Hilbert Space: Definition and Fundamental Properties

A Hilbert space is a complete vector space equipped with an inner product that allows the measurement of lengths, angles, and orthogonality. It generalizes the familiar Euclidean space to finite- and infinite-dimensional settings and forms one of the central mathematical structures in functional analysis, quantum mechanics, signal processing, and machine learning.

Definition

A Hilbert space $ H $ is a vector space over the field of real numbers $\mathbb{R}$ or complex numbers $\mathbb{C}$ together with an inner product

$$
\langle x, y \rangle : H \times H \rightarrow \mathbb{F},
$$

where $\mathbb{F} = \mathbb{R}$ or $\mathbb{C},$ satisfying the following axioms:

1. Linearity
   [
   \langle ax + by, z \rangle
   = a\langle x,z\rangle + b\langle y,z\rangle.
   ]
2. Conjugate symmetry
   [
   \langle x,y\rangle\overline{\langle y,x\rangle}.
   ]
3. Positive definiteness
   [
   \langle x,x\rangle \ge 0,
   ]
   with equality only when
   [
   x=0.
   ]

The inner product induces a norm

[
|x|

\sqrt{\langle x,x\rangle},
]

which defines a metric

[
d(x,y)=|x-y|.
]

A Hilbert space is complete, meaning that every Cauchy sequence converges to an element of the space.

---

Fundamental Properties

1. Completeness

Completeness is the defining feature distinguishing Hilbert spaces from general inner-product spaces.

Every Cauchy sequence

[
x_1,x_2,\ldots
]

has a limit

[
x\in H.
]

This guarantees that limits of convergent processes remain inside the space.

---

2. Inner Product

The inner product generalizes the Euclidean dot product.

It allows one to define:

• length,
• angle,
• orthogonality,
• projection,
• distance.

For vectors (x,y),

[
\cos\theta

\frac{\operatorname{Re}\langle x,y\rangle}
{|x||y|}.
]

---

3. Norm

The induced norm satisfies

• positivity,
• homogeneity,
• triangle inequality.

Thus,

[
|x+y|
\le
|x|+|y|.
]

---

4. Orthogonality

Two vectors are orthogonal if

[
\langle x,y\rangle=0.
]

Orthogonality extends the familiar notion of perpendicular vectors.

---

5. Orthonormal Bases

A Hilbert space possesses an orthonormal basis

[
{e_i}.
]

Every vector can be uniquely represented as

[
x

\sum_i
\langle x,e_i\rangle e_i.
]

In infinite-dimensional spaces this sum converges in norm.

---

6. Parseval’s Identity

For an orthonormal basis,

[
|x|^2

\sum_i
|\langle x,e_i\rangle|^2.
]

This generalizes the Pythagorean theorem.

---

7. Projection Theorem

If (M) is a closed subspace of a Hilbert space, every vector (x) can be uniquely decomposed as

[
x

m+n,
]

where

• (m\in M),
• (n\perp M).

Thus,

[
m

P_Mx,
]

where (P_M) denotes the orthogonal projection.

---

8. Riesz Representation Theorem

Every continuous linear functional

[
f:H\rightarrow\mathbb{F}
]

can be represented uniquely as

[
f(x)

\langle x,y\rangle
]

for some unique vector

[
y\in H.
]

This theorem is one of the cornerstones of functional analysis.

---

9. Cauchy–Schwarz Inequality

For all vectors,

[
|\langle x,y\rangle|
\le
|x|,|y|.
]

Equality holds only when the vectors are linearly dependent.

---

10. Pythagorean Theorem

If

[
x\perp y,
]

then

[
|x+y|^2

|x|^2+|y|^2.
]

---

11. Infinite-Dimensional Structure

Unlike Euclidean spaces, Hilbert spaces may have infinitely many independent directions.

Examples include

• square-integrable functions,
• Fourier series,
• wave functions,
• sequences.

---

Typical Examples

Hilbert Space	Elements	Inner Product
(\mathbb{R}^n)	vectors	(x\cdot y)
(\mathbb{C}^n)	complex vectors	(\sum x_i\overline{y_i})
(\ell^2)	square-summable sequences	(\sum x_i\overline{y_i})
(L^2(a,b))	square-integrable functions	(\int_a^b f(x)\overline{g(x)},dx)

---

Importance in Mathematics and Physics

Hilbert spaces provide the mathematical framework for many areas of modern science:

• Quantum mechanics: States are represented by vectors in a Hilbert space, while observables are represented by linear operators.
• Functional analysis: Hilbert spaces are fundamental objects for studying linear operators, spectral theory, and partial differential equations.
• Signal processing: Signals can be modeled as elements of (L^2) spaces, enabling Fourier analysis and filtering techniques.
• Machine learning: Kernel methods and reproducing kernel Hilbert spaces (RKHS) extend linear algorithms to nonlinear problems.

---

Summary

A Hilbert space is a complete inner-product vector space that extends Euclidean geometry to infinite dimensions. Its key features include:

• an inner product,
• an induced norm and metric,
• completeness,
• orthogonality,
• orthonormal bases,
• unique orthogonal projections,
• the Riesz Representation Theorem,
• Parseval’s identity,
• the Cauchy–Schwarz inequality,
• broad applicability across mathematics, physics, engineering, and data science.

These properties make Hilbert spaces one of the most powerful and versatile structures in modern mathematics.