A map B:En×En→E,(v,w)↦B(v,w) is called a bilinear form (BLF) on En if it is linear in both arguments: ∀u,v,w∈En,∀λ∈E:
B(u+v,w)=B(u,w)+B(v,w),B(λu,v)=λB(u,v)
B(u,v+w)=B(u,v)+B(u,w),B(u,λv)=λB(u,v).
Definition
Let B be a BLF mapping to R. B is called symmetric if B(v,w)=B(w,v) and alternating if B(v,w)=−B(w,v), for ∀v,w∈En.
Definition
A map B:En×En→E,(v,w)↦B(v,w) is called sesquilinear on En if it is linear in the second argument and semilinear in the first argument: ∀u,v,w∈En,∀λ∈E:
B(u+v,w)=B(u,w)+B(v,w),B(λu,v)=λB(u,v)
B(u,v+w)=B(u,v)+B(u,w),B(u,λv)=λB(u,v).
Definition
A sesquilinear form B mapping to C is called Hermitian if B(v,w)=B(w,v).
Definition
A sesquilinear form B is called positive definite if
B(v,v)>0for every v∈En with v=0.
Remark
A symmetric, positive definite BLF is called a Euclidean inner product.
Definition
An inner product is a map ⟨⋅,⋅⟩:En×En→E,(v,w)↦⟨v,w⟩=∑k=1nvkwk such that: ∀u,v,w∈En,∀λ∈E:
⟨v+λw,u⟩=⟨v,u⟩+λ⟨w,u⟩ (bilinearity or sesquilinearity)
⟨v,w⟩=⟨w,v⟩ (symmetry or Hermitian)
⟨v,v⟩≥0 (positive semidefinite)
⟨v,v⟩≥0 and ⟨v,v⟩=0⇔v=0 (positive definite)
Definition
The length or Euclidean norm of a vector x∈En is the non-negative real number ∥x∥ defined by
∥x∥:=⟨x,x⟩=xHx=k=1∑n∣xk∣2.
Remark
Let x,y∈Rn and α∈[0,π] the angle between x and y, then:
⟨x,y⟩=∥x∥∥y∥cos(α).
Parseval’s Identity
Definition
Let B={bi}i∈I be a basis of V, ⟨⋅,⋅⟩ an inner product on V.
B is called orthogonal⇔⟨bk,bl⟩=0,∀k=l
In words: the basis vectors "are ⊥ to each other".
B is called orthonormal (ONB) ⇔⟨bk,bl⟩=δkl={1,k=l0,k=l
In words: the basis vectors "are ⊥ to each other" and have length 1.
Remark
Let V be a vector space with inner product ⟨⋅,⋅⟩, B={bi}i∈I a basis of V. By the definition of a basis, you can write every v∈V as v=∑i∈Iαibi. If B is an ONB, then αi=⟨bi,v⟩,∀i∈I,
⇒ the coordinates of v with respect to B are ⟨bi,v⟩.
Satz
Let B={b1,...,bn} be an ONB of V. Then:
The coordinates of v∈V are given by ξk=⟨bk,v⟩V,k∈{1,...,n}, i.e. v=k=1∑nξkbk=k=1∑n⟨bk,v⟩Vbk.
If ξ=ξ1⋮ξn,η=η1⋮ηn are the coordinate vectors of v,w∈V, ξk=⟨bk,v⟩V,ηk=⟨bk,w⟩V, then Parseval’s identity holds:
⟨v,w⟩V=ξHη=⟨ξ,η⟩
Remark
Parseval’s identity says that the angle between two vectors of a Euclidean/unitary vector space V is not changed by a coordinate transformation, provided we have an orthonormal basis. So we can find a coordinate transformation from V to En and compute the angle with the Euclidean inner product we already know (i.e. the standard inner product).
v⊥w with respect to ⟨⋅,⋅⟩V⇔ξ⊥η with respect to ⟨⋅,⋅⟩
Orthogonal and Unitary Matrices (II)
Definition
The matrix A∈En×n is orthogonal/unitary if and only if the rows of A are pairwise orthonormal to each other (with respect to the standard inner product) and the columns of A are pairwise orthonormal to each other (with respect to the standard inner product).
Definition
A complex n×n matrix A is called unitary if AHA=AAH=𝟙.
A real n×n matrix A is called orthogonal if ATA=AAT=𝟙.
Remark
The notion of orthogonal/unitary matrices A∈En×n is independent of the inner product (by definition via the Euclidean inner product, i.e. AAH=AHA=𝟙). The notion of orthogonal vectors, on the other hand, depends on the inner product ⟨⋅,⋅⟩V under consideration.
Remark
Warning: this remark is a thought experiment and serves to deepen the understanding you have already gained.
If you extended the definition of an orthogonal/unitary matrix to a general inner product ⟨⋅,⋅⟩M, you would get the following:
AMAH=AHMA=𝟙
The matrix M of the M inner product is computed as follows, if the inner product is already given: