1.2.30 Tensor Product Space Definition
The tensor product space merges vector spaces, enabling multilinear operations and forming the basis of tensor algebra.
Tensor Product Space Definition is the characterization of the vector space that results from applying the tensor product construction to a collection of vector spaces, considered as an algebraic object in its own right rather than as the operation that produces it. Given vector spaces , their tensor product space is the vector space , whose elements, structure, and dimension are determined entirely by the factor spaces from which it is built.
Formal Description
Given vector spaces over a field , the tensor product space is the vector space
equipped with the canonical multilinear map satisfying the universal property that every multilinear map out of the product factors uniquely through a linear map on . As a vector space in its own right, supports the ordinary operations of vector addition and scalar multiplication, and questions about its dimension, basis, subspaces, and linear maps can all be posed and answered exactly as for any other vector space, once its relationship to the factor spaces is understood.
Elements of the Tensor Product Space
Every element of the tensor product space is a finite linear combination of elementary tensors , but the space itself is not merely the set of such simple products: it is the vector space they generate, closed under addition and scalar multiplication, and containing sums of elementary tensors that are not themselves elementary. This distinction between the generating elementary tensors and the full ambient space is essential, since most structural questions — dimension, choice of basis, existence of subspaces — concern the space as a whole rather than any single elementary tensor within it.
Dimension and Basis
Finite-Dimensional Case
When each factor space is finite-dimensional with basis , the tensor product space has as a basis the set of all elementary tensors formed by choosing one basis vector from each factor,
and its dimension is the product of the dimensions of the factor spaces,
This multiplicative growth in dimension, in contrast to the additive growth of a direct sum, is the defining numerical signature of the tensor product space: two three-dimensional spaces combine to a nine-dimensional tensor product space, whereas their direct sum would only be six-dimensional.
Basis Independence
Although a basis of is most conveniently exhibited using chosen bases of the factor spaces, the space itself, along with its dimension and its universal property, does not depend on any particular choice of basis; different choices of bases for the factor spaces yield different, but equally valid, bases of the same underlying tensor product space.
Concrete Realizations
Spaces of Multilinear Maps
The dual of a tensor product space is naturally identified with a space of multilinear maps,
giving a concrete realization of the tensor product space in terms of a familiar family of functions. This identification is what connects the abstract tensor product space back to the theory of multilinear forms and to component-based tensor calculus.
Spaces of Linear Maps
For finite-dimensional spaces, the tensor product space is canonically isomorphic to the space of linear maps from to , with an elementary tensor , for a linear functional , corresponding to the rank-one linear map . Under this identification, the matrix representing an element of is exactly the matrix of the corresponding linear map, giving matrix spaces themselves as a concrete instance of a tensor product space.
Structural Properties as a Vector Space
Because a tensor product space is, above all, a vector space, it inherits and interacts with the standard constructions of linear algebra: it possesses subspaces, admits linear maps to and from other vector spaces, can be equipped with a basis-dependent inner product when the factor spaces carry inner products, and can itself serve as a factor in a further tensor product, since nothing in the definition of the tensor product requires the factor spaces to be anything other than ordinary vector spaces. This closure property is what allows repeated tensor products, such as , to be formed without additional definitional machinery.
Role in Tensor Algebra
The tensor product space of copies of and copies of its dual is, by definition, the space of type tensors on , and the direct sum of all such spaces over every choice of and constitutes the full tensor algebra associated to . Understanding the tensor product space as a vector space in its own right — with a definite dimension, an explicit basis built from the factor spaces, and concrete realizations as spaces of multilinear or linear maps — is therefore the structural foundation on which the entire apparatus of tensor algebra, including symmetric and alternating subspaces and index-based component notation, is built.