5.24 Tensor Product Notation

Tensor Product Notation is the collection of symbolic conventions used to write, manipulate, and communicate about tensor products and their elements, ranging from the basic infix symbol ⊗ denoting the product of spaces or vectors, through indexed component notation and the Einstein summation convention, to specialized notations such as Dirac bra-ket notation and abstract index notation used in particular fields. Because the same underlying mathematical object can be described in several structurally different ways, understanding tensor product notation means understanding not just individual symbols but which notational system is in use and what conventions govern it.

The Basic Infix Symbol

Spaces and Elements

The symbol ⊗ denotes the tensor product both at the level of spaces, V ⊗ W, and at the level of elements, v ⊗ w, with context distinguishing the two uses: V ⊗ W names a vector space, while v ⊗ w names a specific simple tensor within that space.

Iterated and Suppressed Parentheses

Multiple applications of ⊗ are written without parentheses, V₁ ⊗ V₂ ⊗ ... ⊗ Vₙ, a convention licensed by the associativity structure of the tensor product, so that this notation is unambiguous up to canonical isomorphism regardless of how the product is actually parenthesized when constructed.

Indexed Component Notation

Explicit Index Notation

Relative to chosen bases, a tensor is written by its components c_{ij} or, for higher order, c_{i₁ i₂ ... iₙ}, with each index ranging over the corresponding basis of one tensor factor; this notation makes the multi-linear, multi-index nature of a tensor explicit and is standard throughout physics and engineering.

The Einstein Summation Convention

Under the Einstein summation convention, a repeated index appearing once as a superscript and once as a subscript is automatically summed over, suppressing the explicit summation symbol; this convention is especially common in index notation for tensor products, where sums over many repeated indices would otherwise clutter every expression.

Diagram Contrasting Notational Styles

Covariant and Contravariant Index Placement

Upper versus Lower Indices

Classical tensor notation distinguishes upper indices (contravariant, associated with the original space V) from lower indices (covariant, associated with the dual space V*), so a tensor with p factors from V and q factors from V* is written with p upper and q lower indices, T^{i₁...iₙ}_{j₁...jᵩ}, encoding both its tensor product structure and how its components transform under a change of basis.

Transformation Behavior Encoded in Placement

This upper/lower distinction is not merely stylistic: it specifies precisely how each index transforms when the underlying basis changes, upper indices transforming with the inverse change-of-basis matrix and lower indices transforming with the change-of-basis matrix itself, matching the transformation rule for elements of V versus elements of V*.

Bra-Ket and Physics-Style Notation

Dirac Notation for Tensor Products of States

In quantum mechanics, a tensor product of two state vectors |v⟩ ∈ V and |w⟩ ∈ W is written |v⟩ ⊗ |w⟩ or, abbreviated further, |v, w⟩ or |vw⟩, treating the tensor product structure of a composite system's state space largely implicitly, with the ⊗ symbol often suppressed once the composite structure has been established in context.

Suppressing the Symbol in Well-Understood Contexts

This suppression mirrors a broader notational tendency: once the reader knows that a given multi-particle or multi-index quantity lives in a tensor product space, the explicit ⊗ symbol is frequently dropped, since juxtaposition or a comma-separated list already conveys the same information unambiguously in that established context.

Notation for Tensor Product of Maps

The Analogous Infix Notation for Morphisms

Just as ⊗ combines spaces and vectors, the same symbol combines linear maps, f ⊗ g : V ⊗ W → V′ ⊗ W′, with the understanding, conveyed by context, that this use of ⊗ denotes the tensor product of linear maps operation rather than the tensor product of vector spaces or elements.

Matrix Notation via the Kronecker Product Symbol

In explicitly finite-dimensional, matrix-based contexts, the tensor product of linear maps is often written using the Kronecker product notation A ⊗ B for the corresponding matrices, visually identical to the abstract tensor product symbol but referring specifically to the concrete block-matrix construction.

Significance of Tensor Product Notation

Enabling Communication Across Different Mathematical Traditions

Because tensor products arise across pure algebra, differential geometry, physics, and applied computation, each with its own notational habits, understanding the range of tensor product notations — abstract, indexed, bra-ket, matrix — is necessary to read and translate between sources from different traditions describing the same underlying mathematical objects.

Notation as a Reflection of Emphasis

The choice of notation in a given context often reflects what is being emphasized: abstract ⊗ notation emphasizes basis-independent structure, indexed notation emphasizes explicit computation and transformation behavior, and bra-ket notation emphasizes physical states and their composition, even though all describe the same underlying tensor product construction.