2.7.5 Tensor Linear Combination Span Relation
Tensor Linear Combination Span Relation explores how tensors span vector spaces through linear combinations, establishing foundational connections in algebraic structures.
Tensor Linear Combination Span Relation is the precise correspondence between the set of all linear combinations formed from a given collection of tensors and the span of that collection, establishing the span as exactly, and only, the reachable set of such combinations, and thereby fixing the smallest subspace that contains the original collection. It converts the informal idea of "everything buildable from a set of tensors" into a rigorously defined subspace with predictable algebraic behavior.
The Defining Relation
Setting
Let be a vector space over a field , and let be any collection of tensors of a fixed type . The span relation identifies
exactly with the set of all finite linear combinations of elements of , with no tensor belonging to unless it is expressible in this form, and every such combination belonging to .
Span as the Smallest Enclosing Subspace
Span Contains the Original Set
Every element is itself a trivial linear combination, using a single term with coefficient , so .
Span Is Closed Under Linear Combination
A linear combination of elements already in is again in , since substituting the defining combination of each such element back into the outer combination produces a single, larger linear combination of elements of itself. This shows is a subspace.
Minimality
If is any subspace of containing , then must contain every linear combination of elements of , by closure of a subspace under addition and scalar action, so . This establishes as the smallest subspace containing .
Basic Properties of the Span Relation
Monotonicity
If , then , since any linear combination available using terms from the smaller set is also available using terms from the larger set.
Idempotence
Taking the span of a span produces nothing new:
since, as noted above, a linear combination of elements of collapses back into a linear combination of elements of directly.
Span of a Union
The span of a union of two sets equals the sum of their individual spans:
where the right-hand sum denotes the set of all tensors expressible as the sum of an element of the first span and an element of the second, since any combination drawing on both sets separates cleanly into a combination of terms from and a combination of terms from .
Span of the Empty Set
By convention, the empty linear combination, with no terms, equals the zero tensor, so , the smallest possible subspace of .
Span Relation and Spanning Sets
Definition of a Spanning Set
A set is called a spanning set for precisely when the span relation yields the entire space:
The tensor basis spanning property is the specific instance of this relation in which consists of the basis tensor products.
Dimension Bound from a Finite Spanning Set
If is a finite spanning set of size , the span relation implies , since no linearly independent set can exceed the size of a spanning set; equality holds exactly when is also linearly independent.
Span Relation Under Removal and Addition of a Generator
Removing a Dependent Generator
If some already lies in , then , since any occurrence of in a combination can be replaced by its own expression in terms of the remaining elements of , so removing a dependent generator never shrinks the span.
Adding a Generator Outside the Span
Conversely, if , then strictly contains , and its dimension increases by exactly one, since is then linearly independent from every element already spanned by .
Span Relation and Subspace Membership Testing
Reformulating Membership as a Linear Combination Problem
Determining whether a specific tensor belongs to is, by the span relation, exactly the question of whether coefficients exist such that , which, using the coordinate form of a linear combination, reduces to solving a system of linear equations over in the unknown coefficients.