14.10.4 Tensor Matrix Product Dimension Relation

Understanding how tensor matrix products relate dimensions in algebraic structures and their mathematical implications.

Tensor Matrix Product Dimension Relation is the rule connecting the row and column dimensions of the two factor matrices to the row and column dimensions of the composite matrix produced by their tensor product, expressed as a simple multiplicative relationship between the corresponding dimensions.

Statement of the Relation

Row Dimension Multiplication

The number of rows in the composite matrix equals the product of the number of rows in the first factor matrix and the number of rows in the second factor matrix.

rows (C) = rows (A) \times rows (B)

Column Dimension Multiplication

The number of columns in the composite matrix equals the product of the number of columns in the first factor matrix and the number of columns in the second factor matrix.

cols (C) = cols (A) \times cols (B)

No Compatibility Requirement Between Factors

Independence From Conformability

Unlike ordinary matrix multiplication, forming a tensor product places no requirement that the number of columns of the first factor match the number of rows of the second factor; any two matrices of any dimensions can be combined by a tensor product, and the dimension relation applies unconditionally.

Contrast With Ordinary Matrix Multiplication

Where ordinary matrix multiplication demands an exact match between an inner pair of dimensions and discards that shared dimension from the result, the tensor product dimension relation retains all four original dimensions, multiplying them in pairs rather than canceling any of them.

Dimension Relation Diagram

Visualizing the Multiplicative Growth

The diagram below shows how the dimensions of two factor matrices combine multiplicatively to give the dimensions of the composite matrix.

Growth Rate of the Composite Dimensions

Multiplicative Rather Than Additive Growth

Because the dimension relation is multiplicative rather than additive, the size of the composite matrix grows much faster than the sizes of the individual factors as either factor's dimensions increase, a property often described as the exponential blow-up of tensor product constructions.

Total Entry Count

The total number of entries in the composite matrix equals the product of the total entry counts of the two factor matrices, since the entry count of a matrix is itself the product of its row and column dimensions.

entries (C) = entries (A) \times entries (B)

Special Dimension Cases

Square Factor Matrices

When both factor matrices are square, the composite matrix is also square, with side length equal to the product of the two factor side lengths.

Row or Column Vectors as Factors

When one factor matrix is a row vector or a column vector, the dimension relation still applies directly, producing a composite matrix whose row or column dimension along that axis equals the corresponding dimension of the other factor, scaled by the length of the vector.

Consequence for Repeated Tensor Products

Cumulative Dimension Growth Across Several Factors

When a tensor product is formed from three or more factor matrices in sequence, the row dimension and column dimension of the final composite matrix equal the product of the row dimensions and the product of the column dimensions of every individual factor matrix involved.

rows (C) = \prod_{k = 1}^{n} rows (A_{k})

Independence From the Order of Combination

Since the dimension relation depends only on multiplying the individual row and column counts together, the final dimensions of the composite matrix are the same regardless of the order in which the factor matrices are combined, even though the internal arrangement of entries differs with the order chosen.