TRANSMISSION // 2611.09790v1
Why the Matrix Logarithm Stands Out for Modelling Correlations
Source published
A theoretical preprint compares a family of transformations that turn correlation matrices into numerical coordinates. The logarithmic member combines unrestricted coordinates, favourable worst-case numerical conditioning and locally stable sampling uncertainty. Gaussian simulations illustrate benefits for statistical testing—but also show that the transformation alone does not fix small-sample errors.

A collection of individually plausible correlations need not form a valid correlation matrix. In a preprint, Ilya Archakov and Peter Reinhard Hansen investigate transformations that make this collective constraint easier to handle, explaining why the matrix logarithm occupies a special position—and where its advantages stop.
Why pairwise limits are not enough
A correlation matrix records how variables move together. Its diagonal entries are one, and its other entries lie between minus one and one. But those individual limits are insufficient: the entries must also satisfy a collective requirement called positive definiteness. The paper studies strictly positive definite matrices, excluding singular boundary cases.
This makes modelling awkward. Choosing or forecasting each correlation separately—even after applying Fisher’s familiar transformation to each pair—does not guarantee a valid matrix when there are more than two variables. An alternative is to represent the whole matrix using unrestricted numerical coordinates, then convert those coordinates back into valid correlations.
One family, several familiar representations
The authors examine matrix versions of the Box–Cox transformation, controlled by a parameter α. For nonzero α, they transform a correlation matrix C into (C^α − I)/α, then retain the entries below the diagonal. At α = 0, the limiting transformation is the matrix logarithm.
Crucially, powers and logarithms operate on the matrix’s eigenvalues, not separately on its entries. The family includes raw correlations at α = 1, the generalised Fisher transformation at α = 0, and the negated off-diagonal entries of the inverse correlation matrix at α = −1.
Recovering C requires finding the missing diagonal of the transformed matrix so that the recovered matrix has a unit diagonal. The authors formulate this as a strictly convex optimisation problem. Their proofs establish that no two valid correlation matrices share the same coordinates, and that the transformation has a smooth inverse on its image.
The dividing line is zero
The central classification is exact: every possible coordinate vector corresponds to a valid correlation matrix if and only if α is zero or negative. For positive α, the attainable coordinates occupy a bounded region.
The distinction comes from behaviour near a zero eigenvalue. For α ≤ 0, the scalar transformation diverges there. In the authors’ equivalent optimisation formulation, this creates an infinite marginal penalty against selecting a singular matrix. Positive α lacks that protection.
The shape of the attainable region also matters. It is convex for α between one-half and one, so averaging valid transformed forecasts remains valid. Other cases can be nonconvex: the authors prove this above one for matrices of dimension at least three, and near one-quarter for dimension at least four. They do not completely classify the remaining positive range.
Among unrestricted members, the logarithm has the smallest exponent in a worst-case bound on numerical conditioning. Negative powers can distort sensitivity more strongly as the original matrix approaches singularity. The bound is attainable in dimensions of at least four, but it does not promise that the logarithm performs best at every particular matrix.
Stable uncertainty is not universal normality
Under independent Gaussian sampling, all family members have the same identity asymptotic covariance at independence, after estimation errors are multiplied by the square root of sample size. For at least three variables, only α = 0 eliminates the first-order dependence of that joint covariance on nearby correlations.
This is a local, large-sample result—not a guarantee of constant uncertainty everywhere. Each individual coordinate’s variance is already stable to first order for every α; the logarithm’s distinctive advantage concerns their joint covariance. Changing coordinates does not create additional statistical information.
A different criterion favours a different parameter. At independence, individual coordinates are symmetric for every member, but a leading third-order dependence among three coordinates forming a triangle disappears only at α = one-third under Gaussian sampling. That value changes for Gaussian scale mixtures. The logarithm therefore does not optimise every aspect of distributional shape or bias.
Simulations show why calibration still matters
The paper illustrates tests of separability: whether a correlation matrix factors into two smaller matrices through a Kronecker product. In logarithmic coordinates, this becomes a linear restriction.
Gaussian simulations nevertheless show severe false-positive rates with standard large-sample critical values. For a 20-variable separable design with 100 observations, a nominal 5% test rejected 45.3% of samples in logarithmic coordinates and 73.6% using raw correlations.
Parametric bootstrap calibration reduced those rates to 5.0% and 6.8%, respectively. Most reported bootstrap results use a pooled, computationally economical approximation; conventional bootstrap checks supported the main comparison in selected difficult designs. These are simulation findings, not evidence from an empirical application or a universal ranking of tests.
A second family exchanges the computational burden
The authors also rescale matrices before transforming them, choosing the rescaling so the transformed diagonal is zero. This family makes recovery explicit, while computing the forward transformation requires convex optimisation.
Here, only the logarithmic member has unrestricted coordinates. Its logarithmic construction was already known; the contribution extends the convex scaling framework across the Box–Cox family. The overall lesson is a qualified one: logarithmic coordinates combine several useful mathematical properties, but finite-sample inference still needs careful calibration.
- correlation matrices
- Box–Cox transformation
- matrix logarithm
- generalised Fisher transformation
- convex optimisation
- variance stabilisation
- statistical simulation