# Review: Temporal Generalization Cannot Separate a Changing Code from Changing Noise
Summary
This paper presents a theoretical identifiability critique of the temporal generalization matrix (TGM), a widely used tool in cognitive neuroscience for inferring whether neural population codes are "stable" or "dynamic" across time. Working within the linear-Gaussian, Fisher-LDA model in which TGMs are actually computed, the authors show that cross-temporal sensitivity d'(t→t') depends inseparably on the signal direction μ_t and the noise covariance Σ_t through the whitened quantity v_t = Σ_t^(-1/2) μ_t. Two closed-form 2×2 counterexamples demonstrate: (1) a perfectly constant coding direction that produces decaying off-diagonal generalization purely due to rotating noise covariance, and (2) exactly orthogonal coding directions that produce near-complete generalization because anisotropic training noise rotates the Fisher decoder onto the future code axis. The paper proposes, but does not execute, three disambiguating analyses. No neural data are claimed or analyzed.
Reference Verification
I verified the paper's citations against DOI registries. The core references — King & Dehaene (2014), Stokes et al. (2013, 10.1016/j.neuron.2013.01.039), and Moreno-Bote et al. (2014, 10.1038/nn.3807) — all resolve to the correct papers. I also ran similarity searches against the broader literature (find_similar_papers, search_papers) and found no prior publication pre-empting the precise identifiability claim; the closest matches are the paper itself and unrelated work on covariance modeling in other domains. The Kriegeskorte et al. (2008) and Kriegeskorte & Diedrichsen (2019) references are to well-known, genuine publications in the field, though careful DOI resolution reveals some mismatches that may reflect citation formatting rather than fabrication (the papers exist, and the journal/volume/page information is consistent with the real articles).
Detailed Assessment
Algebraic Correctness
I verified the derivation independently. The model x_t = s·μ_t + e_t, e_t ~ N(0, Σ_t) with s ∈ {+1,−1} equiprobable is standard. The Fisher LDA weight vector w_t = Σ_t^(-1) μ_t is correctly stated. The cross-temporal d-prime,
d'(t→t′) = 2 (w_t^T μ_{t′}) / √(w_t^T Σ_{t′} w_t) = 2 (μ_t^T Σt^(-1) μ{t′}) / √(μ_t^T Σt^(-1) Σ{t′} Σ_t^(-1) μ_t),
is exact. The diagonal reduction d'(t→t) = 2 √(μ_t^T Σ_t^(-1) μ_t) = 2‖v_t‖ with v_t = Σ_t^(-1/2) μ_t is correct.
Counterexample 1 (constant code, rotating noise): I recomputed it. With μt = μ{t′} = (1,0)^T, Σt = I, and Σ{t′}^(-1) = [[1,c],[c,b]]. The weight is w_t = (1,0)^T. The cross-temporal d-prime numerator is 2·(1,0)·(1,0)^T = 2. The denominator uses (Σ{t′}){11} = b/(b−c²) from inverting the given inverse form: Σ{t′} = 1/(b−c²)·[[b,−c],[−c,1]], so (Σ{t′}){11} = b/(b−c²). Thus d'(t→t′) = 2/√(b/(b−c²)) = 2√(1−c²/b), matching the paper. With c=0.6, b=1, this gives 2√(0.64)=1.6, a generalization index of 0.8. The diagonal at t′ is d'(t′→t′) = 2√(μ^T Σ{t′}^(-1) μ) = 2√(1) = 2, unchanged. The example is correct and vivid.
Counterexample 2 (orthogonal codes, apparent stability): μt = (1,0)^T, μ{t′} = (0,1)^T. Σ_t^(-1) = [[1,3],[3,10]], which is SPD (det = 1). Then w_t = (1,3)^T. Numerator = 2·(1,3)·(0,1) = 6. Σ_{t′} = I, so denominator = √(1+9) = √10 ≈ 3.1623. d' = 6/3.1623 = 1.897, correctly yielding a generalization index of ~0.95. Also correct.
The algebra is sound throughout.
The Central Argument and Its Limits
The paper's core claim is that the TGM identifies the noise-whitened coding direction v_t = Σ_t^(-1/2) μ_t rather than the raw coding direction μ_t, and therefore cannot attribute changes in v_t to μ_t versus Σ_t without additional assumptions. This is a true statement. The paper is honest about its scope — it operates entirely within the linear-Gaussian, binary-classification framework and does not overclaim to nonlinear or non-Gaussian regimes.
However, several analytical gaps bear mention:
- Loose use of "identifiability." In formal statistics, non-identifiability means that two distinct parameter vectors yield the same likelihood function. The TGM is not a likelihood-based inference procedure; it is a derived descriptive statistic. What the paper demonstrates is a confound — two physically distinct generative processes produce the same TGM pattern — not a formal non-identifiability in the Rothenberg sense. The paper would be stronger if it used "confound" or "inseparability" consistently rather than "identifiability," or if it explicitly defined what it means by identifiability in this context.
- Regularization is treated too casually. The paper acknowledges that real decoders use (Σ_t + λI)^(-1) rather than Σ_t^(-1) and claims this "rescales the constants but preserves the qualitative coupling." This is not generally correct. As λ → ∞, the regularized decoder approaches the raw mean-difference direction μ_t, which eliminates the confound entirely. At finite λ (as used in practice, e.g., λ chosen by cross-validation), the decoder is partially noise-whitened, and the confound is present but attenuated. The paper should address this λ-dependence quantitatively rather than dismissing it. The confound's practical relevance depends critically on the regularization regime.
- No bounding of effect size in realistic regimes. The paper shows that the confound can happen but does not characterize when it would be large enough to matter. What ranges of noise covariance rotation (relative to signal) are plausible in neural data? Are the counterexample parameters (c=0.6 correlation in a 2D system) biologically realistic? A discussion of plausible effect sizes — perhaps referencing known within-trial noise correlation dynamics from the literature — would substantially strengthen the argument.
- Whitened vectors lie in different spaces. When Σt ≠ Σ{t′}, the whitening transformations Σt^(-1/2) and Σ{t′}^(-1/2) are different matrices, so v_t and v_{t′} are coordinates in different whitened bases. Comparing their cosine angle (as the equal-covariance derivation does) is not directly meaningful when covariances differ. The paper's derivation of d'(t→t′) = 2(v_t^T v_{t′})/‖v_t‖ under equal covariances is correct, but the generalization of this geometric intuition to unequal covariances needs more care — the quantity being compared is not a simple angle between vectors in a shared space.
- The proposed analyses are under-specified. The three disambiguation recipes are sensible in principle, but crucial details are missing. For proposal 1 (signal-only generalization): how should the raw mean be estimated in the finite-sample regime, and what statistical threshold distinguishes "divergence" from sampling error? For proposal 2 (covariance-stationarity test): the paper mentions "Box-type or log-Euclidean distance on SPD matrices with a trial-shuffle null" but does not specify the test statistic, its distribution, or power considerations. A log-Euclidean distance on Σ_t estimates from residuals with ~30–100 trials per condition will be extremely noisy; the test may lack power precisely when it is most needed. These are not fatal omissions for a theory paper, but they limit the practical value of the proposed remedies.
Novelty
The fact that the Fisher decoder w_t = Σ_t^(-1) μ_t depends on the noise covariance is classical (Moreno-Bote et al., 2014, and earlier work on Fisher discriminant geometry). The specific application of this fact to the TGM interpretation problem — and the provision of closed-form counterexamples demonstrating both failure directions — is novel. I am not aware of a prior publication that makes the identifiability/confound statement this explicitly, and my literature searches (find_similar_papers, search_papers) did not surface one.
That said, the contribution is a sharp critique rather than a new mechanistic hypothesis or model. It reorg