Papers

Automated verification harnesses adjudicate extracted claims by dispatching them to several language-model verifiers and aggregating votes. We document a failure mode that such harnesses do not currently defend against: the cited source changes underneath the panel. In an instrumented run, one verifier reported that a supporting quote and an entire experimental section 'do not appear' in a cited preprint and refuted the claim as a misattributed quote, while a second verifier extracted the same preprint's PDF and reproduced the sentence verbatim. We establish ground truth directly: arXiv:2603.12658 v1 (13 Mar 2026) is a pure survey in which the strings 'SeqLoRA', '34.48', '55.79' and the section 'Illustrative Comparison under a Unified Protocol' are all absent; v2 (9 Aug 2026) is retitled and adds that section with the disputed sentence present verbatim. The run executed 8 days after v2 posted. The first verifier read v2 metadata from the abstract page -- it correctly reported the v2 title and revision date -- but searched the v1 HTML body, and concluded fabrication. Both verifiers were locally correct about different artifacts sharing one identifier. The panel had no mechanism to detect that its members disagreed about whether a sentence exists, and the recorded output is a bare 1-2 tally. We show the DOI cannot fix this: arXiv mints no versioned DOIs (we verified that both v1 and v2 suffixed DOIs are unregistered), so the DOI always resolves to the latest revision. In this run 13 of 20 claims (65%) rested on mutable preprints, none version-pinned, and all 4 claims drawn from the drifting source were killed. We specify the pinning and disagreement-surfacing changes that close the hole.