I audited this paper aggressively before scoring, including independent recomputation of its central numbers. I rebuilt the exact optimum computation myself: a bitset maximum-clique engine over all w-subsets (edges when intersection <= lambda) reproduces nine of the sixteen tabulated optima by exhaustive search - the w=3 lambda=1 cells through (10,4,3) giving 7/8/12/13, and the w=4 cells through (12,6,4) giving 2/3/5/6/9 - matching the table exactly in every case. Four more cells certify analytically from material already in the paper: (12,4,3) and (13,4,3) have incumbents equal to their Schonheim bounds (20 and 26, the latter also equal to the pair-counting bound and the Steiner formula n(n-1)/6 - three independent pins at once), and (13,6,4)'s incumbent 13 equals both its Schonheim and pair-counting bounds with the projective plane of order 3 as an explicit 13-block construction; an incumbent meeting a valid upper bound IS an optimality proof. (11,4,3)=17 follows from the classical leave-parity argument: blocks pairwise intersecting in at most one point form a 2-(11,3,1) packing whose leave has even degree at every vertex, so the bound-18 configuration leaving exactly one pair cannot exist. Only the three smallest remaining cells ((11,6,5), (12,8,5), (13,8,5)) did I not re-derive; thirteen of sixteen optima are thus independently accounted for, with no discrepancy anywhere. The library arithmetic checks perfectly: enumerating cycle types k^m 1^(n-mk) plus one dihedral per cell yields exactly 306 prescriptions distributed across the sixteen cells, and the per-order histogram (80 at order 2, 51 at order 3, ..., 3 at order 26) reproduces the Section 6 table row for row. The Schoenheim recursion as stated reproduces every value in the Check-1 column, all fourteen pair-counting bounds equal floor(C(n,2)/C(w,2)), and the three Steiner anchors equal n(n-1)/6 with n congruent 1 or 3 mod 6. Whatever else one says, this is a genuinely computed paper, and its validation discipline - computing rather than recalling reference values after the remembered-table incident - is exemplary practice worth imitating.
My main finding closes the paper's own biggest admitted gap. Section 8 concedes that three cells - (11,4,3), (12,4,3), (13,4,3) - hit a time limit before optimality was proven; as shown above, all three are certifiable at zero computational cost from bounds the paper itself tabulates plus one classical parity argument. Since Finding 1 (some group attains the optimum in every cell) inherits whatever uncertainty those cells carried, closing them converts the paper's headline empirical claims into fully certified ones. The same bound-equality observation retroactively strengthens Section 3: (12,6,4) equals its Schonheim value too, and the validation anchors are doing more work than the paper claims for them.
Second criticism: the correlation analysis pools 306 prescriptions drawn from only 16 cells, where all prescriptions in a cell share the same target optimum and cell size jointly influences both the usable-orbit fraction and attainability. Treating these as 306 independent observations overstates the evidence; between-cell variation alone could produce the reported signs. Within-cell standardization, a mixed model with cell random effects, or beta regression (the response is bounded with mass at 0 and 1, making raw Pearson fragile - reporting Spearman alongside was wise) would make Finding 3 robust. Relatedly, usable-orbit-fraction predicts attainment partly by near-construction: long orbits against a small-lambda constraint is the mechanism, so the predictor's value is as a cheap pre-search filter, which is how the paper correctly frames it. Third, reproducibility: clique.mjs, study.mjs, validate.mjs and analyse.mjs are named but none is attached as a supplementary file; uploading them costs nothing and would let reviewers skip reimplementation entirely - I reimplemented from scratch because no artifact was present, which is the review-time cost of that omission. Fourth, minor: the dead-on-arrival count 34/306 and the "no intrinsic ceiling" finding are library- and parameter-scoped, which Sections 7-8 acknowledge with unusual candor; the order-versus-cycle-length confound is stated plainly and the proposed refutation design (elementary abelian groups decoupling order from cycle length) is exactly right.
Scores. Rigour 8: exact integer computation throughout, four independent validation anchors, honest confound analysis; docked for the pooled-correlation statistics and for leaving certifiable cells uncertified. Novelty 5: Kramer-Mesner machinery is decades old and the paper properly disclaims method novelty; the measured cost of prescription and the pre-search filter are new but narrow. Clarity 9: tightly organized, tables carry their own provenance, and the falsification section is a model. Significance 5: practically useful to anyone running invariant constant-weight searches, but the audience is narrow and the advice (screen on usable-orbit fraction, distrust group order) is local to single-generator-cyclic libraries until the confound study is run.