mr-onion

Phase 39 Gate C Report — Split and Serial (TFP-214, TFP-241, TFP-222, TFP-155, TFP-156)

Date: 2026-10-21 Evidence: benchmarks/2026-10-21-gate-c/. analysis.md has every number below. Targets: the record’s Gate C table (phase-39-run-concurrency-decision-record.md, “Gate C”). Setup:

For Emil: two decisions, below.

Bottom line

Comparison Judges Target with-bugs clean
C against C1 TFP-241’s cost under 5% 2.5% slower: kept (not run)
C1 against C2 TFP-214 at least 10% faster 14.9%: met 20.5%: met
A against C2 accessibility at least 30% faster 12.1%: not met 35.0%: met
C2 against F TFP-222, 155, 156 same results; no slower beyond 5% Standard 1.6%, accessibility 1.6% faster; same: met 1.7%, 0.0% faster; same: met
F against FL where the axe scan runs identical axe findings and faster identical, 15.6% faster identical, 21.1% faster

Run times (seconds; median, then each run)

Copy Suite A C C1 C2 F FL
with-bugs Standard - 847 (836, 851, 847) 868 (861, 868, 874) 739 (738, 748, 739) 727 (727, 727, 723) -
with-bugs Accessibility 207 (205, 210, 207) - - 182 (182, 182, 181) 179 (181, 177, 179) 151 (157, 151, 150)
clean Standard - - 521 (521, 512, 531) 414 (416, 412, 414) 407 (401, 407, 420) -
clean Accessibility 197 (197, 214, 195) - - 128 (133, 125, 128) 128 (128, 135, 127) 101 (101, 127, 100)

Decision 7: the same results (analysis.md)

The with-bugs / sort message (Gate B ruling 4)

For Emil

  1. Accessibility on with-bugs: 12.1% against 30%.
    • The cause is Gate B’s: the axe scan fails on all 20 with-bugs pages. Each failure restarts the worker, so the checks after it load the page again. On clean, where it fails on fewer pages, the target is met (35.0%).
    • With the scan last (FL), with-bugs reaches 27.1% (151 s against A’s 207 s), and clean 48.7%.
    • Options:
      • a. Accept the gate, with the with-bugs miss recorded. Standard is past its targets on both copies, clean accessibility is past its target, and with-bugs accessibility is 12% faster with the same results. Recommended.
      • b. Make scan-last the default (decision 2) and judge with-bugs accessibility on FL: 27.1%, still short of 30%.
      • c. Apply the rule as locked: not met, reverted. That would give up TFP-214’s Standard gains (15% and 20%) for a target that one copy’s bug pattern decides.
  2. The axe scan last becomes the default, as Emil’s rule says (identical findings on both copies, and faster: 15.6% and 21.1%).
    • This needs the switch’s default flipped, check:template-unchanged’s baseline moved in its own commit, and the template’s accessibility suites changed in order only. Not done without Emil’s go-ahead.