Skip to content

The planted check at a half passes 10 of 10 runs: registered at a half, read on the planted run only

The ten runs planned above, repeated at PLANT=0.5 (jobs 210234 to 210243, pinned at b05a2d8), rq1-partition-openstack-*-n1850-plant0.5.json. All ten pass. Every half's lower bound is above zero (least +0.017); per-half estimates run from +0.053 to +0.142. The pass probability projected by the logged rule (normal per half, interval half-width over 1.96 as the standard error, product over halves) is at least 0.9989 for every run and 0.9999 on average. Both conditions of the rule hold, so check 5 is registered with the plant at a half: neutral.planted_convention, which reads the plant's strength and window from the run's corpus path and refuses any other, and partition_pilot.py --planted, which halts the cell when it fails.

The draft's second clause is dropped. The Stage 1 draft also required that "unplanted must not" pass. Under the repeated-partition design the unplanted dev runs are H1's own data: a pass there is H1 holding on the development window, so a halt on it would turn on the outcome, which an outcome-neutral test may not. For the record, none of the 24 unplanted OpenStack pilot runs passes (23 fail, 1 mixed). The check reads the planted run only.

Planned before any run: the same measurement on Wikimedia. Check 5 runs on every admitted organization, and its pass rate was measured on OpenStack only. Ten runs at PLANT=0.5 on Wikimedia's first ten admissible partitions (seeds 1, 2, 3, 5, 6, 7, 8, 9, 10, 11) at training seeds 1 to 10, N = 1,850, corpus v3, the jobs otherwise as its pilot's. The same rule: registered for Wikimedia if all ten pass and the projected pass probability is at least 0.95; otherwise the check is redesigned for Wikimedia before Stage 1 is submitted. The rates are logged whichever way they fall.