Skip to content

The matched foreign draw implemented

holdout.matched_foreign_draw builds item 3 of the H2 plan: for one run's sibling draw it takes as many in-language rows from the foreign pool as the sibling holds and fills the rest from the pool's other rows, each stratum shuffled by the run's training seed and the sibling it is matched to (a refinement of item 3's "the run's training seed", so a run's two foreign adapters get independent draws). A pool that repeats an example id is refused, since repeats would count as capacity. A pool that cannot cover a draw is refused, never trained smaller, since that is a source that does not qualify. The partition jobs call it once a source's maintainers grant permission and its pool is built; no foreign draw has been made.