Training size does not explain the pairwise pattern¶
datasets/results/projects-qt-creator_qt-creator-qt_qtbase-n788.json. qt-creator vs qtbase rerun at
788 training examples per side (TRAIN_SIZE=788, a nested subsample of the 1,517), the size the two
qtdeclarative pairs trained at. Same held-out changes, one seed.
| qt-creator vs qtbase | qt-creator side | qtbase side |
|---|---|---|
| 1,517 per side (148203) | +0.079 [+0.041, +0.118] | -0.019 [-0.046, +0.008] |
| 788 per side (148408) | +0.044 [+0.013, +0.077] | -0.003 [-0.035, +0.031] |
At the same 788 examples where qt-creator showed no advantage over qtdeclarative (+0.005), it still beats qtbase. The difference between the pairs is the pair, not the training size, which confirms the reading of the earlier entry: qt-creator's refinements carry something qtbase's adapter lacks and qtdeclarative's has. The effect roughly halves with half the data, as a learned property should, and qtbase still never wins at home.