Skip to content

Results

Everything here is recomputed from AJ's dataset with python examples/team_results.py <dataset>/results, and the neural-network tables with python examples/train_tcn.py.

Clean courses

AJ's lever-mode drives, 2026-10-22. All 51 recorded runs completed with 0 missed gates.

Course Runs Median score Range Collisions
L1 Gates 4 20.73 s 20.70 to 22.46 s 0
L2 Slalom 6 26.62 s 25.74 to 27.54 s 0
L3 Corridor + Dock 4 16.26 s 16.20 to 17.44 s 0

Score is time plus 5 s per collision and 10 s per missed gate; lower is better.

Judging included one run under a degraded link: 300 ms lag and 10 % of commands dropped. We ran a blind test of lag compensation: 8 sessions of 2 runs each on L1, with the condition hidden from the driver, compared session by session with an exact two-sided permutation test.

Measure On Off p
Score 21.66 s 22.51 s 0.57
Steering jerkiness 0.66 rad/s² 0.74 rad/s² 0.63
Workload (NASA-RTLX, 0 to 100) 43.4 50.4 0.26
Collisions (total) 0 2

Every median favours it, and none of the differences is significant. We keep it on because it did no measurable harm; we cannot claim it helps.

A neural network against the simple model

Four drivers (AJ, Jose, Kiran, Xinyi), 3 seeds per held-out driver. A causal temporal convolutional network (TCN) on the raw signal, against the controller's linear discriminant (LDA) on 16 features. Accuracy over six poses; chance is 0.17. Each cell is the median across drivers, range in brackets.

Test TCN LDA
Your own calibration 0.68 (0.45 to 0.89) 0.85 (0.76 to 0.88)
A driver it never saw, each scaled by their own calibration 0.33 (0.23 to 0.38) 0.32 (0.29 to 0.34)

The second row is the TCN without gain augmentation, its better setting for a new driver. On each person's own data the LDA won for 3 of 4 drivers, and neither model generalises well to someone new. With one short calibration per person (60 s of held poses) the simple model is the right choice, and in lever mode EMG decides only the brake, where the personal LDA made no false fires and no misses on held-out takes.

Full tables, with and without gain augmentation: examples/TCN.md.

The gate assist

Six scripted off-line approaches to L1's first gate, through the real sim with the controller's assist code: 2 of 6 passed the gate with the assist, 0 of 6 without, and 0 collisions either way (gate-trial.json).