CM-16 / multi-day attempt / not promoted
More objectives did not produce a better replacement.
CM-16 explored whether next-move training could benefit from extra supervision: win/draw/loss, a sampled future move, and board occupancy. After the original November 4 run and token-interface adaptation, the selected continuation ran from November 5, 09:42 UTC to November 9, 17:06 UTC. That is 103.4 elapsed wall-clock hours, including interruptions, not GPU-hours.
The retained trajectory reached update 665,007 and 5.481 billion ordinary target visits. Visits include repeated examples and are not a count of unique positions or games. The experiment was stopped for assessment and did not replace CM-14.
What the playing evidence says
The early periodic studies below consistently lost their direct comparisons with CM-14. A later matched CPU full-system comparison at CM-16 update 369,403 scored 33W / 2D / 15L against Sunfish (68% over 50 games), versus CM-14's 49W / 1D / 0L (99%) on the same 25 opening pairs. Its separate direct match against CM-14 was 8W / 0D / 42L (16% over 50 games). These are results for that intermediate checkpoint, not final update 665,007.
Final assessment limit. Later latest-checkpoint GPU cohorts failed their audit because required GPU telemetry was missing. The assessment was then stopped. Those results are excluded from the headline; no clean final-checkpoint strength result is claimed. “Unsuccessful” means the training experiment did not establish a better replacement for CM-14.
A compute-budget hypothesis, not a causal finding
My working hypothesis is that, with the compute available here, the extra objectives made learning the main chess task harder: more work per useful next-move update, more targets competing for the same model capacity, or both. This remains a hunch informed by the experiment. The run does not isolate those mechanisms or show that auxiliary objectives are generally harmful.
A useful test would hold data, architecture, optimizer, serving harness and evaluation fixed, then compare next-move/WDL training with and without each added objective under matched wall-clock and target budgets. Multiple seeds and fresh openings would help distinguish a repeatable effect from this development history.
What changed during the run
- November 4–5: original baseline, embedding adaptation and selected full-network continuation.
- November 7: ordinary targets changed to equal weighting at update 247,803; WDL then moved to shared clean-history semantics at update 307,472.
- November 8: FUTURE_8 and board-occupancy objectives were removed at the update 418,201 boundary. Next-move and WDL training continued.
- November 9: training stopped at update 665,007 for assessment.
Data exposure, objective weights, output semantics, training duration and evaluation protocols all changed. The later two-task loss normalization is not directly comparable with the earlier four-task aggregate. Continuing the same weights after removing objectives is not a from-scratch ablation.
Eight earlier periodic evaluations, with their original sample sizes
Periods 1–3 used 100-game Sunfish cohorts. Periods 4–8 changed to a 50-game clock-aware search protocol without helpers. Do not connect these rows as one controlled curve. The separate head-to-head protocol stayed at 25 games: 12 color-reversed opening pairs plus one predeclared CM-16-black game. These development openings had prior exposure. They are not final-checkpoint results.
Dated outcome, checkpoint identities and source hashes · Matched CPU full-system comparison · Historical adaptation recipe
The original recipe, preserved in context
This is the dated November 5 plan and earlier observations. It records the choices made then; the outcome and later amendments above supersede its prospective status wording.