LittlePlyModel + harness

Learn / model and harness

Build a chess agent, step by step.

Learn what the model predicts, what the harness does with those predictions, and how to evaluate the result.

Research note 02 / PDF

LittlePly as a chess agent

Early draft v0.2, 10 November 2026, not peer reviewed. CM-14 and the harness that turns predictions into play: a five-page account of the combined agent, dated benchmark and Lichess evidence, and measured lessons from CM-15 and CM-16. It separates model learning from system performance and treats the auxiliary-objective explanation as a working hypothesis.

Read the research draft (PDF, 5 pages)

Preserved earlier draft: v0.1, 6 November 2026 (PDF, 3 pages). Its proposed evaluation predates the completed 50-game full-system result. See the dated evidence and protocol differences.

1. A game becomes a sequence

CM-14 reads the complete legal move history from the standard starting position. Each UCI move—including its promotion piece—is one token. A beginning-of-game token separates games. A 512-token context is a limit, not permission to silently forget older moves.

2. Training learns policy and outcome estimates

The transformer learns from both players' eligible moves. Teacher forcing supplies earlier real moves, never future outcomes. Packed games use separate causal attention blocks. A separate three-class normalization predicts White win/draw/loss at selected positions; those estimates are model predictions, not calibrated promises.

3. Rules turn predictions into a legal move

A chess rules library enumerates legal moves. The model ranks them. This keeps actual play legal even when its raw top prediction is illegal, so raw prediction legality and legal played moves must be reported separately.

4. The harness decides how to use the model

The online harness adds uncertainty-guided lookahead, persistent search and inference caches, bounded Stockfish assistance, and clock-aware execution. It checks history and legality before acting, then records the decision. Browser play keeps the simpler model-and-legal-filtering path. These are different agents around the same learned weights, so their results answer different questions.

5. Evaluation tests the model and the agent

Loss, raw legality, Sunfish results and tournament standings answer different questions. Keep opponent, opening set, helper, clocks and failure accounting fixed before attributing gains. A small score or one tournament is not a FIDE rating.

Exact current architecture · Experiment evidence · Run the recipe

Explore earlier ideas

The historical learning notebook preserves three-token and state-input explanations. Their token counts and training objectives describe those models, not CM-14.

Related research

A reading map, checked against primary sources on November 4, 2026. These papers ask different questions: human alignment, strength, planning and interpretability are not interchangeable. Citations do not validate LittlePly’s scores or imply wholesale implementation. “Possible future experiment” means unimplemented reading, not an announced run.

Learning from human games

Learning and planning

What a model represents and predicts

Use each paper’s own evaluation protocol. Human-move accuracy, puzzle scores, online ratings and our Sunfish development matches cannot be placed on one common strength scale.