# MakoBench Suite History: Earlier Versions

URL: https://www.laserlloyd.com/makobench/docs/suite-history/
Published: 2026-11-05
Description: Earlier MakoBench suite versions, kept exactly as they stood, and why a benchmark score only compares within the suite that produced it.
Reuse: free for personal use — full policy at https://www.laserlloyd.com/llms.txt

The tests behind MakoBench change from time to time. A score only means something against the suite that produced it, so we never compare numbers across suites and we never quietly rewrite an old board.

Why do suites change?

We drop tests that turn out to be slow or noisy, fix questions that were unfair, and add harder sets as models improve. When a change moves scores, every model is re-run on the new suite. The previous board is then kept exactly as it stood, with its own margins, its own scale and the date it was built.

Where are the earlier boards?

The Main Bench, +NSFW Bench and The tests pages each have a Suite version menu at the top. Pick an earlier version there and the page shows that suite as it stood.

Versions

Suite 4.0 (current). Total is Code plus Chat, 10 points each on the standard tests. See the Main Bench.
Suite 3.0. Scored out of 100 on the old tests, so do not set these numbers beside suite 4.0. The archived board has 32 models and was built from the board we archived on 2026-09-23. Pages: Main Bench, +NSFW Bench and The tests.

What changed between them?

The write-up for the current suite is Suite 4.0: what changed. For every release of the engine, including ones that did not touch the scores, read the CrucibleForge changelog on GitHub.

Related: How MakoBench works.