MakoBench: +NSFW Bench (suite 4.0)

39 ranked of 47 models on suite 4.0, board published November 2026. Click a column head to sort, the arrow beside a name for all of that model's details, and the i beside a head for what it means. Columns picks what shows; Export saves the table.

Separate test of adult fiction with adult characters only; not part of Total.

We test local models on one machine: two RTX 5090 and two RTX 3090 graphics cards, about 112 GB of video memory. The judge is Gemma 4 31B (Q8). Hosted models run through their own APIs. What the rig can test

• Total = Code + Chat. 10 each is a perfect run of the standard tests, so 20 is the nominal top; bonus packs add points on top, up to the suite's most possible (a row's bars run to it). NSFW score is a separate test (how far the model goes with adult content) and is not part of Total. Higher is not better or worse: pick what suits your use.
• Each score is nominally 10 on the standard tests. A part scored 90% or more unlocks a harder bonus set, worth 1 point, so Code, Chat and NSFW score can pass 10, up to 10 plus one point per pack in the suite.
• ± Total = half of the 90% interval of a bootstrap over the test cases; models closer together than that are statistically tied.
• Each model is run once, so ± covers which cases were drawn, not run-to-run noise, and it understates the real uncertainty. Rows for the same weights (quant or serving-tier twins) differ by up to 2.3 points here. Treat gaps of a point or two as ties.
• Class is a coarse band on Total: S ≥ 16, A ≥ 13, B ≥ 10, C ≥ 0.
• Lean = chat-leaning or code-leaning when the gap to the board median is 1.5 points or more, otherwise balanced.
• tok/s = median generation speed; only comparable between models run on the same host.
• Quant = the quantization we scored. Q8_0 is the standard for local models; any other quant is marked as a non-standard quant in the row details. API = a hosted model, served by its provider.
• Run cost = what one run of the Code and Chat tests cost at the provider's price, generation only. ~ = estimated from token counts at list price. * means some requests came back without usage data, so the figure may be low. — = run on our own hardware, so no bill.
• N blocked = the provider's content filter blocked N replies; each scores zero.
• One row per model: other quants and serving tiers of the same weights sit under the main row (open the arrow) and are not ranked.
• ⚠ Provisional = CrucibleForge's compatibility check failed for that model, so its score may mis-measure it. It is shown without a rank until it is re-run, except rows tested below Q5, which are not re-run.
• A dash in Total means that model has no complete Chat score yet, so it is not ranked.