Can a fixed AI model become more capable without becoming larger?
Eight measured papers, one frozen model at a time. Every number on these slides is a measured result from the published papers; nothing is projected.
→ / ← or scroll · one slide per step of the argument
The risk. The head chooses among candidates the model itself proposed, so it can steer search away from a place where the vanilla model would have succeeded.
The measurement. Problem by problem, on the same problems: the base-only cell of a paired four-cell table (both solve · head only · base only · neither), published beside every headline, with both denominators.
Across the closed arms: 1.2% to 12.2% of the task set; 11.7% to 59.8% of the problems the vanilla model itself solved. The regression does not track the gain: the largest gains carry the smallest regressions. A head is applied only within the family it was fitted on; outside it the vanilla model runs unchanged.
git clone https://github.com/LouayAlsakka/efficient-thinking && cd efficient-thinking python experience/g13b_score.py --dir experience/results/viiic --plan viiic7 --out /tmp/viiic.json # our bytes, minutes bash experience/reproduce_8c.sh # your bytes, ~4.5 h bash experience/reproduce_matched_compute.sh # base at the head's compute vs the head
Site build after e567b61 · 2026-10-07 13:27Z