Gemma-4-26B-A4B with 39-69% less thinking at same accuracy
bottlecapai.com ·
Bottlecap AI released ThinkingCap-gemma-4-26B-A4B-it, a token-efficient version of Google’s Gemma-4-26B-A4B-it reasoning model. Gemma-4-26B-A4B is a sparse mixture-of-experts model with 26 billion parameters and about 4 billion active parameters per token. Bottlecap says its model uses 38.9% fewer thinking tokens on average across 12 benchmarks while accuracy declined by 0.15 percentage points, from 75.18% to 75.03%, under identical vLLM serving and sampling settings.
Thinking-token reductions ranged from 13.7% on IFBench to 69.1% on LongBench v2. The model used 54.4% fewer tokens across long-context and multimodal tasks, 44.4% fewer on knowledge and reasoning, 36.1% fewer on math, and 27.6% fewer on code. Accuracy increased on some tests, including IFBench and LongBench v2, but fell 4.00 percentage points on AA-LCR. Bottlecap measured looping in 0.76% of the optimized model’s responses, down from 3.64% for the base model.
Bottlecap evaluated both models with thinking enabled, temperature 1.0, top-p 0.95, top-k 64, and a 65,536-token generation cap. The open model and GGUF builds are available under the bottlecapai/ThinkingCap-gemma-4-26B-A4B-it repository. Bottlecap also offers a commercial PRO version, which it says cuts thinking tokens by up to 87.6% and 62% on average.
What people are saying
The thread treated the claimed reduction in reasoning tokens less as a Gemma-specific breakthrough than as another test of whether compressed chain-of-thought can survive contact with real workloads.
What readers liked
- Shorter reasoning at unchanged accuracy would cut PR-review inference bills where hidden deliberation, not the final response, consumes most of the…
- A quick 26B-class model can be a strong fit for general chat and commonplace coding, where agent-grade planning is unnecessary and responsiveness…
Concerns raised
- Hands-on users of comparable reduced-thinking models report noticeably weaker answers than the full reasoning versions, making benchmark-level…
- One reduced-reasoning approach repeatedly hallucinated task completion, a failure mode that makes token savings meaningless for work requiring…
Read full discussion analysis
Source: Hacker News · Based on 7 sampled comments · Analyzed
Discussion overview
The thread treated the claimed reduction in reasoning tokens less as a Gemma-specific breakthrough than as another test of whether compressed chain-of-thought can survive contact with real workloads. Several readers who used similar reduced-thinking variants of Qwen and Kimi found the trade-off visible: answers became less capable, models declared work complete without actually finishing it, and one lighter variant was abandoned almost immediately for being materially weaker. Benchmark parity therefore drew little automatic trust; commenters argued that private tasks expose failures an aggregate score can conceal.
Still, the economics have clear appeal. For PR review and other high-volume tasks, reasoning tokens dominate the bill, so preserving accuracy with shorter deliberation would be genuinely valuable. A fast, reasonably competent 26B model could also fit ordinary chat and routine coding questions even if it is not the right tool for autonomous coding agents or peak-quality work. Readers repeatedly stressed end-to-end time over flashy tokens-per-second figures: a model that thinks at length can lose to one that reaches a correct answer quickly, while faster inference engines may eliminate much of the reason to cut reasoning tokens locally. The practical consensus was conditional: test it on your own workload, because savings are attractive only if trust and task completion remain intact.
Points of disagreement
The central dispute is whether removing most thinking tokens preserves useful intelligence or merely hides a quality collapse behind favorable benchmarks. Supporters see lower reasoning spend as a major win when routine work keeps its accuracy; skeptics say their hands-on tests show weaker reasoning, hallucinated completion, and enough lost reliability to erase any token savings.
What readers liked
- Shorter reasoning at unchanged accuracy would cut PR-review inference bills where hidden deliberation, not the final response, consumes most of the budget.
- A quick 26B-class model can be a strong fit for general chat and commonplace coding, where agent-grade planning is unnecessary and responsiveness matters.
- Readers see genuinely impressive value in small models that deliver strong humanities output, suggesting efficient models are already punching beyond their parameter count.
- End-to-end latency can improve without sacrificing capability when a model reaches the answer directly instead of spending minutes visibly deliberating.
Concerns raised
- Hands-on users of comparable reduced-thinking models report noticeably weaker answers than the full reasoning versions, making benchmark-level parity hard to trust on bespoke tasks.
- One reduced-reasoning approach repeatedly hallucinated task completion, a failure mode that makes token savings meaningless for work requiring dependable execution.
- The most aggressively shortened variant was judged substantially dumber and was dropped quickly, suggesting the efficiency knob can cross a sharp quality cliff.
- Some compressed variants appear more restrictive than their base models, reducing usefulness for requests the original model would handle rather than simply improving efficiency.
Keep reading
Sources and details
bottlecapai.com · Published
Gemma-4-26B-A4B with 39-69% less thinking at same accuracy
Read report →
Community analysis available for 1 of 1 linked discussions.
Additional discussion searches are still incomplete.
Coverage details and dates
Latest available community analysis:
Summaries: 1 current · 0 awaiting update · 0 not verified
Latest summary update:
Hacker News · bottlecapai.com