Story
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses
1 report
1 website
1 discussion
Latest report
Overview
How much GPU RAM do you actually need to run Qwen3.8 27B without sacrificing quality? The full BF16 model weighs 55 GB, putting it beyond most consumer hardware. Yet the 17 GB Q4_K_M matches the full model on a popular agentic coding benchmark, Terminal-Bench 2.1. It fits on a 24 GB card such as RTX 4090, still leaving room for about 64k tokens of context. Compression eventually hits a cliff. At 1...
Summary from quesma.com.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · quesma.com
Hacker News discussion ↗
Historical count: 14 · 14 saved in sample · Historical sample
Awaiting analysis