Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses

quesma.com
September 8, 2026
6 min read
61/100
Summary
How much GPU RAM do you actually need to run Qwen3.8 27B without sacrificing quality? The full BF16 model weighs 55 GB, putting it beyond most consumer hardware. Yet the 17 GB Q4_K_M matches the full model on a popular agentic coding benchmark, Terminal-Bench 2.1. It fits on a 24 GB card such as RTX 4090, still leaving room for about 64k tokens of context. Compression eventually hits a cliff. At 1...
Coverage & discussions
Hacker News · quesma.com
Community discussions
Historical count: 14 · 14 saved in sample · Historical sample
Awaiting analysis