
quesma.com
September 8, 2026
6 min read
50/100
Summary
How much GPU RAM do you actually need to run Qwen3.8 27B without sacrificing quality? The full BF16 model weighs 55 GB, putting it beyond most consumer hardware. Yet the 17 GB Q4_K_M matches the full model on a popular agentic coding benchmark, Terminal-Bench 2.1. It fits on a 24 GB card such as RTX 4090, still leaving room for about 64k tokens of context. Compression eventually hits a cliff. At 1...