Story
Performance per dollar is getting faster and cheaper
1 report
1 website
1 discussion
Latest report
Overview
Performance per dollar for AI inference is improving, with GLM5.2 served on AMD MI355X achieving 2626 tokens per second per node and 213 tokens per second in a single stream at over 2x lower cost than Blackwell. Demand for inference is increasing rapidly, outpacing supply, as new frontier models are released frequently.
Summary from wafer.ai.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · wafer.ai
Hacker News discussion ↗
Historical count: 5 · 5 saved in sample · Historical sample
Analysis ready
Read this discussion’s reaction
Based on 5 sampled comments from this thread. Analyzed 2026-07-04.
- Praise: There's a growing interest in AMD's performance per watt, which could shake up the data center landscape, especially for companies outside the US where energy costs are a major factor.
- Praise: The mention of companies like Meta and OpenAI using AMD is a promising sign that they might finally be gaining traction against Nvidia's dominance.
- Concern: Quantization to FP4 is often a disaster for accuracy, with many models losing their edge and becoming 'lobotomized' — not what we need for frontier-level AI.
- Concern: Skepticism runs high about AMD's ability to compete; many users are tired of being disappointed and doubt they'll finally see viable competition against Nvidia.