← All topics
inference
Latest stories covering inference, with summaries and links to related coverage.
1 stories · 1 reports · page 1 of 1
Connected topics
Performance per dollar is getting faster and cheaper
news
5 min read
Performance per dollar for AI inference is improving, with GLM5.2 served on AMD MI355X achieving 2626 tokens per second per node and 213 tokens per second in a single stream at over 2x lower cost than Blackwell. Demand for inference is increasing rapidly, outpacing supply, as new frontier models are released frequently.