OpenAI Jalapeño: Better than Nvidia Blackwell

The thread treated the claimed custom OpenAI inference chip less as a settled victory over Nvidia than as a revealing sign of where AI infrastructure is headed. Several commenters were impressed by the prospect of purpose-built silicon driving token costs down, especially for stable, heavily used models where tailoring hardware to a known workload can save enormous amounts at hyperscale. They also saw a crowded field of inference ASICs as healthy pressure on Nvidia’s margins and a possible route to cheaper AI access. But the headline comparison drew substantial skepticism. Readers questioned whether the underlying analysis is independent enough to support grand claims, and whether token-per-joule comparisons against humans measure anything meaningful when a brain handles perception, movement, memory, and biological upkeep alongside speech. The deeper split concerned whether custom hardware creates a durable OpenAI moat. Optimists argue that even a less economical chip can pay off through workload-specific efficiency and supplier leverage. Skeptics counter that semiconductor lead times freeze design choices while model architectures move quickly, so an accelerator can arrive optimized for yesterday’s model. Some also reject the comforting idea that cheaper inference automatically democratizes AI: scale, energy, water, and memory supply could leave the lowest-cost frontier access concentrated in a few giant operators.