Story
Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
1 report
1 website
1 discussion
Latest report
Overview
Run open models as fast as your hardware allows Magnitude is an open source inference engine for agents that optimizes itself for your exact hardware. It compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. One click connects the agent you already use (Pi, OpenCode, Hermes, Codex, and more). Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU. Dow...
Summary from github.com.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · github.com
Hacker News discussion ↗
Historical count: 15 · 15 saved in sample · Historical sample
Awaiting analysis