
github.com
September 11, 2026
4 min read
49/100
Summary
litellm's routing + translation in ~2,900 lines and 2 dependencies (openai , httpx ). litellm routes LLM calls across providers and translates between message formats. That core is buried under 100k+ LOC of proxy servers, caching layers, cost tracking, and dozens of features most users never touch. litelm extracts just the call path — model routing, message translation, streaming, tool use, embedd...