Hetzner is working on LLM Inference

Flash-MoE: Running a 397B Parameter Model on a Laptop

How Taalas “prints” LLM onto a chip?

Nano-vLLM: How a vLLM-style inference engine works

David Patterson: Challenges and Research Directions for LLM Inference Hardware