AI systems
Source reports covering AI systems. Stories will appear when analysis and community reactions are ready.
5 reports · page 1 of 1
Connected topics are temporarily unavailable. You can still browse stories below.
Source reports
Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025)
tool
36 min read
vLLM is a high-throughput LLM inference system that utilizes components such as paged attention, continuous batching, prefix caching, and specdec. It supports multi-GPU and multi-node dynamic serving to enhance performance at scale.
I'm building a parallel internet, and it's called The Thinnernet
opinion
10 min read
The Thinnernet project aims to create a parallel internet by integrating knowledge bases with ticket management systems to enhance proof of work. The initiative began in 2020 and is influenced by a humorous alter-ego inspired by Steve Jobs.
Rethinking search as code generation
research
23 min read
Search is evolving from monolithic services to programmable primitives to enhance AI systems. As frontier models advance, they require access to fresh, accurate, and well-curated knowledge, making search a foundational component for drawing conclusions and performing actions in AI products.
Familiarity is the enemy: On why Enterprise systems have failed for 60 years
opinion
33 min read
Enterprise knowledge systems have struggled for sixty years due to issues related to familiarity. A senior executive at a global enterprise indicated that this familiarity was a key reason for not adopting a new AI product.
Pentagon to adopt Palantir AI as core US Military system
news
3 min read
Palantir's Maven artificial intelligence system will be adopted as an official program of record by the Pentagon, ensuring its long-term integration into U.S. military operations. The system aims to enhance weapons-targeting capabilities for warfighters.