A CPU that runs entirely on GPU

github.com
March 4, 2026
8 min read
61/100
Summary
nCPU is a CPU architecture that operates entirely on GPU, utilizing tensors for registers, memory, flags, and the program counter. All arithmetic operations, including addition, multiplication, bitwise operations, and shifts, are performed through trained neural networks, with specific methods like Kogge-Stone carry-lookahead for addition and learned byte-pair lookup tables for multiplication.
Key Takeaways
- The nCPU operates entirely on GPU, utilizing tensors for registers, memory, flags, and the program counter, with all arithmetic performed through trained neural networks.
- The nCPU achieves 100% accuracy on integer arithmetic, verified by 347 automated tests, and includes 23 models totaling approximately 135 MB.
- Multiplication in the nCPU is 12 times faster than addition, contrasting with conventional CPUs where multiplication is typically slower than addition.
- The nCPU benchmarks show execution times ranging from 136 to 262 microseconds per cycle, depending on the instruction mix, with models loading in 60 milliseconds.
Coverage & discussions
Hacker News · github.com
Community discussions
Historical count: 5 · 5 saved in sample · Historical sample
Analysis ready
Community Sentiment
Positives
- The exploration of running a CPU entirely on a GPU opens up intriguing possibilities for future computing architectures, potentially revolutionizing how we approach processing tasks.
Concerns
- The skepticism about completely replacing CPUs with GPUs highlights fundamental differences in how each handles latency and processing, suggesting that a full transition may not be feasible.
Related Articles
Flash-MoE: Running a 397B Parameter Model on a Laptop
Mar 22, 2026

Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't
Jul 10, 2026

Parakeet.cpp – Parakeet ASR inference in pure C++ with Metal GPU acceleration
Feb 27, 2026
BarraCUDA Open-source CUDA compiler targeting AMD GPUs
Feb 17, 2026

We got 207 tok/s with Qwen3.5-27B on an RTX 3090
Apr 20, 2026