Story
Training a 3.8B LLM to 0.384 CORE for $998
1 report
1 website
1 discussion
Latest report
Overview
Training a 3.8B LLM to 0.384 CORE for $998 Somewhere between “nanoGPT toy” and “you need a research lab” there’s a large, under-described region where one person with a few thousand dollars can train a meaningful model. I wanted to see language and understanding emerge from random weights for myself, and to learn the parts you can only learn by starting from scratch. This project was written in th...
Summary from hugovergnes.github.io.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
hugovergnes.github.io
Training a 3.8B LLM to 0.384 CORE for $998
Read report →
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · hugovergnes.github.io
Historical count: 5 · 5 saved in sample · Historical sample
Awaiting analysis