Train Your Own LLM from Scratch
GitHub repository angelos-p/llm-from-scratch offers a hands-on workshop for building a GPT training pipeline from scratch. The workshop focuses on reproducing the GPT-2 model with 124 million parameters using PyTorch.
github.com
4 min
5/5/2026
"time to GPT-2", down to 2.91 hours
Enabled fp8 training for GPT-2 resulted in a 4.3% reduction in training time, bringing it down to 2.91 hours. Using 8XH100 spot instance prices, the cost to reproduce GPT-2 is approximately $20.
twitter.com
2 min
2/4/2026
Train Your Own LLM from Scratch
GitHub repository angelos-p/llm-from-scratch offers a hands-on workshop for building a GPT training pipeline from scratch. The workshop focuses on reproducing the GPT-2 model with 124 million parameters using PyTorch.
github.com
4 min
5/5/2026
"time to GPT-2", down to 2.91 hours
Enabled fp8 training for GPT-2 resulted in a 4.3% reduction in training time, bringing it down to 2.91 hours. Using 8XH100 spot instance prices, the cost to reproduce GPT-2 is approximately $20.
twitter.com
2 min
2/4/2026
Train Your Own LLM from Scratch
GitHub repository angelos-p/llm-from-scratch offers a hands-on workshop for building a GPT training pipeline from scratch. The workshop focuses on reproducing the GPT-2 model with 124 million parameters using PyTorch.
github.com
4 min
5/5/2026
"time to GPT-2", down to 2.91 hours
Enabled fp8 training for GPT-2 resulted in a 4.3% reduction in training time, bringing it down to 2.91 hours. Using 8XH100 spot instance prices, the cost to reproduce GPT-2 is approximately $20.
twitter.com
2 min
2/4/2026
No more articles to load