fp8-training
Latest stories covering fp8-training, with summaries and links to related coverage.
1 articles · page 1 of 1
Connected topics
"time to GPT-2", down to 2.91 hours
2 min read
Enabled fp8 training for GPT-2 resulted in a 4.3% reduction in training time, bringing it down to 2.91 hours. Using 8XH100 spot instance prices, the cost to reproduce GPT-2 is approximately $20.