Explorative modeling: Train on the best of K guesses
Explorative Modeling introduces a third pretraining axis for generative models, enhancing end-to-end generation capabilities. Increased exploration leads to improved performance across images, video, and language, with benefits scaling alongside model size.
alexiglad.github.io
17 min
12h ago
Explorative modeling: Train on the best of K guesses
Explorative Modeling introduces a third pretraining axis for generative models, enhancing end-to-end generation capabilities. Increased exploration leads to improved performance across images, video, and language, with benefits scaling alongside model size.
alexiglad.github.io
17 min
12h ago
Explorative modeling: Train on the best of K guesses
Explorative Modeling introduces a third pretraining axis for generative models, enhancing end-to-end generation capabilities. Increased exploration leads to improved performance across images, video, and language, with benefits scaling alongside model size.
alexiglad.github.io
17 min
12h ago
No more articles to load