mixture-of-experts
Latest stories covering mixture-of-experts, with summaries and links to related coverage.
2 articles · page 1 of 1
Connected topics
Inkling: Our Open-Weights Model
tool
20 min read
Inkling is a Mixture-of-Experts transformer model with 975 billion total parameters and 41 billion active parameters. The model is released with full weights available for customization, supporting interactive collaboration and user-defined modifications.
DeepSeek V4–almost on the frontier, a fraction of the price
tool
3 min read
DeepSeek has released two preview models in its V4 series: DeepSeek-V4-Pro and DeepSeek-V4-Flash. The Pro model features 1.6 trillion total parameters with 49 billion active, while the Flash model has 284 billion total parameters and 13 billion active, both utilizing a 1 million token context Mixture of Experts architecture under the MIT license.