ZAYA1-8B: An 8B Moe Model with 760M Active Params Matching DeepSeek-R1 on Math
ZAYA1-8B matches DeepSeek-R1 on math benchmarks and remains competitive with Claude Sonnet 4.5 on reasoning tasks. The model, trained entirely on AMD hardware, operates with less than 1 billion active parameters while closing in on Gemini 2.5 Pro in coding performance.
firethering.com
6 min
2d ago
ZAYA1-8B: An 8B Moe Model with 760M Active Params Matching DeepSeek-R1 on Math
ZAYA1-8B matches DeepSeek-R1 on math benchmarks and remains competitive with Claude Sonnet 4.5 on reasoning tasks. The model, trained entirely on AMD hardware, operates with less than 1 billion active parameters while closing in on Gemini 2.5 Pro in coding performance.
firethering.com
6 min
2d ago
ZAYA1-8B: An 8B Moe Model with 760M Active Params Matching DeepSeek-R1 on Math
ZAYA1-8B matches DeepSeek-R1 on math benchmarks and remains competitive with Claude Sonnet 4.5 on reasoning tasks. The model, trained entirely on AMD hardware, operates with less than 1 billion active parameters while closing in on Gemini 2.5 Pro in coding performance.
firethering.com
6 min
2d ago
No more articles to load