Model evaluation
Latest stories covering Model evaluation, with summaries and links to related coverage.
1 stories · 1 reports · page 1 of 1
0 stories · 0 reports in the last 7 days
Latest report · Counts as of (UTC)
Models in this coverage
Up to six tracked models linked to this topic’s reports in the last 30 days. Counts measure coverage on Themata, not usage.
- DeepSeek V4.1 Flash
DeepSeek
· Open weights
An open-weight mixture-of-experts model that reads text and images. Its architecture focuses on efficient long-context and agent workloads, with support for up to one million tokens.
1 story · 1 report on this topic
No established topics share multiple stories with this topic yet.
Latest stories
DeepSeek V4.1 Flash 1017 (Max)
research
5 min read
DeepSeek released the reasoning model DeepSeek V4.1 Flash 1017 (Max) on October 17, 2026. The open-weights model accepts text and image inputs, produces text, and supports a 1 million-token context window. It is a mixture-of-experts model with 552 billion total parameters and 16 billion active parameters during inference. Its weights are available on Hugging Face under the MIT license, which permits commercial use, and it is available through five API providers. Artificial Analysis gave the model a score of 45 on its Intelligence Index, compared with a median score of 19 among open-weight models of a similar size. The composite index evaluates reasoning, knowledge, mathematics and coding. The evaluation generated 210 million output tokens, above the comparable-model median of 140 million, indicating relatively high verbosity. DeepSeek’s API pricing is $0.30 per million input tokens and $1.20 per million output tokens, below respective comparison medians of $0.43 and $1.68. Artificial Analysis estimates an average Intelligence Index evaluation cost of $0.26 per task. Output speed measured 230.4 tokens per second, compared with a 77.9-token-per-second median, while time to first token was 1.08 seconds versus a 1.69-second median.