Story
GLM 5.2 beats Claude in our benchmarks
1 report
1 website
1 discussion
Latest report
Overview
GLM 5.2 from Zhipu AI achieved a 39% F1 score on the IDOR detection benchmark, outperforming Claude Code, which scored 32%. Both models were evaluated on the same dataset and prompt, with GLM 5.2 costing approximately $0.17 per vulnerability found.
Summary from semgrep.dev.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · semgrep.dev
Hacker News discussion ↗
Historical count: 5 · 5 saved in sample · Historical sample
Analysis ready
Read this discussion’s reaction
Based on 5 sampled comments from this thread. Analyzed 2026-06-29.
- Praise: GLM 5.2 is proving to be a reliable workhorse model for daily programming tasks, offering significant cost savings compared to other APIs.
- Praise: The model excels at finding and fixing vulnerabilities, demonstrating its strong performance in practical applications.
- Praise: With 753 billion parameters, GLM 5.2 showcases impressive capabilities that could rival larger models while remaining accessible.
- Concern: Concerns about potential export controls on open models could hinder access to powerful AI tools, impacting innovation and security.
- Concern: The comparison to Claude and other models raises questions about the practicality and cost-effectiveness of running such large models locally.
- Concern: Skepticism exists regarding the legal feasibility of imposing export restrictions on AI models, indicating a complex regulatory landscape.