Story
I benchmarked Claude Code's caveman plugin against "be brief."
1 report
1 website
1 discussion
Latest report
Overview
Caveman is a Claude Code compression plugin that delivers ultra-compressed responses with approximately 75% fewer tokens while maintaining technical accuracy. Benchmarking against the prompt "be brief" showed that Caveman matched it in both token count and response quality across 24 prompts in six categories.
Summary from maxtaylor.me.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · maxtaylor.me
Hacker News discussion ↗
Historical count: 5 · 5 saved in sample · Historical sample
Analysis ready
Read this discussion’s reaction
Based on 5 sampled comments from this thread. Analyzed 2026-04-30.
- Praise: The benchmark results indicate that Caveman performs comparably to the simple 'be brief.' prompt, suggesting that advanced plugins can achieve similar efficiency.
- Praise: The structured approach of plugins like Caveman can provide real value in organizing responses, which is essential for clarity in coding tasks.
- Praise: Benchmarking plugins like Caveman contributes to a better understanding of their actual performance, helping users make informed decisions about their use.
- Concern: The reliance on a single run per prompt raises concerns about the reliability of the benchmark results, as variability could skew the findings.
- Concern: Critics argue that the actual token savings from using Caveman are negligible in practical coding scenarios, questioning its overall utility.
- Concern: There is a sentiment that many plugins, including Caveman, are overhyped and that users may be falling for 'snake oil' solutions without empirical support.