Story
Autoresearch on an old research idea
1 report
1 website
1 discussion
Latest report
Overview
Karpathy's Autoresearch utilizes a constrained optimization loop with a large language model (LLM) agent. The author applied Autoresearch to legacy code from eCLIP while managing household tasks.
Summary from ykumar.me.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · ykumar.me
Hacker News discussion ↗
Historical count: 5 · 5 saved in sample · Historical sample
Analysis ready
Read this discussion’s reaction
Based on 5 sampled comments from this thread. Analyzed 2026-03-24.
- Praise: Using LLMs to explore prior art can yield valuable insights, with even a small percentage of applicable knowledge being beneficial for learning and problem-solving.
- Praise: The structured trial and error approach of Autoresearch, despite its limitations, still provides a useful framework for optimizing research processes.
- Concern: The reliance on hyperparameter tuning in Autoresearch raises concerns about its overall value, suggesting that the costs may not justify the benefits.
- Concern: Many recommendations from LLMs are often irrelevant or poorly maintained, which can lead to wasted resources and inefficiencies in real-world applications.
- Concern: The effectiveness of Autoresearch is heavily dependent on the quality of the evaluation metrics used, which can undermine the optimization process if they are inadequate.