job-automation
Latest stories covering job-automation, with summaries and links to related coverage.
5 articles · page 1 of 1
Connected topics
90% of US working hours are spent on tasks not covered well by AI benchmarks
research
9 min read
Mercor has published a Benchmark Map that measures how well 29 selected AI benchmarks cover tasks across the US labor force. The map uses the Department of Labor’s O*NET taxonomy, which divides the workforce into 923 occupations, 22 job families, and 18,797 tasks. A task is counted as covered when an LLM judge maps at least five benchmark prompts to it; one prompt can map to multiple tasks. Only 208 of 923 occupations have at least one task meeting that threshold, while six of 22 job families have none. Mercor estimates that 90% of US working hours are spent on tasks with little or no coverage in its initial benchmark set, making economy-wide assessments of AI capability difficult. The organization says benchmark coverage disproportionately favors AI-exposed tasks, with O*NET tasks rated exposed to AI about six times more likely to appear than unexposed tasks. Tasks in occupations with larger wage bills and tasks rated most important are also overrepresented. Mercor found that reweighting APEX benchmark scores so each O*NET task counts equally changed model results little for investment banking, law, accounting, and software engineering. Less than one-third of relevant tasks in those four occupations had sufficient APEX coverage. Mercor characterizes its estimates as provisional because its benchmark list is incomplete, selection criteria involve judgment, and excluding saturated benchmarks can understate coverage.
Why AI hasn't replaced software engineers, and won't
opinion
21 min read
AI has not replaced software engineers due to the complexity and creativity required in software development that current AI technologies cannot replicate. Evidence indicates that AI serves as a tool to assist engineers rather than a replacement for their roles.
What's gonna happen to software engineers?
opinion
11 min read
The future of software developers is uncertain, with various speculations about potential job displacement and skill transferability. Concerns include the possibility of widespread unemployment in the software engineering field.
I was interviewed by an AI bot for a job
opinion
1 min read
AI avatars are increasingly being used to conduct job interviews through one-on-one video calls, posing questions and analyzing candidates' responses. Many job seekers find the experience unsettling due to the lifelike appearance of the AI avatars.
I don't know if my job will still exist in ten years
opinion
6 min read
The software engineering industry is facing uncertainty regarding its future viability over the next decade. Predictions indicate significant changes in the demand for software engineers and the nature of their work by 2026.