90% of US work happens on tasks AI benchmarks can't measure

A map of what AI can and cannot do

Mercor released a new research report called the Benchmark Map, which tracks how well existing AI benchmarks cover real American jobs. The findings are striking: about 90% of working hours in the United States are spent on tasks that standard AI benchmarks barely touch ¹.

To build the map, Mercor studied 923 occupations listed by the US Department of Labor's O*NET system, which describes all major types of work in the country. Across those jobs, O*NET lists 18,797 individual tasks — things like "draft legal contracts" or "advise clients on tax rules." Mercor then checked how many of those tasks appear in a curated list of 29 AI benchmarks known for quality and real-world relevance.

Only 208 of the 923 occupations had at least five benchmark prompts that could be linked to their tasks. Six out of 22 major job families had no occupations with that level of coverage at all.

The bias is obvious

The gaps are not random. The data show that AI benchmark makers tend to focus on large, high-paying industries first. Jobs in fields like software engineering and finance dominate popular benchmarks, while equally important middle-income roles get far less attention.

Take the legal field, for example. Benchmarks heavily cover tasks done by lawyers, but they barely test the work of legal secretaries or court clerks — even though those roles face similar levels of AI exposure ¹. The same pattern repeats across other sectors: the "long tail" of smaller and mid-size knowledge work jobs is largely invisible to AI evaluators.

Why this matters

The problem goes beyond missing data. If benchmarks don't cover what most Americans actually do at work, it becomes very difficult to know whether current AI models are truly ready for real-world use. An AI model might score well on coding challenges but struggle with the everyday tasks that make up the bulk of the economy.

Mercor said it plans to keep expanding its benchmark coverage so researchers can better understand where AI stands and where it falls short. For now, the Benchmark Map serves as a reminder that today's AI progress reports may not tell the full story about how well machines can handle the American workforce.

Key facts

• 90% of US working hours are spent on tasks with little or no benchmark coverage
• Only 208 of 923 US occupations have at least 5 benchmark prompts linked to their tasks
• Six of 22 major job families have no occupations with 5+ benchmark coverage
• Benchmarks overrepresent high-wage industries like software and finance
• Mercor published the Benchmark Map to track AI capability coverage across the economy

Sources

1. A benchmark map of the US economy | Mercor