Crashing Waves vs. Rising Tides: Preliminary Findings on AI Automation from Thousands of Worker Evaluations of Labor Market Tasks

AI-generated keywords: AI Automation Rising-Tide Automation Task Duration Success Rates Labor Markets

AI-generated Key Points

  • Rising tides are the primary form of AI automation
  • Steady improvement in AI performance across a wide range of tasks
  • Models successfully completing tasks that take humans approximately 3-4 hours with a 50% success rate in 2024-Q2
  • Projected success rate to increase to about 65% by 2025-Q3 and reach higher levels by 2029
  • Gradual improvement in AI capabilities referred to as rising-tide automation
  • Workers likely have more visibility into changes and time to adjust compared to crashing waves of automation
  • Contrast with METR's work showing a shallower relationship between task duration and AI success rates across most job domains
  • AI capabilities growing steadily over time, providing workers with a smoother transition into an increasingly automated workforce
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Matthias Mertens, Adam Kuzee, Brittany S. Harris, Harry Lyu, Wensu Li, Jonathan Rosenfeld, Meiri Anto, Martin Fleming, Neil Thompson

License: CC BY 4.0

Abstract: We propose that AI automation is a continuum between: (i) crashing waves where AI capabilities surge abruptly over small sets of tasks, and (ii) rising tides where the increase in AI capabilities is more continuous and broad-based. We test for these effects in preliminary evidence from an ongoing evaluation of AI capabilities across over 3,000 broad-based tasks derived from the U.S. Department of Labor O*NET categorization that are text-based and thus LLM-addressable. Based on more than 17,000 evaluations by workers from these jobs, we find little evidence of crashing waves (in contrast to recent work by METR), but substantial evidence that rising tides are the primary form of AI automation. AI performance is high and improving rapidly across a wide range of tasks. We estimate that, in 2024-Q2, AI models successfully complete tasks that take humans approximately 3-4 hours with about a 50% success rate, increasing to about 65% by 2025-Q3. If recent trends in AI capability growth persist, this pace of AI improvement implies that LLMs will be able to complete most text-related tasks with success rates of, on average, 80%-95% by 2029 at a minimally sufficient quality level. Achieving near-perfect success rates at this quality level or comparable success rates at superior quality would require several additional years. These AI capability improvements would impact the economy and labor market as organizations adopt AI, which could have a substantially longer timeline.

Submitted to arXiv on 01 Apr. 2026

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2604.01363v1

Our study on AI automation explores the continuum between crashing waves and rising tides in terms of AI capabilities across various tasks. By evaluating over 3,000 text-based tasks from the U.S. Department of Labor O*NET categorization, we have found evidence that rising tides are the primary form of AI automation. Our analysis shows a steady improvement in AI performance across a wide range of tasks, with models successfully completing tasks that take humans approximately 3-4 hours with a 50% success rate in 2024-Q2. This success rate is projected to increase to about 65% by 2025-Q3 and reach even higher levels by 2029. This gradual improvement in AI capabilities, referred to as rising-tide automation, suggests that workers will likely have more visibility into these changes and more time to adjust compared to a scenario characterized by crashing waves of automation. Our findings also contrast with recent work by METR which showed a shallower relationship between task duration and AI success rates across most job domains. This indicates that rather than sudden bursts, AI capabilities are growing steadily over time, providing workers with a smoother transition into an increasingly automated workforce. Overall, our study sheds light on the trajectory of AI capabilities and their implications for labor markets and the economy. It underscores the importance of understanding the gradual nature of AI automation and its potential impact on various industries as organizations adopt these technologies.
Created on 05 Apr. 2026

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.