AI summary · arXiv: 2303.10130v4 · econ.GN

GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models

Tyna Eloundou, Sam Manning, Pamela Mishkin, Daniel Rock
Original paper Submitted to arXiv on 17 Mar. 2023 License: CC BY-SA 4.0

How to read this summary? Illustrated guide

The essentials

  • The paper investigates the potential implications of large language models (LLMs), specifically Generative Pre-trained Transformers (GPTs), on the US labor market.
  • Around 80% of the US workforce could have at least 10% of their work tasks affected by the introduction of LLMs, while approximately 19% of workers may see at least 50% of their tasks impacted.
  • Higher-income jobs may face greater exposure to LLM capabilities and LLM-powered software.
  • With access to an LLM, about 15% of all worker tasks in the US could be completed significantly faster at the same level of quality. When incorporating software and tooling built on top of LLMs, this share increases to between 47 and 56% of all tasks.
  • General-purpose technologies like GPTs exhibit considerable economic, social, and policy implications as they can create new types of work.
  • It is essential to view LLMs as versatile building blocks for creating additional tools rather than modular specialists performing specific tasks.
  • The study acknowledges some limitations such as its focus solely on the United States which restricts generalizability to other nations where adoption and impact may differ due to various factors such as industrial organization, technological infrastructure, regulatory frameworks, linguistic diversity, and cultural contexts.
  • Education programs for workers training them in skills related to automation technology; reforms to safety net programs; and other measures are needed in order to shape a future economy with increasingly widespread adoption of large language models (LLMs).

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: LLMs GPTs Automation US Labor Market Implications

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
This working paper investigates the potential implications of large language models (LLMs), specifically Generative Pre-trained Transformers (GPTs), on the US labor market. The study focuses on the increased capabilities arising from LLM-powered software compared to LLMs on their own, and assesses occupations based on their alignment with LLM capabilities using a new rubric that integrates both human expertise and GPT-4 classifications. The findings reveal that around 80% of the US workforce could have at least 10% of their work tasks affected by the introduction of LLMs, while approximately 19% of workers may see at least 50% of their tasks impacted. These impacts are not restricted to industries with higher recent productivity growth, and higher-income jobs may face greater exposure to LLM capabilities and LLM-powered software. The analysis suggests that with access to an LLM, about 15% of all worker tasks in the US could be completed significantly faster at the same level of quality. When incorporating software and tooling built on top of LLMs, this share increases to between 47 and 56% of all tasks. This finding implies that LLM-powered software will have a substantial effect on scaling the economic impacts of the underlying models. The paper also discusses how general-purpose technologies like GPTs exhibit considerable economic, social, and policy implications as they can create new types of work. However, it is essential to view LLMs as versatile building blocks for creating additional tools rather than modular specialists performing specific tasks. The study acknowledges some limitations such as its focus solely on the United States which restricts generalizability to other nations where adoption and impact may differ due to various factors such as industrial organization, technological infrastructure, regulatory frameworks, linguistic diversity, and cultural contexts. Overall, this research provides insights into how LLM adoption may affect different occupations in terms of task automation potential in various industries across the US labor market. The study highlights the need for policy-related directions such as education programs for workers training them in skills related to automation technology; reforms to safety net programs; and other measures in order to shape a future economy with increasingly widespread adoption of large language models (LLMs).

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 1 free rewrite left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Continue with Google Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero Zotero guide
Citation alerts Citation alerts guide

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Very close Builds on this paper Cites this paper
    GPTs or Grim Position Threats? The Potential Impacts of Large Language Models on Non-Managerial Jobs and Certifications in Cybersecurity
    Raza Nowrozy · 2024 · Informatics · cited 9 times · Not summarized yet

    The cybersecurity study applies LLM job-impact analysis to non-managerial cybersecurity roles and certification exams, citing this paper.

    Abstract

    ChatGPT, a Large Language Model (LLM) utilizing Natural Language Processing (NLP), has caused concerns about its impact on job sectors, including cybersecurity. This study assesses ChatGPT’s impacts in non-managerial cybersecurity roles using the NICE Framework and Technological Displacement theory. It also explores its potential to pass top cybersecurity certification exams. Findings reveal ChatGPT’s promise to streamline some jobs, especially those requiring memorization. Moreover, this paper highlights ChatGPT’s challenges and limitations, such as ethical implications, LLM limitations, and Artificial Intelligence (AI) security. The study suggests that LLMs like ChatGPT could transform the…

  2. Very close Broader context
    On Large Language Models in National Security Applications
    William N. Caballero, Phillip R. Jenkins · 2024 · Cryptography and Security · cited 37 times · Not summarized yet

    The article examines LLM benefits and risks in national security, rather than estimating their exposure across the labor market.

    Abstract

    The overwhelming success of GPT-4 in early 2023 highlighted the transformative potential of large language models (LLMs) across various sectors, including national security. This article explores the implications of LLM integration within national security contexts, analyzing their potential to revolutionize information processing, decision-making, and operational efficiency. Whereas LLMs offer substantial benefits, such as automating tasks and enhancing data analysis, they also pose significant risks, including hallucinations, data privacy concerns, and vulnerability to adversarial attacks. Through their coupling with decision-theoretic principles and Bayesian reasoning, LLMs can significan…

  3. Very close Same question
    The Impact of Large Language Multi-Modal Models on the Future of Job Market
    Tarry Singh · 2023 · Computers and Society · preprint, not peer reviewed · cited 7 times · Not summarized yet

    The position paper considers how multimodal language models may affect jobs and human workers, focusing on displacement and coexistence.

    Abstract

    The rapid advancements in artificial intelligence, particularly in large language multi-modal models like GPT-4, have raised concerns about the potential displacement of human workers in various industries. This position paper aims to analyze the current state of job replacement by AI models and explores potential implications and strategies for a balanced coexistence between AI and human workers.

  4. Very close Same question
    “Generate” the Future of Work through AI: Empirical Evidence from Online Labor Markets
    Jin Liu, Xing-Chen Xu, Xiao-Si Nan et al. · 2026 · Information systems research · Not summarized yet

    The study measures generative AI’s labor-market effects in online platform submarkets, finding contraction where skills align with LLM capabilities.

    Abstract

    Large Language Model (LLM)-based generative AI systems are general-purpose tools capable of augmenting or even automating a wide range of job functions, positioning them to reshape labor market dynamics. However, predicting their precise impact a priori is challenging, given AI’s simultaneous effects on both demand and supply, as well as the strategic responses of market participants. Leveraging an extensive dataset from a leading online labor platform, we document a pronounced displacement effect and an overall contraction in submarkets where required skills closely align with core LLM functionalities. Although demand and supply both decline, the reduction in supply is comparatively smaller…

  5. Very close Same method, another problem
    Financial Statement Analysis with Large Language Models
    Alex Kim, Maximilian Muhn, Valeri Nikolaev · 2024 · Statistical Finance · preprint, not peer reviewed · cited 92 times · AI summary available

    The study tests GPT-4’s analytical capability on financial statements, rather than assessing occupational exposure to LLMs.

    Abstract

    We investigate whether large language models (LLMs) can successfully perform financial statement analysis in a way similar to a professional human analyst. We provide standardized and anonymous financial statements to GPT4 and instruct the model to analyze them to determine the direction of firms' future earnings. Even without narrative or industry-specific information, the LLM outperforms financial analysts in its ability to predict earnings changes directionally. The LLM exhibits a relative advantage over human analysts in situations when the analysts tend to struggle. Furthermore, we find that the prediction accuracy of the LLM is on par with a narrowly trained state-of-the-art ML model. …

  6. Close Review
    Summary of ChatGPT/GPT-4 Research and Perspective Towards the Future of Large Language Models
    Yiheng Liu, Tianle Han, Siyuan Ma et al. · 2023 · Computation and Language · cited 789 times · AI summary available

    The survey analyzes ChatGPT and GPT-4 research across application domains, drawing on 194 arXiv papers.

    Abstract

    This paper presents a comprehensive survey of ChatGPT and GPT-4, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations such as large-scale pre-training that captures knowledge across the entire world wide web, instruction fine-tuning and Reinforcement Learning from Human Feedback (RLHF) have played significant roles in enhancing LLMs' adaptability and performance. We performed an in-depth analysis of 194 relevant papers on arXiv, encompassing trend analysis, word cloud representation, and distribution analysis across various application domains. The findings reveal a significant and increasing inte…

  7. Close Same method, another problem
    Better Call GPT, Comparing Large Language Models Against Lawyers
    Lauren Martin, Nick Whitehouse, Stephanie Yiu et al. · 2024 · Computers and Society · preprint, not peer reviewed · cited 57 times · AI summary available

    The study empirically compares LLMs with human legal reviewers on contract-review accuracy, speed, and cost.

    Abstract

    This paper presents a groundbreaking comparison between Large Language Models and traditional legal contract reviewers, Junior Lawyers and Legal Process Outsourcers. We dissect whether LLMs can outperform humans in accuracy, speed, and cost efficiency during contract review. Our empirical analysis benchmarks LLMs against a ground truth set by Senior Lawyers, uncovering that advanced models match or exceed human accuracy in determining legal issues. In speed, LLMs complete reviews in mere seconds, eclipsing the hours required by their human counterparts. Cost wise, LLMs operate at a fraction of the price, offering a staggering 99.97 percent reduction in cost over traditional methods. These re…

  8. Close Review
    Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond
    Jingfeng Yang, Hongye Jin, Ruixiang Tang et al. · 2023 · Computation and Language · cited 1,163 times · AI summary available

    The survey guides practitioners on LLM models, data, and downstream NLP tasks rather than estimating labor-market impacts.

    Abstract

    This paper presents a comprehensive and practical guide for practitioners and end-users working with Large Language Models (LLMs) in their downstream natural language processing (NLP) tasks. We provide discussions and insights into the usage of LLMs from the perspectives of models, data, and downstream tasks. Firstly, we offer an introduction and brief summary of current GPT- and BERT-style LLMs. Then, we discuss the influence of pre-training data, training data, and test data. Most importantly, we provide a detailed discussion about the use and non-use cases of large language models for various natural language processing tasks, such as knowledge-intensive tasks, traditional natural languag…

Prior work it builds on

  1. Close Groundwork for this paper Used in depth by this paper A method it uses
    How will Language Modelers like ChatGPT Affect Occupations and Industries?
    E. Felten, Manav Raj, Robert C. Seamans · 2023 · Social Science Research Network · cited 223 times · Not summarized yet

    The study develops a method for assessing occupational exposure to language-model advances, which this paper cites.

    Abstract

    Recent dramatic increases in AI language modeling capabilities has led to many questions about the effect of these technologies on the economy. In this paper we present a methodology to systematically assess the extent to which occupations, industries and geographies are exposed to advances in AI language modeling capabilities. We find that the top occupations exposed to language modeling include telemarketers and a variety of post-secondary teachers such as English language and literature, foreign language and literature, and history teachers. We find the top industries exposed to advances in language modeling are legal services and securities, commodities, and investments. We also find a p…

  2. Close Groundwork for this paper Used in depth by this paper A method it uses
    GPT-4 Technical Report
    OpenAI · 2023 · Computation and Language · cited 28,314 times · AI summary available

    The technical report describes GPT-4’s model, training, and benchmark performance, and this paper cites it.

    Abstract

    We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably ac…

  3. Related Groundwork for this paper Used in depth by this paper A method it uses
    What Can Machines Learn, and What Does It Mean for Occupations and the Economy?
    Erik Brynjolfsson, Tom Michael Mitchell, Daniel Rock · 2018 · cited 634 times · Not summarized yet

    The study scores O*NET tasks for machine-learning suitability using a rubric that this paper cites as prior work.

    Abstract

    Advances in machine learning (ML) are poised to transform numerous occupations and industries. This raises the question of which tasks will be most affected by ML. We apply the rubric evaluating task potential for ML in Brynjolfsson and Mitchell (2017) to build measures of "Suitability for Machine Learning" (SML) and apply it to 18,156 tasks in O*NET. We find that (i) ML affects different occupations than earlier automation waves; (ii) most occupations include at least some SML tasks; (iii) few occupations are fully automatable using ML; and (iv) realizing the potential of ML usually requires redesign of job task content.

  4. Close Groundwork for this paper
    Language Models are Few-Shot Learners
    Tom B. Brown, Benjamin Mann, Nick Ryder et al. · 2020 · Computation and Language · cited 66,211 times · AI summary available

    The paper shows that scaling language models improves few-shot performance, and this labor-impact study cites it.

    Abstract

    Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires task-specific fine-tuning datasets of thousands or tens of thousands of examples. By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do. Here we show that scaling up language models greatly improves task-agnostic, few-shot performance, sometimes even reaching competitiveness with prior state-of-the-art fine-tuning approaches. Spec…

  5. Related Groundwork for this paper Used in depth by this paper A method it uses
    The Impact of Artificial Intelligence on the Labor Market
    Michael Webb · 2019 · Social Science Research Network · cited 528 times · Not summarized yet

    The study estimates occupational automation exposure from job descriptions and patents, an earlier approach cited by this paper.

    Abstract

    I develop a new method to predict the impacts of a technology on occupations. I use the overlap between the text of job task descriptions and the text of patents to construct a measure of the exposure of tasks to automation. I first apply the method to historical cases such as software and industrial robots. I establish that occupations I measure as highly exposed to previous automation technologies saw declines in employment and wages over the relevant periods. I use the fitted parameters from the case studies to predict the impacts of artificial intelligence. I find that, in contrast to software and robots, AI is directed at high-skilled tasks. Under the assumption that the historical patt…

Papers that cite it

  1. Close Broader context
    GPT (Generative Pre-Trained Transformer)— A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions
    Gokul Yenduri, M. Ramalingam, G. Chemmalar Selvi et al. · 2024 · IEEE Access · cited 759 times · Not summarized yet

    The review surveys GPT technologies, applications, challenges, and future directions, and cites this paper.

    Abstract

    The Generative Pre-trained Transformer (GPT) represents a notable breakthrough in the domain of natural language processing, which is propelling us toward the development of machines that can understand and communicate using language in a manner that closely resembles that of humans. GPT is based on the transformer architecture, a deep neural network designed for natural language processing tasks. Due to their impressive performance on natural language processing tasks and ability to effectively converse, GPT have gained significant popularity among researchers and industrial communities, making them one of the most widely used and effective models in natural language processing and related …

  2. Close Broader context
    Generative AI for Economic Research: Use Cases and Implications for Economists
    Anton Korinek · 2023 · Journal of Economic Literature · cited 310 times · Not summarized yet

    The paper describes LLM use cases for economists and potential productivity gains from automating research tasks, citing this study.

    Abstract

    Generative artificial intelligence (AI) has the potential to revolutionize research. I analyze how large language models (LLMs) such as ChatGPT can assist economists by describing dozens of use cases in six areas: ideation and feedback, writing, background research, data analysis, coding, and mathematical derivations. I provide general instructions and demonstrate specific examples of how to take advantage of each of these, classifying the LLM capabilities from experimental to highly useful. I argue that economists can reap significant productivity gains by taking advantage of generative AI to automate micro-tasks. Moreover, these gains will grow as the performance of AI systems continues to…

  3. Close Builds on this paper
    The Short-Term Effects of Generative Artificial Intelligence on Employment: Evidence from an Online Labor Market
    Xiang Hui, O. Reshef, Luofeng Zhou · 2024 · Social Science Research Network · cited 230 times · Not summarized yet

    The study tests generative AI’s short-term employment and earnings effects among freelancers in occupations affected by AI, citing this paper.

    Abstract

    Generative artificial intelligence (AI) holds the potential to either complement workers by enhancing their productivity or substitute them. We examine the short-term effects of the recently released generative AI models (ChatGPT, DALL-E 2, and Midjourney) on the employment outcomes of freelancers on a large online platform. We find that freelancers in highly affected occupations suffer from the introduction of generative AI, experiencing reductions in both employment and earnings. We find similar effects studying the release of other image-based generative AI models. Exploring the heterogeneity by freelancers’ employment history, we do not find evidence that high-quality service, measured b…

  4. Close Broader context
    Assessing the risk of takeover catastrophe from large language models
    Seth D. Baum · 2024 · Risk Analysis · cited 8 times · Not summarized yet

    The article analyzes catastrophic takeover risks from LLMs, a concern distinct from this paper’s labor-market exposure estimates.

    Abstract

    This article presents a risk analysis of large language models (LLMs), a type of “generative” artificial intelligence (AI) system that produces text, commonly in response to textual inputs from human users. The article is specifically focused on the risk of LLMs causing an extreme catastrophe in which they do something akin to taking over the world and killing everyone. The possibility of LLM takeover catastrophe has been a major point of public discussion since the recent release of remarkably capable LLMs such as ChatGPT and GPT‐4. This arguably marks the first time when actual AI systems (and not hypothetical future systems) have sparked concern about takeover catastrophe. The article's a…

  5. Close Builds on this paper Uses this paper in depth
    Artificial Intelligence and Jobs: Has the Inflection Point Arrived? Evidence from an Online Labor Platform
    Dandan Qiao, Hua-Xia Rui, Qian Xiong · 2026 · Journal of Management Information Systems · cited 3 times · Not summarized yet

    The study estimates ChatGPT’s contrasting displacement and productivity effects across online labor markets, citing this paper.

    Abstract

    ABSTRACT This study investigates how artificial intelligence (AI) influences various online labor markets (OLMs) over time. Employing the Difference-in-Differences method, we discovered two distinct scenarios following ChatGPT’s launch: displacement effects featuring reduced work volume and earnings, exemplified by translation & localization OLM; productivity effects featuring increased work volume and earnings, exemplified by web development OLM. To understand these opposite effects in a unified framework, we developed a Cournot competition model to identify an inflection point for each market. Before this point, human workers benefit from AI enhancements; beyond this point, human workers w…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

Updated on 6 November 2026.

The illustrated guide to the papers around a paper

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.