From AGI to ASI
Authors: Tim Genewein, Matija Franklin, Alexander Lerchner, Laurent Orseau, Samuel Albanie, Adam Bales, Cole Wyeth, Stephanie Chan, Iason Gabriel, Joel Z. Leibo, Allan Dafoe, Marcus Hutter, Thore Graepel, Shane Legg
AI-generated Key Points
- Pursuit of human-level artificial general intelligence (AGI) has become a tangible target for major AI organizations
- Implications of achieving AGI prompt complex questions and considerations for society
- Evolution of AI beyond AGI towards artificial superintelligence (ASI) is explored in the report
- Four potential pathways to ASI: scaling AGI, paradigm shifts in AI development, recursive improvement processes, and emergence through large-scale multi-agent systems
- Possible obstacles and bottlenecks along pathways highlight the need to address key research questions
- Uncertainties around ASI progress suggest advancements in AI could accelerate in the future
- Transformative changes driven by breakthroughs across scientific and technological domains enabled by AI progress are expected instead of a singular transformative event triggered by human-level AGI introduction
- Collaborative interdisciplinary effort on a global scale is necessary to prepare for the evolving landscape shaped by advancing towards ASI
- Proactive engagement with emerging technologies is crucial to anticipate and navigate potential societal impacts positively
Abstract: Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations. Achieving this goal would have profound and far-reaching impacts on human society, which raises many complex questions for the decade ahead. This report investigates how AI itself might continue to develop in a post-AGI world along the continuum of machine intelligence. The endpoint of this continuum, Universal AI, is theoretically well understood, which provides some formal grounding for the main focus of this report: the transition from human-level AGI to artificial general superintelligence, which, intuitively, can be understood as a system that is more intelligent and cognitively capable than large organisations of humans. After characterizing ASI, the report discusses four potential pathways from AGI to ASI: scaling AGI, AI paradigm shifts, recursive improvement, and ASI emerging from large-scale multi-agent collectives. The report then discusses possible frictions and bottlenecks along these pathways. Determining whether the impact of these frictions will be negligible or substantial raises a number of concrete open research questions. Due to large uncertainties for predicting ASI progress, it cannot be ruled out that AI progress might continue to accelerate over the next years. This could imply that the image of a single transformative step change, caused by the introduction of human-level AGI into our society, could be inaccurate. More apt might be the prospect of a series of transformative societal changes caused by AI-enabled progress and breakthroughs across many areas of science and technology. Preparing for this prospect requires a massively interdisciplinary endeavour of global scope and interest.
Tools for this paper
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
We compare the title and abstract with papers indexed in our database. For arXiv papers, we search within the same category; for DOI and other sources, we search across sources and subjects. You can rerun the search as our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.