Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control

AI-generated keywords: Societal Harms Large Language Models Manipulation and Control Emerging Research Areas Autonomous Manipulation

AI-generated Key Points

  • Large Language Models (LLMs) are part of a larger computational infrastructure that can be used for manipulation and control.
  • LLMs can distort and standardize information environments, serving as mechanisms of control in various domains.
  • Emerging research areas enhance the power of LLMs, including persuasion through real-time design in conversational interfaces, modeling human agents and populations, and combining them with reinforcement learning for strategic dialogue models.
  • LLM-based systems can simulate and predict human behavior to exert significant influence over individuals, society, and politics.
  • Controversial use of LLMs includes altering writing styles in contexts involving sustained human-machine interactions.
  • The expanding scope of power wielded by powerful actors through LLMs is a concern, especially within a global context dominated by tech giants like Microsoft.
  • Greater scrutiny and regulation surrounding the deployment of LLMs are needed to prevent their misuse for autonomous manipulation and control.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Yaqub Chaudhary, Jonnie Penn

21 pages
License: CC BY 4.0

Abstract: Large language models (LLMs) can reproduce a wide variety of rhetorical styles and generate text that expresses a broad spectrum of sentiments. This capacity, now available at low cost, makes them powerful tools for manipulation and control. In this paper, we consider a set of underestimated societal harms made possible by the rapid and largely unregulated adoption of LLMs. Rather than consider LLMs as isolated digital artefacts used to displace this or that area of work, we focus on the large-scale computational infrastructure upon which they are instrumentalised across domains. We begin with discussion on how LLMs may be used to both pollute and uniformize information environments and how these modalities may be leveraged as mechanisms of control. We then draw attention to several areas of emerging research, each of which compounds the capabilities of LLMs as instruments of power. These include (i) persuasion through the real-time design of choice architectures in conversational interfaces (e.g., via "AI personas"), (ii) the use of LLM-agents as computational models of human agents (e.g., "silicon subjects"), (iii) the use of LLM-agents as computational models of human agent populations (e.g., "silicon societies") and finally, (iv) the combination of LLMs with reinforcement learning to produce controllable and steerable strategic dialogue models. We draw these strands together to discuss how these areas may be combined to build LLM-based systems that serve as powerful instruments of individual, social and political control via the simulation and disingenuous "prediction" of human behaviour, intent, and action.

Submitted to arXiv on 06 May. 2024

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2405.03813v1

In this paper, Chaudhary and Penn delve into the potential societal harms stemming from the widespread adoption of Large Language Models (LLMs). They argue that LLMs are not just isolated tools but are part of a larger computational infrastructure that can be used for manipulation and control. The authors highlight how LLMs can be utilized to distort and standardize information environments, serving as mechanisms of control in various domains. They explore emerging research areas that enhance the power of LLMs, such as using them for persuasion through real-time design in conversational interfaces, modeling human agents and populations, and combining them with reinforcement learning for strategic dialogue models. The authors emphasize how these capabilities can be combined to create LLM-based systems that exert significant influence over individuals, society, and politics by simulating and predicting human behavior. They also discuss the controversial use of LLMs in altering writing styles, particularly in contexts involving sustained human-machine interactions. The paper warns about the expanding scope of power wielded by powerful actors through LLMs, especially within a global context dominated by tech giants like Microsoft. Overall, Chaudhary and Penn shed light on the potential dangers posed by unchecked use of LLMs in shaping narratives, influencing decision-making processes, and controlling social dynamics. Their analysis underscores the need for greater scrutiny and regulation surrounding the deployment of LLMs to prevent their misuse for autonomous manipulation and control.
Created on 30 May. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.