Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control
AI-generated Key Points
- Large Language Models (LLMs) are part of a larger computational infrastructure that can be used for manipulation and control.
- LLMs can distort and standardize information environments, serving as mechanisms of control in various domains.
- Emerging research areas enhance the power of LLMs, including persuasion through real-time design in conversational interfaces, modeling human agents and populations, and combining them with reinforcement learning for strategic dialogue models.
- LLM-based systems can simulate and predict human behavior to exert significant influence over individuals, society, and politics.
- Controversial use of LLMs includes altering writing styles in contexts involving sustained human-machine interactions.
- The expanding scope of power wielded by powerful actors through LLMs is a concern, especially within a global context dominated by tech giants like Microsoft.
- Greater scrutiny and regulation surrounding the deployment of LLMs are needed to prevent their misuse for autonomous manipulation and control.
Authors: Yaqub Chaudhary, Jonnie Penn
Abstract: Large language models (LLMs) can reproduce a wide variety of rhetorical styles and generate text that expresses a broad spectrum of sentiments. This capacity, now available at low cost, makes them powerful tools for manipulation and control. In this paper, we consider a set of underestimated societal harms made possible by the rapid and largely unregulated adoption of LLMs. Rather than consider LLMs as isolated digital artefacts used to displace this or that area of work, we focus on the large-scale computational infrastructure upon which they are instrumentalised across domains. We begin with discussion on how LLMs may be used to both pollute and uniformize information environments and how these modalities may be leveraged as mechanisms of control. We then draw attention to several areas of emerging research, each of which compounds the capabilities of LLMs as instruments of power. These include (i) persuasion through the real-time design of choice architectures in conversational interfaces (e.g., via "AI personas"), (ii) the use of LLM-agents as computational models of human agents (e.g., "silicon subjects"), (iii) the use of LLM-agents as computational models of human agent populations (e.g., "silicon societies") and finally, (iv) the combination of LLMs with reinforcement learning to produce controllable and steerable strategic dialogue models. We draw these strands together to discuss how these areas may be combined to build LLM-based systems that serve as powerful instruments of individual, social and political control via the simulation and disingenuous "prediction" of human behaviour, intent, and action.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.