Exécution de notre outil de synthèse sur un nouvel article

Vérifiez l’article ci-dessous, puis lancez sa synthèse.


Simulating Human Opinions with Large Language Models: Opportunities and Challenges for Personalized Survey Data Modeling

Carolin Kaiser (Nürnberg Institut für Marktentscheidungen e.V.), Jakob Kaiser (Nürnberg Institut für Marktentscheidungen e.V.), Vladimir Manewitsch (Nürnberg Institut für Marktentscheidungen e.V.), Lea Rau (Ludwig-Maximilians-Universität München), René Schallner (Nürnberg Institut für Marktentscheidungen e.V.)

ACM Conference on User Modeling, Adaptation and Personalization (UMAP)
DOI: 10.1145/3708319.3733685 (Social Sciences)
Licence : non indiquée (tous droits réservés)

Résumé : Public and private organizations rely on opinion surveys to inform business and policy decisions. Yet, empirical surveys are costly and time-consuming. Recent advances in large language models (LLMs) have sparked interest in generating synthetic survey data, i.e., simulated answers based on target demographics, as an alternative to real human data. But how well can LLMs replicate human opinions? In this ongoing project, we develop and critically evaluate methods for synthetic survey sampling. As an empirical benchmark, we collected responses from a representative U.S. sample (n = 461) on preferences for a common consumer good (soft drinks). Then, we developed ASPIRE (Automated Synthetic Persona Interview and Response Engine), a tool that pairs each human participant with a “digital twin” based on their demographic profile and generates synthetic responses via LLM technology. Synthetic data achieved better-than-chance accuracy in matching human responses and approximated aggregate subjective rankings for both binary and Likert-scale items. However, LLM-simulated data overestimated humans’ tendencies to provide positive ratings and exhibited substantially reduced variance compared to real data. The match of synthetic and real data was not systematically related to participants’ age, gender, or ethnicity, indicating no demographic bias. Overall, while synthetic sampling shows promise for modeling aggregate opinion trends, it currently falls short in replicating the variability and complexity of real human opinions. We discuss insights of our ongoing project for accurate and responsible user opinion modeling via LLMs.

Publié le 12 Jui. 2025