Exécution de notre outil de synthèse sur un nouvel article
Vérifiez l’article ci-dessous, puis lancez sa synthèse.
Visuospatial Perspective Taking in Multimodal Language Models
Jonathan E. Prunty (University of Cambridge), Seraphina Zhang (University of Cambridge), Patrick Quinn (University of Cambridge), Jianxun Lian (Microsoft Research Asia (China)), Xing Xie (Microsoft Research Asia (China)), Lucy G. Cheke (University of Cambridge)
Résumé : As multimodal language models (MLMs) are increasingly used in social and collaborative settings, it is crucial to evaluate their perspective-taking abilities. Existing benchmarks largely rely on text-based vignettes or static scene understanding, leaving visuospatial perspective-taking (VPT) underexplored. We adapt two evaluation tasks from human studies: the Director Task, assessing VPT in a referential communication paradigm, and the Rotating Figure Task, probing perspective-taking across angular disparities. Across tasks, MLMs show pronounced deficits in Level 2 VPT, which requires inhibiting one's own perspective to adopt another's. These results expose critical limitations in current MLMs' ability to represent and reason about alternative perspectives, with implications for their use in collaborative contexts.