# What Do I Hear? Generating Sounds for Visuals with ChatGPT

**Authors:** David Chuan-En Lin, Nikolas Martelaro  
**arXiv:** [2311.05609](https://arxiv.org/abs/2311.05609)  
**Date:** 2023-11-09  
**Summary page:** https://www.summarizepaper.com/fr/paper/2311.05609v1/

## Abstract

This short paper introduces a workflow for generating realistic soundscapes for visual media. In contrast to prior work, which primarily focus on matching sounds for on-screen visuals, our approach extends to suggesting sounds that may not be immediately visible but are essential to crafting a convincing and immersive auditory environment. Our key insight is leveraging the reasoning capabilities of language models, such as ChatGPT. In this paper, we describe our workflow, which includes creating a scene context, brainstorming sounds, and generating the sounds.