Results of the summarizing process for the arXiv paper: 2205.07444v2

This paper presents a deep reinforcement learning agent (AI) that uses sound as the input on the DareFightingICE platform at the DareFightingICE Competition in IEEE CoG 2022. The AI, referred to as blind AI, is unique because it relies solely on sound for gameplay, whereas most state-of-the-art AIs rely on visual or structured observations provided by their environments. Learning to play games from only sound is still a new and challenging task. To tackle this challenge, the authors propose different approaches to process audio data and utilize the Proximal Policy Optimization algorithm for their blind AI. They also introduce the use of their blind AI in evaluating sound designs submitted to the competition and define two metrics specifically for this task. The experimental results demonstrate not only the effectiveness of their blind AI but also the efficacy of the proposed metrics. This research contributes to advancing the field of deep reinforcement learning by exploring gameplay using only sound as input. It also provides valuable insights into evaluating game sounds and their impact on player experience. In addition, this work builds upon previous advancements in fighting game AI competitions, where various algorithms have been tested, including deep reinforcement learning with self-play and Monte Carlo Tree Search. However, these previous AIs relied on frame data provided by the competition until 2021. The DareFightingICE competition introduced a new challenge in 2022 by requiring entry AIs to play solely based on audio data without access to frame data information. Therefore, this study represents a pioneering effort in training an AI to play a fighting game using only sound as input. The authors highlight that their blind AI opens up possibilities for exploring alternative sensory inputs in gaming and encourages further research in this area. Overall, this paper presents a comprehensive exploration of deep reinforcement learning with sound-based input for gameplay and introduces novel evaluation metrics for assessing game sounds. The findings contribute to advancing both the field of artificial intelligence and game design by showcasing the potential of blind AI and highlighting the importance of sound in enhancing player experience.

• - Deep reinforcement learning agent (AI) using sound as input on DareFightingICE platform
• - Unique blind AI relying solely on sound for gameplay
• - Proposed approaches to process audio data and utilized Proximal Policy Optimization algorithm
• - Use of blind AI in evaluating sound designs and introduction of specific metrics
• - Experimental results demonstrating effectiveness of blind AI and proposed metrics
• - Advancement in deep reinforcement learning by exploring gameplay with sound input
• - Insights into evaluating game sounds and their impact on player experience
• - Previous AIs relied on frame data, but DareFightingICE competition introduced challenge of playing based on audio data only
• - Pioneering effort in training an AI to play a fighting game using only sound as input
• - Possibilities for exploring alternative sensory inputs in gaming and encouragement for further research
• - Comprehensive exploration of deep reinforcement learning with sound-based input and introduction of novel evaluation metrics

Summary: 1. A special kind of computer program called an AI is being trained to play a game using only sound as input. 2. This AI is different from others because it can't see the game, it can only hear it. 3. The scientists have come up with ways to understand and use the sound in the game, and they used a special algorithm to help the AI learn how to play better. 4. They also created new ways to measure how good the sounds in the game are and how they affect players. 5. The scientists did experiments to show that this blind AI and their new metrics work well. Definitions- Deep reinforcement learning agent (AI): A computer program that learns how to do things by trying different actions and getting rewards for doing well. - Sound: What we hear when something makes noise, like music or talking. - Input: Information that goes into a computer program so it knows what to do. - Gameplay: How you play a game, like moving characters or making choices. - Metrics: Measurements or ways of judging how good something is.

Deep Reinforcement Learning Agent Using Sound as Input for DareFightingICE Competition

In the 2022 IEEE CoG DareFightingICE competition, a new challenge was introduced: training an AI to play a fighting game using only sound as input. To tackle this challenge, researchers from the University of Tokyo proposed different approaches to process audio data and utilized the Proximal Policy Optimization algorithm for their blind AI. The experimental results demonstrate not only the effectiveness of their blind AI but also the efficacy of two novel metrics specifically designed to evaluate game sounds. This paper presents a comprehensive exploration of deep reinforcement learning with sound-based input for gameplay and introduces valuable insights into evaluating game sounds and their impact on player experience.

Background

The field of artificial intelligence has made great strides in recent years, particularly in gaming applications such as playing video games or board games at superhuman levels. Deep reinforcement learning (DRL) is one approach used by AIs to learn how to play these games through trial-and-error without any prior knowledge about them. DRL algorithms have been tested in various competitions such as AlphaGo Zero and OpenAI Five, where they achieved impressive results against human players or other AIs. However, most state-of-the-art AIs rely on visual or structured observations provided by their environments; learning to play games from only sound is still a new and challenging task.

Proposed Methodology

To address this challenge, the authors propose different approaches for processing audio data that can be used by their blind AI agent on the DareFightingICE platform at IEEE CoG 2022 competition. They utilize Proximal Policy Optimization (PPO), which is an advanced DRL algorithm that adapts its policy over time based on rewards received during interactions with its environment while avoiding catastrophic forgetting due to large changes in policy parameters between iterations. In addition, they introduce two metrics specifically designed for evaluating game sounds submitted to the competition: “sound quality” and “player engagement” scores which measure how well players are able to distinguish between different sounds within a game level and how engaged they are while playing it respectively.

Results & Discussion

The experimental results demonstrate not only the effectiveness of their blind AI but also the efficacy of their proposed metrics for assessing game sounds submitted to IEEE CoG 2022 competition. The findings contribute significantly towards advancing both fields of artificial intelligence and game design by showcasing potential applications of blind AI agents in exploring alternative sensory inputs in gaming and highlighting importance of sound in enhancing player experience respectively. Furthermore, this work builds upon previous advancements in fighting game AI competitions where various algorithms have been tested including deep reinforcement learning with self-play and Monte Carlo Tree Search; however these previous AIs relied on frame data provided by competitions until 2021 when DareFightingICE introduced new challenge requiring entry AIs solely based on audio data without access frame information which makes this study pioneering effort towards training an AI using only sound as input .

Conclusion

This research paper presents a deep reinforcement learning agent (AI) that uses sound as its sole input source on DareFightingICE platform at IEEE CoG 2022 competition along with two novel evaluation metrics specifically designed for assessing impact of sound designs submitted thereon player experience . It contributes significantly towards advancing both fields artificial intelligence & game design by exploring possibilities offered by alternative sensory inputs & emphasizing importance role played by sound therein . This work builds upon previous advancements made fighting game AI competitions while introducing unique challenge relying solely on audio data instead frame information thus representing pioneering effort training an agent use just sound .