Results of the summarizing process for the arXiv paper: 2211.03769v1

In recent years, the success of AlphaZero (AZ) has demonstrated that neural-network-based Go AIs can surpass human performance by a large margin. However, researchers have raised concerns about whether these agents are robust to adversarial perturbations. In this paper titled "Are AlphaZero-like Agents Robust to Adversarial Perturbations? ", Li-Cheng Lan and colleagues investigate the existence of adversarial states in Go AIs that may lead them to play surprisingly wrong actions. They extend the concept of adversarial examples to the game of Go by generating perturbed states that are semantically equivalent to the original state by adding meaningless moves to the game. An adversarial state is one that leads to an undoubtedly inferior action that is obvious even for Go beginners. The authors acknowledge that searching for such states is challenging due to the large, discrete, and non-differentiable search space in Go. To tackle this challenge, they develop the first adversarial attack on Go AIs which can efficiently search for adversarial states by strategically reducing the search space. This method can also be extended to other board games such as NoGo. Experimentally, they show that both Policy-Value neural network (PV-NN) and Monte Carlo tree search (MCTS) can be misled by adding one or two meaningless stones. For example, on 58% of AlphaGo Zero self-play games their method can make KataGo agent with 50 simulations of MCTS plays a losing action by adding two meaningless stones. The authors further evaluated their algorithm's found adversarial examples with amateur human Go players and found that 90% of examples indeed lead the AI agent to play an obviously inferior action. Overall, this study highlights potential vulnerabilities in current AI systems' robustness when faced with adversarial perturbations in complex games like Go. The authors provide their code at \url{https://PaperCode.cc/GoAttack} for further exploration and development. The findings of this study have implications for developing more robust AI systems in complex games and other domains.

• - AlphaZero has demonstrated that neural-network-based Go AIs can surpass human performance by a large margin
• - Researchers have raised concerns about whether these agents are robust to adversarial perturbations
• - Li-Cheng Lan and colleagues investigate the existence of adversarial states in Go AIs that may lead them to play surprisingly wrong actions
• - Adversarial state is one that leads to an undoubtedly inferior action that is obvious even for Go beginners
• - The authors develop the first adversarial attack on Go AIs which can efficiently search for adversarial states by strategically reducing the search space
• - Both Policy-Value neural network (PV-NN) and Monte Carlo tree search (MCTS) can be misled by adding one or two meaningless stones
• - 90% of examples indeed lead the AI agent to play an obviously inferior action when evaluated with amateur human Go players
• - This study highlights potential vulnerabilities in current AI systems' robustness when faced with adversarial perturbations in complex games like Go.

AlphaZero is a computer program that can play the game of Go better than most humans. Some people are worried that this program might not always make good decisions when it plays. Li-Cheng Lan and other researchers looked into this and found that sometimes AlphaZero makes really bad moves. These bad moves happen when AlphaZero is in an "adversarial state," which means it's in a situation where it's very likely to make a mistake. The researchers figured out how to find these situations and make AlphaZero play badly on purpose. They did this by adding some extra stones to the board in certain places. This study shows that even really smart computer programs like AlphaZero can be tricked into making mistakes, especially if they're playing complex games like Go. Definitions- Neural-network-based: A type of computer program that learns from experience, similar to how humans learn. - Adversarial perturbations: Changes made to a system with the intention of causing errors or malfunctions. - Adversarial states: Situations where a system is more likely to make mistakes or perform poorly. - Inferior action: A decision or move that is not as good as other possible options. - Monte Carlo tree search (MCTS): A method used by some AI programs for decision-making in games. - Vulnerabilities: Weaknesses or flaws in a system that could be exploited by others.

Are AlphaZero-like Agents Robust to Adversarial Perturbations?

In recent years, the success of AlphaZero (AZ) has demonstrated that neural-network-based Go AIs can surpass human performance by a large margin. However, researchers have raised concerns about whether these agents are robust to adversarial perturbations. In this paper titled "Are AlphaZero-like Agents Robust to Adversarial Perturbations?", Li-Cheng Lan and colleagues investigate the existence of adversarial states in Go AIs that may lead them to play surprisingly wrong actions.

What Are Adversarial Examples?

Adversarial examples are inputs designed to mislead an AI system into making incorrect predictions or decisions. They are generated by adding small perturbations to the original input such that it is semantically equivalent but leads the AI system astray. This concept has been widely studied in computer vision tasks where small changes in images can cause misclassification of objects even though they look similar to humans.

Extending Adversarial Examples To The Game Of Go

The authors extend the concept of adversarial examples to the game of Go by generating perturbed states that are semantically equivalent to the original state by adding meaningless moves to the game. An adversarial state is one that leads an AI agent playing Go into making an undoubtedly inferior action which is obvious even for beginners with no experience in playing Go. However, searching for such states is challenging due to the large, discrete, and non-differentiable search space in Go.

Developing An Attack On Go AIs

To tackle this challenge, they develop a novel attack on current AI systems which can efficiently search for adversarially crafted states by strategically reducing its search space using heuristics and domain knowledge from expert players' games records as well as Monte Carlo tree search (MCTS). This method can also be extended easily other board games such as NoGo without requiring any additional modifications or training data sets specific for each game type.

Experimental Results

Experimentally, they show that both Policy-Value neural network (PV-NN) and Monte Carlo tree search (MCTS) can be misled by adding one or two meaningless stones when tested on 58% of AlphaGo Zero self-play games their method was able make KataGo agent with 50 simulations of MCTS plays a losing action by adding two meaningless stones . The authors further evaluated their algorithm's found adversarial examples with amateur human Go players and found that 90% of examples indeed leaded them into playing obviously inferior actions compared with what professional players would do under same circumstances .

Implications For Developing More Robust AI Systems

Overall, this study highlights potential vulnerabilities in current AI systems' robustness when faced with adversarial perturbations in complex games like Go and provides insights into developing more secure models against malicious attacks . The authors provide their code at \url{https://PaperCode.cc/GoAttack} for further exploration and development so others could build upon their work towards creating more robust AI systems not only limited within board games but also applicable across different domains .