Results of the summarizing process for the arXiv paper: 2305.08346v1

Abstract Gamification has been widely studied for its positive effects on education and learning systems. However, the focus on its adverse effects is often overlooked. This study aims to provide a comprehensive overview of research reporting negative effects of game design elements and to explore developers' awareness and perceptions of these effects in practice. A systematic mapping study was conducted, resulting in 68 included papers that reported undesired effects of game design elements such as badges, leaderboards, competitions, and points. The most cited negative effects included lack of effect, worsened performance, motivational issues, lack of understanding, irrelevance, ethical issues like gaming the system and cheating. The study also mapped the relations between game design elements and their potential negative effects. Additionally, a focus group discussion with developers revealed that they were not fully aware of many potential negative effects but found this information useful. Developers agreed on some negative effects while also recognizing positive counterparts. The study concludes that while gamification can have positive impacts on education/learning software when properly applied, it is also prone to generating harmful effects. By discussing and revealing potential negative effects, informed decisions can be made considering their trade-off with expected benefits.

• - Gamification is widely studied for positive effects on education and learning systems
• - Negative effects of game design elements are often overlooked
• - Study aimed to provide overview of research reporting negative effects and explore developers' awareness
• - 68 papers included in systematic mapping study reported undesired effects of elements such as badges, leaderboards, competitions, and points
• - Most cited negative effects include lack of effect, worsened performance, motivational issues, lack of understanding, irrelevance, ethical issues like gaming the system and cheating
• - Relations between game design elements and potential negative effects were mapped
• - Developers not fully aware of many potential negative effects but found information useful
• - Gamification can have positive impacts when properly applied but also prone to harmful effects

Summary1. Gamification means using game elements to make learning fun. 2. Sometimes game design can have bad effects that people don't notice. 3. A study looked at how games can have negative effects and if developers know about them. 4. The study found that many papers reported problems with things like badges and points in games. 5. Game elements can cause issues like not helping, making things worse, and cheating. Definitions- Gamification: Using game elements in non-game contexts to engage and motivate people. - Undesired: Not wanted or favorable; something that is not good or preferred. - Systematic mapping study: A research method that systematically collects and analyzes existing literature on a specific topic to provide an overview of the field. - Ethical issues: Concerns related to moral principles, values, and behavior in a particular context, such as fairness, honesty, and integrity.

Introduction

Gamification, the use of game design elements in non-game contexts, has gained significant attention in recent years for its potential to enhance education and learning systems. It is believed that incorporating game-like features such as badges, leaderboards, competitions, and points can increase motivation and engagement among learners. However, while the positive effects of gamification have been extensively studied, there is a lack of research on its negative impacts. The aim of this study was to provide a comprehensive overview of research reporting negative effects of game design elements and explore developers' awareness and perceptions of these effects in practice. By identifying potential negative effects and their relationships with specific game design elements, this study aims to inform decision-making when implementing gamification in educational software.

Methodology

A systematic mapping study was conducted to identify relevant literature on the negative effects of gamification. A search strategy was developed using keywords related to gamification and its potential adverse impacts. The databases used for the search included Scopus, Web of Science, ACM Digital Library, IEEE Xplore Digital Library, ERIC (Education Resources Information Center), PsycINFO (Psychological Information Database), and Google Scholar. After screening titles and abstracts for relevance based on inclusion criteria set by the researchers (e.g., studies must report on undesired effects or consequences related to game design elements), 68 papers were included in the final analysis. In addition to analyzing existing literature, a focus group discussion with developers was conducted to gain insight into their awareness and perceptions regarding potential negative effects of gamification.

Results

The results revealed several common themes among the identified negative effects reported in literature:

• Lack of effect: Some studies found no significant impact or improvement on learning outcomes when using gamified features.
• Worsened performance: In some cases, the use of gamification led to a decrease in performance or learning outcomes.
• Motivational issues: While gamification is intended to increase motivation, some studies found that it can have the opposite effect and lead to decreased motivation among learners.
• Lack of understanding: The use of game design elements may cause confusion or lack of understanding among learners, particularly if they are not familiar with gaming concepts.
• Irrelevance: Some learners may perceive gamified features as irrelevant to their learning goals, leading to disengagement.
• Ethical issues: Gamification can also raise ethical concerns such as gaming the system or cheating in order to earn rewards or points.

The study also mapped the relationships between specific game design elements and their potential negative effects. For example, leaderboards were associated with increased competition and comparison among learners, which could lead to demotivation for those who do not perform well. The focus group discussion with developers revealed that while they were aware of some potential negative effects (such as motivational issues), there were others that they had not considered. They found this information useful in informing their decision-making when incorporating gamification into educational software. Developers also recognized that while there are potential negative effects, there are also positive impacts on learning and motivation.

Conclusion

This study highlights the need for a more balanced approach towards implementing gamification in education and learning systems. While it can have positive impacts when properly applied, it is also prone to generating harmful effects if not carefully designed and implemented. By identifying potential negative effects and their relationships with specific game design elements, this study provides valuable insights for developers when incorporating gamification into educational software. It emphasizes the importance of considering trade-offs between expected benefits and potential adverse impacts. Further research is needed to better understand the mechanisms behind these negative effects and how they can be mitigated. In the meantime, developers should carefully consider the potential consequences of incorporating gamification into their software and make informed decisions based on their specific context and goals.