Results of the summarizing process for the arXiv paper: 2102.05089v1

Gamification has emerged as a promising approach to motivate and engage participants in software engineering education and practice activities. A systematic mapping study was conducted to investigate strategies for evaluating gamification in the context of software engineering. The study selected 100 primary studies on gamification in software engineering from 2011 to 2020. These studies were categorized based on the presence of evaluation procedures or models for gamification, the purpose of evaluation, criteria used, type of data collected, instruments used, and procedures for data analysis. The results indicate that while 64 studies report procedures for evaluating gamification, only three propose evaluation models. The evaluation of gamification focuses on two aspects: evaluating the gamification strategy itself related to user experience and perceptions; and evaluating its outcomes and effects on users and context. The most recurring criteria used in evaluations are engagement, motivation, satisfaction, and performance. Evaluation requires a mix of subjective and objective inputs with qualitative and quantitative data analysis approaches. Depending on whether the focus is on strategy or outcomes evaluation, there is a predominance of certain types of data collection methods or analysis techniques. For instance, when evaluating strategy-related aspects such as user experience or perception towards gamified systems or applications using surveys or interviews may be more appropriate than analyzing performance metrics. In conclusion, this study highlights the need for standardization in evaluating gamification approaches in software engineering education and practice activities. It also provides insights into different strategies employed by researchers in this field while identifying gaps that require further investigation.

• - Gamification is a promising approach to motivate and engage participants in software engineering education and practice activities.
• - A systematic mapping study was conducted to investigate strategies for evaluating gamification in the context of software engineering.
• - The study selected 100 primary studies on gamification in software engineering from 2011 to 2020.
• - The results indicate that while 64 studies report procedures for evaluating gamification, only three propose evaluation models.
• - The evaluation of gamification focuses on two aspects: evaluating the gamification strategy itself related to user experience and perceptions; and evaluating its outcomes and effects on users and context.
• - The most recurring criteria used in evaluations are engagement, motivation, satisfaction, and performance.
• - Evaluation requires a mix of subjective and objective inputs with qualitative and quantitative data analysis approaches.
• - Depending on whether the focus is on strategy or outcomes evaluation, there is a predominance of certain types of data collection methods or analysis techniques.
• - This study highlights the need for standardization in evaluating gamification approaches in software engineering education and practice activities.

Gamification is a way to make learning and doing things more fun by adding game-like elements. A study was done to see how well gamification works in software engineering education and practice. The study looked at 100 other studies from 2011 to 2020. Most of the studies talked about how to evaluate gamification, but only three had specific ways to do it. Evaluating gamification means looking at how much people like it and how well it helps them learn or do things. People use different methods to collect data and analyze it when evaluating gamification. This study shows that there needs to be a standard way of evaluating gamification in software engineering education and practice. Definitions- Gamification: adding game-like elements to make learning or doing things more fun - Software engineering: designing and creating computer programs - Evaluation: looking at something closely to see how well it works or if it's good

Gamification: A Promising Approach to Motivate and Engage Software Engineering Participants

Software engineering is a complex field that requires dedication, focus, and engagement. To ensure that students and practitioners remain motivated and engaged in software engineering activities, researchers have proposed gamification as a promising approach. Gamification involves the use of game elements such as points, levels, rewards, leaderboards, etc., to create an engaging environment for learning or practice. To better understand the strategies used for evaluating gamification in software engineering contexts, a systematic mapping study was conducted from 2011 to 2020. The study selected 100 primary studies on gamification in software engineering and categorized them based on their evaluation procedures or models for gamification; purpose of evaluation; criteria used; type of data collected; instruments used; and procedures for data analysis.

Evaluating Gamification Strategies

The results indicate that 64 studies reported procedures for evaluating gamifications while only three proposed evaluation models. Generally speaking, evaluations of gamified systems focus on two aspects: (1) Evaluating the strategy itself related to user experience and perceptions; (2) Evaluating its outcomes and effects on users and context. The most recurring criteria used in evaluations are engagement, motivation, satisfaction, performance metrics such as time spent playing/learning or number of tasks completed successfully. Evaluation requires a mix of subjective inputs such as surveys or interviews with qualitative data analysis approaches along with objective inputs such as performance metrics with quantitative data analysis techniques depending on whether the focus is on strategy-related aspects or outcome-related aspects respectively.

Conclusion

In conclusion this study highlights the need for standardization when it comes to evaluating gamification approaches in software engineering education and practice activities. It also provides insights into different strategies employed by researchers in this field while identifying gaps that require further investigation