Taste or Strategy? Nationalistic Bias and Competitor Penalties in Figure Skating Judging
Authors: Jialin Liu, Shu Shen
Abstract
Many decisions rest on expert panels whose members have ties to some candidates, and favoritism is hard to tell from shared taste or better information. Using a rich dataset from figure skating, we find evidence of a strategic compatriot premium and a targeted penalty on the compatriot's close rivals. The premium falls along a randomly drawn start order and, before 2022/23, rises when close rivals have their own judges on the panel. The penalty grows with the compatriot's placement chances and fades once she is out of contention. A counterfactual analysis shows that these biases can shape close competitions.
The papers around it, by date and closeness
Higher is closer to this paper; left is older. Lines join papers close to each other: groups of lines are sub-topics. Select a point to see why it is there. Back to the summary of this paper
Papers around this one
Ranked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
Biased forecasts and votingJacopo Bizzotto, Davide Cipullo, André Reslow · 2026 · The Scandinavian Journal of Economics · Not summarized yet
“Biased forecasts and voting” models strategic distortion by forecasters seeking to influence voters, while this paper studies judges’ strategic favoritism in skating scores.
Abstract
We introduce macroeconomic forecasters as strategic agents who may bias their reports to influence their audience. We test the motives of forecasters using monthly forecaster‐level data around the Brexit referendum. To guide our analysis, we model the way in which a referendum voter forms expectations based on the reports of a politically motivated forecaster. The forecaster trades off its reputation for honesty against the opportunity to influence the vote. The model predicts that the forecaster lies selectively and continues to do so even after the referendum. Our analysis finds that forecasters exposed to financial losses from Brexit issued significantly less accurate GDP growth forecasts…
-
The Price of DiversityHari Bandi, Dimitris Bertsimas · 2021 · Computers and Society · preprint, not peer reviewed · AI summary available
“The Price of Diversity” develops methods to reduce selection bias while preserving merit, whereas this paper examines nationalistic bias in expert judging.
Abstract
Systemic bias with respect to gender, race and ethnicity, often unconscious, is prevalent in datasets involving choices among individuals. Consequently, society has found it challenging to alleviate bias and achieve diversity in a way that maintains meritocracy in such settings. We propose (a) a novel optimization approach based on optimally flipping outcome labels and training classification models simultaneously to discover changes to be made in the selection process so as to achieve diversity without significantly affecting meritocracy, and (b) a novel implementation tool employing optimal classification trees to provide insights on which attributes of individuals lead to flipping of thei…
-
Inherent Trade-Offs in the Fair Determination of Risk ScoresJon Kleinberg, Sendhil Mullainathan, Manish Raghavan · 2016 · Machine Learning · cited 2,257 times · AI summary available
“Inherent Trade-Offs in the Fair Determination of Risk Scores” proves conflicts among algorithmic fairness conditions; this paper studies favoritism and rival penalties in human judging.
Abstract
Recent discussion in the public sphere about algorithmic classification has involved tension between competing notions of what it means for a probabilistic classification to be fair to different groups. We formalize three fairness conditions that lie at the heart of these debates, and we prove that except in highly constrained special cases, there is no method that can satisfy these three conditions simultaneously. Moreover, even satisfying all three conditions approximately requires that the data lie in an approximate version of one of the constrained special cases identified by our theorem. These results suggest some of the ways in which key notions of fairness are incompatible with each o…
-
A Statistical Model of Serve Return Impact Patterns in Professional TennisStephanie A. Kovalchik, Jim Albert · 2022 · Methodology · cited 4 times · AI summary available
“A Statistical Model of Serve Return Impact Patterns in Professional Tennis” models tennis tracking data, while this paper uses skating scores to test for judging bias.
Abstract
The spread in the use of tracking systems in sport has made fine-grained spatiotemporal analysis a primary focus of an emerging sports analytics industry. Recently publicized tracking data for men's professional tennis allows for the first detailed spatial analysis of return impact. Mixture models are an appealing model-based framework for spatial analysis in sport, where latent variable discovery is often of primary interest. Although finite mixture models have the advantages of interpretability and scalability, most implementations assume standard parametric distributions for outcomes conditioned on latent variables. In this paper, we present a more flexible alternative that allows the lat…
-
How to Find a Needle in a HaystackTheodora Helimäki, Åsa von Schoultz · 2024 · Political Behaviour in Contemporary Finland · Not summarized yet
“How to Find a Needle in a Haystack” examines voter evaluations and candidate-choice heuristics, while this paper studies judges’ nationalistic scoring behavior.
Abstract
Candidate choices are characterized by a more personal and intricate decision-making process compared to party choices. In this more complex choice, not only substantive evaluations but also perceived competences and the personal characteristics of candidates can affect voters’ choice of candidates. In this chapter, we present voters subjective evaluation of what matters for their choice of candidate and how these have developed over the last five latest parliamentary elections. We then move on to explore which type of voters are prone to use certain types of heuristics in their decision-making process. Here, we use register data on candidates in combination with stated candidate choice in t…
-
A Spectral Approach for the Dynamic Bradley-Terry ModelXin-Yu Tian, Jian Shi, Xiaotong Shen et al. · 2023 · Methodology · cited 8 times · Not summarized yet
“A Spectral Approach for the Dynamic Bradley-Terry Model” estimates time-varying sports rankings from pairwise comparisons, while this paper tests bias in figure-skating scores.
Abstract
The dynamic ranking, due to its increasing importance in many applications, is becoming crucial, especially with the collection of voluminous time-dependent data. One such application is sports statistics, where dynamic ranking aids in forecasting the performance of competitive teams, drawing on historical and current data. Despite its usefulness, predicting and inferring rankings pose challenges in environments necessitating time-dependent modeling. This paper introduces a spectral ranker called Kernel Rank Centrality, designed to rank items based on pairwise comparisons over time. The ranker operates via kernel smoothing in the Bradley-Terry model, utilizing a Markov chain model. Unlike th…
-
AI Oversight and Human Mistakes: Evidence from Centre CourtDavid Almog, Romain Gauriot, Lionel Page et al. · 2024 · Machine Learning · cited 16 times · Not summarized yet
“AI Oversight and Human Mistakes: Evidence from Centre Court” studies how Hawk-Eye affects tennis umpires’ decisions, while this paper examines nationalistic bias in skating judges’ scores.
Abstract
Powered by the increasing predictive capabilities of machine learning algorithms, artificial intelligence (AI) systems have begun to be used to overrule human mistakes in many settings. We provide the first field evidence this AI oversight carries psychological costs that can impact human decision-making. We investigate one of the highest visibility settings in which AI oversight has occurred: the Hawk-Eye review of umpires in top tennis tournaments. We find that umpires lowered their overall mistake rate after the introduction of Hawk-Eye review, in line with rational inattention given psychological costs of being overruled by AI. We also find that umpires increased the rate at which they c…
-
Goodhart in the Planner: Sampling-Based Control Exploits Rewards Learned from Human PreferencesSoovadeep Bakshi, Apurba Bose · 2026 · Robotics · AI summary available
“Goodhart in the Planner” studies reward exploitation in robot control, whereas this paper investigates strategic favoritism and competitor penalties in figure-skating judging.
In short
Preference-trained reward models can be exploited by harder planning, while calibrated regularization reduces—but does not eliminate—the resulting loss in true return.
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 16 November 2026.