Do Modern Difference-in-Differences Estimators Change Published Findings in Business Research?

Auteurs : Davide Proserpio

Soumis à arXiv le 07 Nov. 2026
Résumé scientifique

Staggered-adoption difference-in-differences (DiD) designs are a workhorse of empirical research in business-school journals. The two-way fixed effects (TWFE) estimator that typically implements them can place negative weights on heterogeneous treatment effects. We ask whether negative weights change published findings by reanalyzing staggered-adoption specifications in business-school journals with journal-wide public replication archives. Following Hull (2026), we use large language model agents to identify eligible specifications, replicate the published TWFE estimate, and re-estimate each specification with the DiD-averaging estimator of Callaway and Sant'Anna (2021) and the imputation estimator of Borusyak et al. (2024). We re-estimate 355 specifications from 40 papers. Across the 283 DiD-averaging and 306 imputation comparisons that pass Hull's leverage screen, from 28 and 29 papers, TWFE and modern estimates have correlations of 0.61 and 0.70, change sign in 25.1 and 18.0 percent of comparisons, and differ significantly with opposite signs in 10.2 and 7.2 percent. Modern standard errors are 1.61 and 1.30 times those of TWFE. Including the comparisons that fail the screen leaves these figures essentially unchanged. Our results suggest that TWFE and heterogeneity-robust estimators disagree in a non-negligible share of the published staggered designs we re-estimate, and more often than in economics.

Les articles autour de lui, par date et par proximité

Plus haut, c’est plus proche de cet article ; à gauche, c’est plus ancien. Les traits relient les articles proches entre eux : les groupes de traits sont des sous-thèmes. Sélectionnez un point pour voir pourquoi il est là. Retour au résumé de cet article

Comment lire cette carte ? Guide illustré

Les articles les plus proches Les travaux antérieurs sur lesquels il s’appuie Les articles qui le citent

Les articles autour de celui-ci

Classés selon la proximité de leur titre et de leur résumé avec ceux de cet article. Sélectionnez-en pour les lire ensemble.

Les articles les plus proches

  1. Très proche Même question Cité par cet article Utilisé en profondeur par cet article
    How Different are Different Differences-in-Differences? A Large-Scale Meta-Analysis
    Peter Hull · 2026 · Econometrics · cité 1 fois · Résumé IA disponible

    Cette méta-analyse compare TWFE aux estimateurs modernes sur des spécifications à adoption échelonnée, mais dans des articles d’économie plutôt que de gestion et marketing.

    En bref

    Dans 1 346 spécifications de différences-en-différences à adoption échelonnée, les estimations TWFE concordent généralement avec les méthodes modernes, et les inversions de signe statistiquement significatives sont rares.

  2. Très proche Article de revue
    When Can We Use Two-Way Fixed Effects (TWFE)? A Comparison of TWFE and Novel Dynamic Difference-in-Differences Estimators
    Tobias Rüttenauer, O. Aksoy · 2026 · Sociological methodology · Pas encore résumé

    Cet article compare par simulations TWFE à cinq estimateurs DiD dynamiques et expose leurs biais et limites en cas d’adoption échelonnée.

    Résumé scientifique

    The conventional two-way fixed effects (TWFE) estimator has come under increasing scrutiny in settings with staggered treatment adoption. Recent research shows that TWFE can be biased when treatment effects vary across time or groups, prompting the development of several alternative dynamic difference-in-differences (DiD) estimators. Yet for applied researchers, it often remains unclear when TWFE is biased, what the newer estimators solve, and what limitations they all have. The authors provide an accessible overview of this literature and compare conventional TWFE with five dynamic DiD estimators using Monte Carlo simulations. The simulations consider realistic scenarios with time- and grou…

  3. Très proche Même question Cité par cet article
    How Much Should We Trust Staggered Difference-In-Differences Estimates?
    A. Baker, D. Larcker, Charles C. Y. Wang · 2021 · Social Science Research Network · cité 2 259 fois · Pas encore résumé

    Cette étude réexamine des résultats publiés sur les DiD échelonnés en finance et comptabilité, en évaluant les biais liés à l’hétérogénéité des effets.

    Résumé scientifique

    Difference-in-differences analysis with staggered treatment timing is frequently used to assess the impact of policy changes on corporate outcomes in academic research. However, recent advances in econometric theory show that such designs are likely to be biased in the presence of treatment effect heterogeneity. Given the pronounced use of staggered treatment designs in applied corporate finance and accounting research, this finding potentially impacts a large swath of prior findings in these fields. We survey the nascent literature and document how and when such bias arises from treatment effect heterogeneity. We apply recently proposed methods to a set of prior published results, and find …

  4. Très proche Contexte plus large Cité par cet article
    Difference-in-Differences with compositional changes
    Pedro H. C. Sant'Anna, Qi Xu · 2023 · Journal of Econometrics · cité 7 fois · Pas encore résumé

    Cet article propose des estimateurs DiD pour les données répétées en coupe transversale avec changements de composition, plutôt que de comparer des estimateurs TWFE.

    Résumé scientifique

    This paper studies Difference-in-Differences (DiD) setups with repeated cross-sectional data and potential compositional changes across time periods. We begin our analysis by deriving the efficient influence function and the semiparametric efficiency bound for the average treatment effect on the treated (ATT). We introduce nonparametric estimators that attain the semiparametric efficiency bound under mild rate conditions on the estimators of the nuisance functions, exhibiting a type of rate doubly robust (DR) property. Additionally, we document a trade-off related to compositional changes: We derive the asymptotic bias of DR DiD estimators that erroneously exclude compositional changes and t…

  5. Proche Autre approche du problème Cité par cet article Utilisé en profondeur par cet article
    Two-stage differences in differences
    J. Gardner · 2022 · cité 237 fois · Pas encore résumé

    Cet article propose une estimation DiD en deux étapes pour l’adoption échelonnée et les effets hétérogènes, un autre remplacement possible de TWFE.

    Résumé scientifique

    A recent literature has shown that when adoption of a treatment is staggered and average treatment effects vary across groups and over time, difference-in-differences regression does not identify an easily interpretable measure of the typical effect of the treatment. In this paper, I extend this literature in two ways. First, I provide some simple underlying intuition for why difference-in-differences regression does not identify a group × period average treatment effect. Second, I propose an alternative two-stage estimation framework, motivated by this intuition. In this framework, group and period effects are identified in a first stage from the sample of untreated observations, and average treatmen…

  6. Proche Article de revue Cité par cet article
    Difference-in-Differences Designs: A Practitioner's Guide
    A. Baker, Brantly Callaway, Scott Cunningham et al. · 2025 · cité 50 fois · Pas encore résumé

    Ce guide organise les types de plans DiD et leurs estimateurs, notamment les périodes multiples et les traitements échelonnés.

    Résumé scientifique

    Difference-in-differences (DiD) is arguably the most popular quasi-experimental research design. Its canonical form, with two groups and two periods, is well-understood. However, empirical practices can be ad hoc when researchers go beyond that simple case. This article provides an organizing framework for discussing different types of DiD designs and their associated DiD estimators. It discusses covariates, weights, handling multiple periods, and staggered treatments. The organizational framework, however, applies to other extensions of DiD methods as well.

  7. Proche Article de revue Cité par cet article
    What’s trending in difference-in-differences? A synthesis of the recent econometrics literature
    J. Roth, Pedro H. C. Sant'Anna, A. Bilinski et al. · 2022 · Journal of Econometrics · cité 1 835 fois · Pas encore résumé

    Cette synthèse classe les avancées récentes en DiD, notamment celles sur les périodes multiples et la variation du calendrier de traitement.

    Résumé scientifique

    This paper synthesizes recent advances in the econometrics of difference-in-differences (DiD) and provides concrete recommendations for practitioners. We begin by articulating a simple set of ``canonical'' assumptions under which the econometrics of DiD are well-understood. We then argue that recent advances in DiD methods can be broadly classified as relaxing some components of the canonical DiD setup, with a focus on $(i)$ multiple periods and variation in treatment timing, $(ii)$ potential violations of parallel trends, or $(iii)$ alternative frameworks for inference. Our discussion highlights the different ways that the DiD literature has advanced beyond the canonical model, and helps to…

  8. Proche Contexte plus large Cité par cet article
    How Much Should We Trust Differences-in-Differences Estimates?
    Marianne Bertrand, E. Duflo, S. Mullainathan · 2004 · National Bureau of Economic Research · cité 11 440 fois · Pas encore résumé

    Cet article étudie le biais des erreurs-types en DiD dû à la corrélation sérielle, plutôt que les poids négatifs de TWFE.

    Résumé scientifique

    Most Difference-in-Difference (DD) papers rely on many years of data and focus on serially correlated outcomes. Yet almost all these papers ignore the bias in the estimated standard errors that serial correlation introduce4s. This is especially troubling because the independent variable of interest in DD estimation (e.g., the passage of law) is itself very serially correlated, which will exacerbate the bias in standard errors. To illustrate the severity of this issue, we randomly generate placebo laws in state-level data on female wages from the Current Population Survey. For each law, we use OLS to compute the DD estimate of its 'effect' as well as the standard error for this estimate. The …

Les travaux antérieurs sur lesquels il s’appuie

  1. Apparenté Contexte plus large Utilisé en profondeur par cet article
    Negative Weights are No Concern in Design-Based Specifications
    K. Borusyak, P. Hull · 2024 · Social Science Research Network · cité 12 fois · Pas encore résumé

    Cet article montre que les spécifications fondées sur le plan d’étude évitent les poids négatifs ex post, un enjeu distinct des comparaisons empiriques de TWFE.

    Résumé scientifique

    Recent work shows that popular partially-linear regression specifications can put negative weights on some treatment effects, potentially producing incorrectly-signed estimands. We show this is not an issue in design-based specifications, in which low-dimensional controls span the conditional expectation of the treatment. Specifically, the estimands of such specifications are convex averages of causal effects with ex-ante weights that average the potentially negative ex-post weights across possible treatment realizations. This result extends to design-based instrumental variable estimands under a first-stage monotonicity condition and applies to formula treatments and instruments such as shi…

  2. Apparenté Même question
    Causal Panel Analysis under Parallel Trends: Lessons from a Large Reanalysis Study
    Albert Chiu, Xingchen Lan, Ziyi Liu et al. · 2023 · American Political Science Review · cité 50 fois · Pas encore résumé

    Cette réanalyse compare des modèles TWFE à des estimateurs robustes à l’hétérogénéité sur des études publiées, mais en science politique.

    Résumé scientifique

    Two-way fixed effects (TWFE) models are widely used in political science to establish causality, but recent methodological discussions highlight their limitations under heterogeneous treatment effects (HTE) and violations of the parallel trends (PT) assumption. This growing literature has introduced numerous new estimators and procedures, causing confusion among researchers about the reliability of existing results and best practices. To address these concerns, we replicated and reanalyzed 49 studies from leading journals that employ TWFE models for causal inference using observational panel data with binary treatments. Using six HTE-robust estimators, diagnostic tests, and sensitivity analy…

  3. Apparenté Base de cet article
    Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
    Sarah C. Abraham, Li-Yang Sun · 2018 · Journal of Econometrics · cité 4 821 fois · Pas encore résumé

    Cet article établit que TWFE peut agréger de façon non convexe des effets hétérogènes et produire des termes parasites dans les études d’événement.

    Résumé scientifique

    Event studies are frequently used to estimate average treatment effects on the treated (ATT). In estimating the ATT, researchers commonly use fixed effects models that implicitly assume constant treatment effects across cohorts. We show that this is not an innocuous assumption. In fixed effect models where the sole regressor is treatment status, the OLS coefficient is a non-convex average of the heterogeneous cohort-specific ATTs. When regressors containing lags and leads of treatment are added, the OLS coefficient corresponding to a given lead or lag picks up spurious terms consisting of treatment effects from other periods. Therefore, estimates from these commonly used models are not causa…

Comment ces articles sont-ils trouvés ?

Nous comparons le titre et le résumé de cet article avec ceux de tous les articles résumés sur ce site, et avec les articles que Semantic Scholar recommande, ceux qu’il cite et ceux qui le citent (pour un article très cité, ses citations les plus récentes et, depuis OpenAlex, les plus citées). Parmi les travaux antérieurs et les suites, les articles qui s’utilisent en profondeur, une méthode qu’il utilise et les suites très citées remontent un peu. Les niveaux (très proche, proche, apparenté) viennent de la similarité des textes, pas d’un jugement de qualité ; * signale un article sans résumé, comparé par son titre. La phrase sous un article est écrite par une IA à partir des deux résumés : vérifiez-la dans les articles. Un article jugé hors sujet par trois lecteurs quitte la liste.

Mis à jour le 16 novembre 2026.

Le guide illustré des articles autour d’un article