A multi-cell experimental design to recover policy relevant treatment effects, with an application to online advertising
AI-generated Key Points
- The paper proposes an experimental design that leverages modern estimation techniques when only eligibility to receive treatment can be randomized.
- This design is tailored to exploit these methods and recover enough information to solve problems with an intensive margin.
- The paper fills the gap in the literature by embedding a causal inference setup in an advertiser's optimization problem, enabling them to choose the intensive margin of how many consumers to reach with advertising.
- It connects causal inference with advertising decisions and provides a framework for recovering treatment effect parameters that account for parallel experimentation by competitors.
- The paper introduces a specific decision problem faced by firms - choosing the fraction of consumers from a target segment to reach with advertising to maximize expected profit.
- The proposed approach outperforms standard techniques in recovering treatment effect parameters and generates better decisions relative to standard techniques through a simple advertising reach decision problem.
- The paper discusses practical issues in implementing this design and highlights its limitations in accounting for other experimentation costs relevant in real-time bidding settings.
Authors: Caio Waisman, Brett R. Gordon
Abstract: Experiments are an important tool to measure the impacts of interventions. However, in experimental settings with one-sided noncompliance, extant empirical approaches may not produce the estimates a decision-maker needs to solve their problem. For example, these experimental designs are common in digital advertising settings, but they are uninformative of decisions regarding the intensive margin -- how much should be spent or how many consumers should be reached with a campaign. We propose a solution that combines a novel multi-cell experimental design with modern estimation techniques that enables decision-makers to recover enough information to solve problems with an intensive margin. Our design is straightforward to implement. Using data from advertising experiments at Facebook, we demonstrate that our approach outperforms standard techniques in recovering treatment effect parameters. Through a simple advertising reach decision problem, we show that our approach generates better decisions relative to standard techniques.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
Similar papers summarized with our AI tools
Navigate through even more similar papers through atree representation
Look for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.