Processing math: 100%
7 Pre-Experiment Checklist
- Map out unit interactions and plausible spillover networks.
- Collect high-resolution substitution logs or co-click data.
- Generate clusters and validate using exposure metrics.
- Design meta-experiment with ≥25% traffic allocated to Bernoulli randomization.
- Write and register a pre-analysis plan (estimators, heterogeneity checks, etc.).
- Monitor compliance; re-balance if significant imbalance arises.
- Report bias estimates and effect sizes from both designs.
- Discuss implications for external validity and platform-wide rollout.