Towards Optimal Variance Reduction in Online Controlled Experiments

Ying Jin & Shan Ba
We study optimal variance reduction solutions for count and ratio metrics in online controlled experiments. Our methods apply flexible machine learning tools to incorporate covariates that are independent from the treatment but have predictive power for the outcomes, and employ the cross-fitting technique to remove the bias in complex machine learning models. We establish CLT-type asymptotic inference based on our estimators under mild convergence conditions. Our procedures are optimal (efficient) for the corresponding targets as...
This data repository is not currently reporting usage information. For information on how your repository can submit usage information, please see our documentation.