标题： 视差实验：具有溢出效应的A/B测试 显示英文标题

标题： Seesaw Experimentation: A/B Tests with Spillovers

摘要： 本文探讨了A/B测试中的溢出效应如何阻碍组织进步，并提出了缓解这些挑战的策略。 我们识别出一种称为“跷跷板实验”的现象，其中公司的整体表现反而恶化，尽管在测量的A/B测试指标上实现了持续改进。 当主要指标中的成功创新在次要、未测量的维度上产生负面外部性时，就会出现跷跷板实验。 为了解决这个问题，我们建议对A/B测试批准实施正 hurdle rate。 我们推导出最优 hurdle rate，提供了一个简单的解决方案，在保持去中心化实验的同时减轻负面溢出效应。 显示英文摘要

摘要： This paper examines how spillover effects in A/B testing can impede organizational progress and develops strategies for mitigating these challenges. We identify a phenomenon termed ``seesaw experimentation'', where a firm's overall performance paradoxically deteriorates despite achieving continuous improvements in measured A/B testing metrics. Seesaw experimentation arises when successful innovations in primary metrics generate negative externalities in secondary, unmeasured dimensions. To address this problem, we propose implementing a positive hurdle rate for A/B test approval. We derive the optimal hurdle rate, offering a simple solution that preserves decentralized experimentation while mitigating negative spillovers.