图 书 馆
窥视 A/B 测试：为什么它很重要，以及如何应对它Peeking at A/B Tests: Why it matters, and what to do about it |
|
| 课程网址: | http://videolectures.net/kdd2017_walsh_peeking_tests/ |
| 主讲教师: | David Walsh |
| 开课单位: | 斯坦福大学 |
| 开课时间: | 2017-10-09 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | This paper reports on novel statistical methodology, which has been deployed by the commercial A/B testing platform Optimizely to communicate experimental results to their customers. Our methodology addresses the issue that traditional p-values and confidence intervals give unreliable inference. This is because users of A/B testing software are known to continuously monitor these measures as the experiment is running. We provide always valid p-values and confidence intervals that are provably robust to this effect. Not only does this make it safe for a user to continuously monitor, but it empowers her to detect true effects more efficiently. This paper provides simulations and numerical studies on Optimizely's data, demonstrating an improvement in detection performance over traditional methods. |
| 关 键 词: | 统计方法; A/B 测试软件; 数据科学 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2023-12-25：wujk |
| 最后编审: | 2023-12-25：wujk |
| 阅读次数: | 28 |