0


重叠的实验基础设施:更多、更好、更快的实验

Overlapping Experiment Infrastructure: More, Better, Faster Experimentation
课程网址: http://videolectures.net/kdd2010_tang_oei/  
主讲教师: Diane Tang
开课单位: 斯坦福大学
开课时间: 2010-10-01
课程语种: 英语
中文简介:
在谷歌,实验几乎是一个口头禅;我们评估几乎所有可能影响用户体验的变化。这些变化不仅包括明显的用户可见变化,例如对用户界面的修改,还包括更微妙的变化,例如可能影响排名或内容选择的不同机器学习算法。我们对实验的永不满足的兴趣使我们解决了如何进行更多实验,如何运行能够产生更好决策的实验以及如何更快地运行它们的问题。在本文中,我们描述了Google重叠的实验基础设施,它是解决这些问题的关键组成部分。此外,由于仅靠实验基础设施是不够的,我们还讨论了有效使用它所需的相关工具和教育过程。最后,我们通过描述显示整个实验环境成功的趋势来总结。虽然本文特别描述了我们在Google实施的实验系统和实验过程,但我们相信它们可以被任何有兴趣使用实验来改进搜索引擎和其他Web应用程序的实体推广和应用。
课程简介: At Google, experimentation is practically a mantra; we evaluate almost every change that potentially affects what our users experience. Such changes include not only obvious user-visible changes such as modifications to a user interface, but also more subtle changes such as different machine learning algorithms that might affect ranking or content selection. Our insatiable appetite for experimentation has led us to tackle the problems of how to run more experiments, how to run experiments that produce better decisions, and how to run them faster. In this paper, we describe Google's overlapping experiment infrastructure that is a key component to solving these problems. In addition, because an experiment infrastructure alone is insufficient, we also discuss the associated tools and educational processes required to use it effectively. We conclude by describing trends that show the success of this overall experimental environment. While the paper specifically describes the experiment system and experimental processes we have in place at Google, we believe they can be generalized and applied by any entity interested in using experimentation to improve search engines and other web applications.
关 键 词: 实验; 用户体验; 学习算法
课程来源: 视频讲座网
最后编审: 2019-05-11:cwx
阅读次数: 232