图 书 馆
深度嵌入森林：具有深度嵌入特征的基于森林的服务Deep Embedding Forest: Forestbased Serving with Deep Embedding Features |
|
| 课程网址: | http://videolectures.net/kdd2017_shan_deep_embedding_forest/ |
| 主讲教师: | Ying Shan |
| 开课单位: | 微软 |
| 开课时间: | 2017-10-09 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Deep Neural Networks (DNN) have demonstrated superior ability to extract high level embedding vectors from low level features. Despite the success, the serving time is still the bottleneck due to expensive run-time computation of multiple layers of dense matrices. GPGPU, FPGA, or ASIC-based serving systems require additional hardware that are not in the mainstream design of most commercial applications. In contrast, tree or forest-based models are widely adopted because of low serving cost, but heavily depend on carefully engineered features. This work proposes a Deep Embedding Forest model that benefits from the best of both worlds. The model consists of a number of embedding layers and a forest/tree layer. The former maps high dimensional (hundreds of thousands to millions) and heterogeneous low-level features to the lower dimensional (thousands) vectors, and the latter ensures fast serving. Built on top of a representative DNN model called Deep Crossing, and two forest/tree-based models including XGBoost and LightGBM, a two-step Deep Embedding Forest algorithm is demonstrated to achieve on-par or slightly better performance as compared with the DNN counterpart, with only a fraction of serving time on conventional hardware. After comparing with a joint optimization algorithm called partial fuzzification, also proposed in this paper, it is concluded that the two-step Deep Embedding Forest has achieved near optimal performance. Experiments based on large scale data sets (up to 1 billion samples) from a major sponsored search engine proves the efficacy of the proposed model. |
| 关 键 词: | 神经网络; 嵌入特征; 密集矩阵 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2023-05-29：chenxin01 |
| 最后编审: | 2023-05-29：chenxin01 |
| 阅读次数: | 32 |