图 书 馆
随机特征工程作为内核方法的一种快速准确的替代方法Randomized Feature Engineering as a Fast and Accurate Alternative to Kernel Methods |
|
| 课程网址: | http://videolectures.net/kdd2017_wang_randomized_feature_engineer... |
| 主讲教师: | Suhang Wang |
| 开课单位: | 视频讲座网 |
| 开课时间: | 2017-10-09 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Feature engineering has found increasing interest in recent years because of its ability to improve the effectiveness of various machine learning models. Although tailored feature engineering methods have been designed for various domains, there are few that simulate the consistent effectiveness of kernel methods. At the core, the success of kernel methods is achieved by using similarity functions that emphasize local variations in similarity. Unfortunately, this ability comes at the price of the high level of computational resources required and the inflexibility of the representation as it only provides the similarity of two data points instead of vector representations of each data point; while the vector representations can be readily used as input to facilitate various models for different tasks. Furthermore, kernel methods are also highly susceptible to overfitting and noise and it cannot capture the variety of data locality. In this paper, we first analyze the inner working and weaknesses of kernel method, which serves as guidance for designing feature engineering. With the guidance, we explore the use of randomized methods for feature engineering by capturing multi-granular locality of data. This approach has the merit of being time and space efficient for feature construction. Furthermore, the approach is resistant to overfitting and noise because the randomized approach naturally enables fast and robust ensemble methods. Extensive experiments on a number of real world datasets are conducted to show the effectiveness of the approach for various tasks such as clustering, classification and outlier detection. |
| 关 键 词: | 特征工程; 学习模型; 相似函数; 计算资源 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2022-11-24：chenxin01 |
| 最后编审: | 2023-05-18：liyy |
| 阅读次数: | 23 |