Heuristic Search Algorithm for Dimensionality Reduction Optimally Combining Feature Selection and Feature Extraction
Abstract
The following are two classical approaches to dimensionality reduction: 1. Approximating the data with a small number of features that exist in the data (feature selection). 2. Approximating the data with a small number of arbitrary features (feature extraction). We study a generalization that approximates the data with both selected and extracted features. We show that an optimal solution to this hybrid problem involves a combinatorial search, and cannot be trivially obtained even if one can solve optimally the separate problems of selection and extraction. Our approach that gives optimal and approximate solutions uses a “best first” heuristic search. The algorithm comes with both an a priori and an a posteriori optimality guarantee similar to those that can be obtained for the classical weighted A* algorithm. Experimental results show the effectiveness of the proposed approach.
Cite
Text
He et al. "Heuristic Search Algorithm for Dimensionality Reduction Optimally Combining Feature Selection and Feature Extraction." AAAI Conference on Artificial Intelligence, 2019. doi:10.1609/AAAI.V33I01.33012280Markdown
[He et al. "Heuristic Search Algorithm for Dimensionality Reduction Optimally Combining Feature Selection and Feature Extraction." AAAI Conference on Artificial Intelligence, 2019.](https://mlanthology.org/aaai/2019/he2019aaai-heuristic/) doi:10.1609/AAAI.V33I01.33012280BibTeX
@inproceedings{he2019aaai-heuristic,
title = {{Heuristic Search Algorithm for Dimensionality Reduction Optimally Combining Feature Selection and Feature Extraction}},
author = {He, Baokun and Shah, Swair and Maung, Crystal and Arnold, Gordon and Wan, Guihong and Schweitzer, Haim},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2019},
pages = {2280-2287},
doi = {10.1609/AAAI.V33I01.33012280},
url = {https://mlanthology.org/aaai/2019/he2019aaai-heuristic/}
}