What is feature selection, and why is it important? Describe the main categories of feature selection methods and give examples of each.

Sample answer preview

Feature selection is the process of identifying and selecting a subset of the most relevant features for model training. It differs from feature extraction, which creates new features through transformations like PCA. Feature selection is important for several reasons.