Engineering Features for Decision Trees
Using your knowledge of decision trees, learn the fundamentals of engineering the best features for your models.
We'll cover the following...
The best features for decision trees
Feature engineering is an iterative, creative process. The best features result from combining business domain knowledge with technical knowledge of the decision tree algorithm. From the algorithmic perspective, the following are critical for engineering the best decision tree features:
The best categorical features produce the data’s purest splits (i.e., decision boundaries). This is especially true when multiple categorical features are used simultaneously.
Avoid categorical ...