Comparison of different decision tree algorithms
| Methods | CART | C4. 5 | CHAID | QUEST |
|---|---|---|---|---|
| Measure used to select input variable | Gini index; Twoing criteria | Entropy info-gain | Chi-square | Chi-square for categorical variables; J-way ANOVA for continuous/ordinal variables |
| Pruning | Pre-pruning using a single-pass algorithm | Pre-pruning using a single-pass algorithm | Pre-pruning using Chi-square test for independence | Post-pruning |
| Dependent variable | Categorical/ Continuous | Categorical/ Continuous | Categorica | Categorical |
| Input variables | Categorical/ Continuous | Categorical/ Continuous | Categorical/ Continuous | Categorical/ Continuous |
| Split at each node | Binary; Split on linear combinations | Multiple | Multiple | Binary; Split on linear combinations |
