Decision Trees are an important type of algorithm for predictive modeling machine learning.
The representation for the decision tree model is a binary tree. This is your binary tree from algorithms and data structures, nothing too fancy. Each node represents a single input variable (x) and a split point on that variable (assuming the variable is numeric).
The leaf nodes of the tree contain an output variable (y) which is used to make a prediction. Predictions are made by walking the splits of the tree until arriving at a leaf node and output the class value at that leaf node.
Trees are fast to learn and very fast for making predictions. They are also often accurate for a broad range of problems and do not require any special preparation for your data.
Decision trees have a high variance and can yield more accurate predictions when used in an ensemble.
The following shows an example – the decision tree for TV.
decision-tree
–EOF (The Ultimate Computing & Technology Blog) —
loading...
Last Post: A Short Introduction: Linear Discriminant Analysis Algorithm
Next Post: A Short Introduction to Naive Bayes Algorithm
