Information Gain, Gini and Decision Tree made from scratch

In this post, we will go over the complete decision tree theory and also build a very basic decision tree using information gain from scratch.

The below jupyter notebook as a Github Gist shows all the explanations and steps, including how to calculate Gini, Information gain and building a decision tree using the information gain you calculate.

You can also watch the video explainer here on youtube.