Implementing Decision Trees From Scratch Using R

Decision Trees You can find the iPython Notebook for this post at https://github.com/bryantravissmith/FromScratch/tree/master/SupervisedLearning/DecisionTrees Decision Trees are a non-parametric supervised machine learning algorithm that takes a set of training data and constructs a set of regions in the space of features that is then used to make predictions. These predictions can be continuous values (Decision Tree […]

Implementing Logistic Regression From Scratch – Part 2: Python Code

Introduction I wrote about the theory of Logistic Regression in the previous article where I highlighted that the algorithm is attempting to find the weights/coefficients that maximizes the likelihood that the estimates of the probability/labels are correct. ¬†Through algebriac manipulation, the problem is reframed as finding the weights that produce minimum negative log-likelihood. ¬† One […]