Python Tutorial : Applying logistic regression and SVM

Want to learn more? Take the full course at https://learn.datacamp.com/courses/linear-classifiers-in-python at your own pace. More than a video, you'll learn hands-on coding & quickly apply skills to your daily work. --- In this video, we'll see how to run logistic regression and SVM with scikit-learn. The LogisticRegression class in scikit-learn is used just like the other models you've seen in the prerequisite course. First, we import LogisticRegression from scikit learn. You'll notice we're importing from linear_model, because logistic regression is a linear classifier. More on this later. Then, we instantiate an instance of the classifier. We fit the classifier on our training set. And then we can predict, compute the score, etc. Let's try this on an example data set, in this case the wine classification data set built into scikit-learn. We load the data set. Then, we create and fit a LogisticRegression object. We compute the training accuracy and see it's about 97%. scikit-learn's LogisticRegression can also output confidence scores rather than "hard" or definite predictions. Let's do this with the "predict_proba" function and test it out on the first training example. Here the classifier is reporting over 99% confidence for the first class, and very low probabilities for the other two. As a reminder, the little e means "10 to the power of", so you should interpret that first probability as 9-point-9 times 10 to the power of -1, or point-99, or 99%. We'll discuss these probabilities more in Chapter 3. In scikit-learn, the basic SVM classifier is called LinearSVC for linear support vector classifier. The LinearSVC object works exactly the same way as LogisticRegression. Note that this data set has more than 2 classes. scikit-learn's Logistic Regression and SVM implementations handle this automatically. We'll talk about how this works in Chapter 3. We can repeat these steps again for the "SVC" class, which fits a nonlinear SVM by default. As