Python Tutorial : Linear modeling with financial data
Want to learn more? Take the full course at https://learn.datacamp.com/courses/machine-learning-for-finance-in-python at your own pace. More than a video, you'll learn hands-on coding & quickly apply skills to your daily work.
---
Now that we have features and targets, we can fit our first machine learning model -- a linear model.
For machine learning, we usually split our data into train and test sets. With time-series data, we want to break up our train and test into continuous chunks. The training data should be the earliest data, and the test data should be the latest data. We fit our model to the training data and test on the newest data to understand how our algorithm will perform on new, unseen data. We can't use sklearn's train_test_split because it randomly shuffles the train and test data.
For linear models, we need to add a constant to our features, which adds a column of ones for a y-intercept term. statsmodels has add_constant() for this.
Then we split the data into train and test sets. First, we get the index we'll split at by using the train set fraction and the number of rows in our data. We get the number of rows from the dot-shape property and convert this to an integer.
Finally, we split features and targets into train and test sets using Python's indexing. Remember Python indexing goes [start:stop:step]. Here, we start from the beginning and go to train_size for the training dataset, then go from train_size to the end of the data for the test set.
Now that we have our train and test sets, we can fit a linear model. We first create the model with the OLS() function from statsmodels, giving it our train_targets and train_features. Then we use the fit method which returns an object with the results of the fit.
Printing out the summary of the fit results will yield a lot of information.
We see the R-squared value in the upper right and many other metrics. We can compare this value with R-squared from other models we try. An R-square
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from DataCamp · DataCamp · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
SQL Server Tutorial: Date manipulation
DataCamp
R Tutorial: Intermediate Interactive Data Visualization with plotly in R
DataCamp
R Tutorial: Adding aesthetics to represent a variable
DataCamp
R Tutorial: Moving Beyond Simple Interactivity
DataCamp
Python Tutorial: Why use ML for marketing? Strategies and use cases
DataCamp
Python Tutorial: Preparation for modeling
DataCamp
Python Tutorial: Machine Learning modeling steps
DataCamp
R Tutorial: The prior model
DataCamp
R Tutorial: Data & the likelihood
DataCamp
R Tutorial: The posterior model
DataCamp
R Tutorial: An Introduction to plotly
DataCamp
R Tutorial: Plotting a single variable
DataCamp
R Tutorial: Bivariate graphics
DataCamp
Python Tutorial: Customer Segmentation in Python
DataCamp
Python Tutorial: Time cohorts
DataCamp
Python Tutorial: Calculate cohort metrics
DataCamp
Python Tutorial: Cohort analysis visualization
DataCamp
R Tutorial: Building Dashboards with flexdashboard
DataCamp
R Tutorial: Anatomy of a flexdashboard
DataCamp
R Tutorial: Layout basics
DataCamp
R Tutorial: Advanced layouts
DataCamp
Python Tutorial: Time Series Analysis in Python
DataCamp
Python Tutorial: Correlation of Two Time Series
DataCamp
Python Tutorial: Simple Linear Regressions
DataCamp
Python Tutorial: Autocorrelation
DataCamp
R Tutorial: The gapminder dataset
DataCamp
R Tutorial: The filter verb
DataCamp
R Tutorial: The arrange verb
DataCamp
R Tutorial: The mutate verb
DataCamp
R Tutorial: What is cluster analysis?
DataCamp
R Tutorial: Distance between two observations
DataCamp
R Tutorial: The importance of scale
DataCamp
R Tutorial: Measuring distance for categorical data
DataCamp
Python Tutorial: Plotting multiple graphs
DataCamp
Python Tutorial: Customizing axes
DataCamp
Python Tutorial: Legends, annotations, & styles
DataCamp
Python Tutorial: Introduction to iterators
DataCamp
Python Tutorial: Playing with iterators
DataCamp
Python Tutorial: Using iterators to load large files into memory
DataCamp
SQL Tutorial: Introduction to Relational Databases in SQL
DataCamp
SQL Tutorial: Tables: At the core of every database
DataCamp
SQL Tutorial: Update your database as the structure changes
DataCamp
Python Tutorial: Classification-Tree Learning
DataCamp
Python Tutorial: Decision-Tree for Classification
DataCamp
Python Tutorial: Decision-Tree for Regression
DataCamp
Python Tutorial: Census Subject Tables
DataCamp
Python Tutorial: Census Geography
DataCamp
Python Tutorial: Using the Census API
DataCamp
R Tutorial: A/B Testing in R
DataCamp
R Tutorial: Baseline Conversion Rates
DataCamp
R Tutorial: Designing an Experiment - Power Analysis
DataCamp
R Tutorial: Introduction to qualitative data
DataCamp
R Tutorial: Understanding your qualitative variables
DataCamp
R Tutorial: Making Better Plots
DataCamp
SQL Tutorial: OLTP and OLAP
DataCamp
SQL Tutorial: Storing data
DataCamp
SQL Tutorial: Database design
DataCamp
Python Tutorial: Introduction to spaCy
DataCamp
Python Tutorial: Statistical Models
DataCamp
Python Tutorial: Rule-based Matching
DataCamp
More on: ML Maths Basics
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
Structuring TypeScript: Interfaces, Type Aliases, Enums, and Object Types
Medium · JavaScript
How I set up Sanity TypeGen for fully typed GROQ queries in TypeScript
Dev.to · Nayan Kyada
June 25 - AI, ML and Computer Vision Meetup
Dev.to AI
PHP fun: Lean theorem in PHP
Dev.to · david duymelinck
🎓
Tutor Explanation
DeepCamp AI