Evidently AI Tutorial-Open Source ML Models Monitoring and Observability

Krish Naik · Beginner ·📐 ML Fundamentals ·2y ago

Evidently is an open-source Python library for data scientists and ML engineers.It helps evaluate, test, and monitor data and ML models from validation to production. It works with tabular, text data and embeddings. vidently helps evaluate and test data and ML model quality throughout the model lifecycle. Code : https://colab.research.google.com/drive/1bdXdxffXo8Ag0Wbyu2d9agXaUCnZjFDm?usp=sharing Evidently has a modular approach with 3 components: Reports, Test Suites, and a Monitoring Dashboard. They cover different usage scenarios: from ad hoc analysis to automated pipeline testing and continuous monitoring. Evidently has a simple, declarative API and a library of in-built metrics, tests, and visualizations. Timestamp: 00:00:00 Introduction 00:02:25 What is Evidently AI 00:05:25 Model Monitoring Using Evidently AI 00:14:17 Model Performance Check Using Evidently AI 00:25:53 Target Drift Using Evidently AI ------------------------------------------------------------------------------------------------------------- Support me by joining membership so that I can upload these kind of videos https://www.youtube.com/channel/UCNU_lfiiWBdtULKOw6X0Dig/join ------------------------------------------------------------------------------------------------------------------------------ ►Data Science Projects: https://www.youtube.com/watch?v=S_F_c9e2bz4&list=PLZoTAELRMXVPS-dOaVbAux22vzqdgoGhG&pp=iAQB ►Learn In One Tutorials Statistics in 6 hours: https://www.youtube.com/watch?v=LZzq1zSL1bs&t=9522s&pp=ygUVa3Jpc2ggbmFpayBzdGF0aXN0aWNz Machine Learning In 6 Hours: https://www.youtube.com/watch?v=JxgmHe2NyeY&t=4733s&pp=ygUba3Jpc2ggbmFpayBtYWNoaW5lIGxlYXJuaW5n Deep Learning 5 hours : https://www.youtube.com/watch?v=d2kxUVwWWwU&t=1210s&pp=ygUYa3Jpc2ggbmFpayBkZWVwIGxlYXJuaW5n ►Learn In a Week Playlist Statistics:https://www.youtube.com/watch?v=11unm2hmvOQ&list=PLZoTAELRMXVMgtxAboeAx-D9qbnY94Yay Machine Learning : https://www.youtube.com/watch?v=z8sxaUw_f-M&list=PLZoTAELRMXVPj

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Krish Naik · Krish Naik · 0 of 60

← Previous Next →

Natural Language Processing|Stemming

Natural Language Processing|Stemming

Natural Language Processing|BagofWords

Natural Language Processing|BagofWords

Gaussian distribution or Normal Distribution in statisctics

Gaussian distribution or Normal Distribution in statisctics

Natural Language Processing|TF-IDF for Machine Learning| Text Prerocessing

Natural Language Processing|TF-IDF for Machine Learning| Text Prerocessing

Log Normal Distribution in Statistics

Log Normal Distribution in Statistics

Covariance in Statistics

Covariance in Statistics

Confusion matrix, Precision, Recall| Data Science Interview questions

Confusion matrix, Precision, Recall| Data Science Interview questions

Tutorial 44-Balanced vs Imbalanced Dataset and how to handle Imbalanced Dataset

Tutorial 44-Balanced vs Imbalanced Dataset and how to handle Imbalanced Dataset

Implementing a Spam classifier in python| Natural Language Processing

Implementing a Spam classifier in python| Natural Language Processing

Tutorial 11-Exploratory Data Analysis(EDA) of Titanic dataset

Tutorial 11-Exploratory Data Analysis(EDA) of Titanic dataset

Face Recognition using open CV and VGG 16 Transfer Learning

Face Recognition using open CV and VGG 16 Transfer Learning

Pedestrian Detection using OpenCV from Videos

Pedestrian Detection using OpenCV from Videos

Face and Eye Detection from Videos using HAAR Cascade Classifier

Face and Eye Detection from Videos using HAAR Cascade Classifier

Reading, Writing and Displaying images with Opencv| OpenCV Tutorial

Reading, Writing and Displaying images with Opencv| OpenCV Tutorial

OpenCV Installation | OpenCV tutorial

OpenCV Installation | OpenCV tutorial

Face and Eye Detection from Images using HAAR Cascade Classifier

Face and Eye Detection from Images using HAAR Cascade Classifier

Car Detection using HAAR Cascade and Opencv from Videos.

Car Detection using HAAR Cascade and Opencv from Videos.

Using OpenFace for Face recognition in Keras

Using OpenFace for Face recognition in Keras

OpenPose Tutorial with Tensorflow

OpenPose Tutorial with Tensorflow

Multiple Linear Regression using python and sklearn

Multiple Linear Regression using python and sklearn

Dimensional Reduction| Principal Component Analysis

Dimensional Reduction| Principal Component Analysis

Movie Recommender System using Python

Movie Recommender System using Python

TPR,FPR,FNR,TNR, Confusion Matrix

TPR,FPR,FNR,TNR, Confusion Matrix

Precision, Recall and F1-Score

Precision, Recall and F1-Score

Artificial Neural Network for Customer's Exit Prediction from Bank

Artificial Neural Network for Customer's Exit Prediction from Bank

GridSearchCV- Select the best hyperparameter for any Classification Model

GridSearchCV- Select the best hyperparameter for any Classification Model

RandomizedSearchCV- Select the best hyperparameter for any Classification Model

RandomizedSearchCV- Select the best hyperparameter for any Classification Model

K Nearest Neighbor classification with Intuition and practical solution

K Nearest Neighbor classification with Intuition and practical solution

K Means Clustering Intuition

K Means Clustering Intuition

Create custom Alexa Skill- Lambda function- Part2

Create custom Alexa Skill- Lambda function- Part2

Hierarchical Clustering intuition

Hierarchical Clustering intuition

Implement Transfer Learning with a generic Code Template

Implement Transfer Learning with a generic Code Template

Gender Classifier and Age Estimator using Resnet Convolution Neural Network

Gender Classifier and Age Estimator using Resnet Convolution Neural Network

Unlock Your Application With Your Face using OpenCV

Unlock Your Application With Your Face using OpenCV

Draw rectangle from webcam and sketch process it on a live feed

Draw rectangle from webcam and sketch process it on a live feed

Complete Life Cycle of a Data Science Project

Complete Life Cycle of a Data Science Project

How we can apply Machine Learning in Finance

How we can apply Machine Learning in Finance

Deep Learning in Medical Science

Deep Learning in Medical Science

How to switch your career to Data Science.

How to switch your career to Data Science.

Linear Regression Mathematical Intuition

Linear Regression Mathematical Intuition

Handle Categorical features using Python

Handle Categorical features using Python

Machine Learning Algorithm- Which one to choose for your Problem?

Machine Learning Algorithm- Which one to choose for your Problem?

DBSCAN Clustering Easily Explained with Implementation

DBSCAN Clustering Easily Explained with Implementation

Curse of Dimensionality Easily explained| Machine Learning

Curse of Dimensionality Easily explained| Machine Learning

Feature Selection Techniques Easily Explained | Machine Learning

Feature Selection Techniques Easily Explained | Machine Learning

Tutorial 29-R square and Adjusted R square Clearly Explained| Machine Learning

Tutorial 29-R square and Adjusted R square Clearly Explained| Machine Learning

Cross Validation using sklearn and python | Machine Learning

Cross Validation using sklearn and python | Machine Learning

Handling Missing Data Easily Explained| Machine Learning

Handling Missing Data Easily Explained| Machine Learning

Deploy Machine Learning Model using Flask

Deploy Machine Learning Model using Flask

Deployment of Deep Learning Model using Flask

Deployment of Deep Learning Model using Flask

How to Visualize Multiple Linear Regression in python

How to Visualize Multiple Linear Regression in python

K Nearest Neighbour Easily Explained with Implementation

K Nearest Neighbour Easily Explained with Implementation

Predicting Heart Disease using Machine Learning

Predicting Heart Disease using Machine Learning

Predicting Lungs Disease using Deep Learning

Predicting Lungs Disease using Deep Learning

Stock Sentiment Analysis using News Headlines

Stock Sentiment Analysis using News Headlines

Random Forest(Bootstrap Aggregation) Easily Explained

Random Forest(Bootstrap Aggregation) Easily Explained

Voting Classifier(Hard Voting and Soft Voting Classifier)

Voting Classifier(Hard Voting and Soft Voting Classifier)

Credit Card Fraud Detection using Machine Learning from Kaggle

Credit Card Fraud Detection using Machine Learning from Kaggle

Hyperparameter Optimization for Xgboost

Hyperparameter Optimization for Xgboost

Tutorial 45-Handling imbalanced Dataset using python- Part 1

Tutorial 45-Handling imbalanced Dataset using python- Part 1

Related AI Lessons

I Tried Rust and Carbon for 6 Months-Only One Survived (And It Wasn’t What I Expected)

Discover the challenges and surprises of learning Rust and Carbon programming languages

Medium · Programming

Predictive operations for BFSI Banking: delay prediction, risk scoring, leakage prevention, and recovery

Learn how predictive operations can improve BFSI banking with delay prediction, risk scoring, and leakage prevention

Dev.to · Ananthapathmanabhan A

Six Choices Every AI Engineer Has to Make (and Nobody Teaches)

AI engineers face crucial production trade-offs when deploying models, and understanding these choices is vital for success

Towards Data Science

Predicting Satellite Collisions: How Machine Learning is Saving Earth’s Orbit

Machine learning helps predict satellite collisions in Earth's orbit, preventing catastrophic consequences

Medium · Machine Learning

Chapters (5)

Introduction

2:25 What is Evidently AI

5:25 Model Monitoring Using Evidently AI

14:17 Model Performance Check Using Evidently AI

25:53 Target Drift Using Evidently AI

Debug Slow HTTP Requests in Python With httptap