Activation Functions

Data Skeptic · Beginner ·📐 ML Fundamentals ·8y ago
In a neural network, the output value of a neuron is almost always transformed in some way using a function. A trivial choice would be a linear transformation which can only scale the data. However, other transformations, like a step function allow for non-linear properties to be introduced. Activation functions can also help to standardize your data between layers. Some functions such as the sigmoid have the effect of "focusing" the area of interest on data. Extreme values are placed close together, while values near it's point of inflection change more quickly with respect to small chang…
Watch on YouTube ↗ (saves to browser)

Playlist

Uploads from Data Skeptic · Data Skeptic · 0 of 60

← Previous Next →
1 Data Skeptic book giveaway contest winner selection
Data Skeptic book giveaway contest winner selection
Data Skeptic
 2 OpenHouse - Front end and API overview
OpenHouse - Front end and API overview
Data Skeptic
 3 OpenHouse Crawling with AWS Lambda
OpenHouse Crawling with AWS Lambda
Data Skeptic
 4 [MINI] Logistic Regression on Audio Data
[MINI] Logistic Regression on Audio Data
Data Skeptic
 5 Data Provenance and Reproducibility with Pachyderm
Data Provenance and Reproducibility with Pachyderm
Data Skeptic
 6 [MINI] Primer on Deep Learning
[MINI] Primer on Deep Learning
Data Skeptic
 7 Big Data Tools and Trends
Big Data Tools and Trends
Data Skeptic
 8 [MINI] Automated Feature Engineering
[MINI] Automated Feature Engineering
Data Skeptic
 9 The Data Refuge Project
The Data Refuge Project
Data Skeptic
 10 [MINI] The Perceptron
[MINI] The Perceptron
Data Skeptic
 11 Reinventing Sponsored Search Auctions
Reinventing Sponsored Search Auctions
Data Skeptic
 12 [MINI] Feed Forward Neural Networks
[MINI] Feed Forward Neural Networks
Data Skeptic
 13 Data Science at Patreon
Data Science at Patreon
Data Skeptic
 14 [MINI] Backpropagation
[MINI] Backpropagation
Data Skeptic
 15 [MINI] GPU CPU
[MINI] GPU CPU
Data Skeptic
 16 Goodhart's Law
Goodhart's Law
Data Skeptic
 17 Exploring Data Skeptic downloads with Periscope Data
Exploring Data Skeptic downloads with Periscope Data
Data Skeptic
 18 OpenHouse
OpenHouse
Data Skeptic
 19 Opinion Polls for Presidential Elections
Opinion Polls for Presidential Elections
Data Skeptic
 20 [MINI] Generative Adversarial Networks
[MINI] Generative Adversarial Networks
Data Skeptic
 21 [MINI] AdaBoost
[MINI] AdaBoost
Data Skeptic
 22 [MINI] The Bootstrap
[MINI] The Bootstrap
Data Skeptic
 23 [MINI] Dropout
[MINI] Dropout
Data Skeptic
 24 [MINI] Gini Coefficients
[MINI] Gini Coefficients
Data Skeptic
 25 [MINI] Survival Analysis
[MINI] Survival Analysis
Data Skeptic
 26 [MINI] Random Forest
[MINI] Random Forest
Data Skeptic
 27 [MINI] Heteroskedasticity
[MINI] Heteroskedasticity
Data Skeptic
 28 NYC Bike Share Rebalancing
NYC Bike Share Rebalancing
Data Skeptic
 29 [MINI] ANOVA
[MINI] ANOVA
Data Skeptic
 30 Urban Congestion
Urban Congestion
Data Skeptic
 31 [MINI] The CAP Theorem
[MINI] The CAP Theorem
Data Skeptic
 32 Unstructured Data for Finance
Unstructured Data for Finance
Data Skeptic
 33 Detecting Terrorists with Facial Recognition?
Detecting Terrorists with Facial Recognition?
Data Skeptic
 34 Predictive Models on Random Data
Predictive Models on Random Data
Data Skeptic
 35 [MINI] Entropy
[MINI] Entropy
Data Skeptic
 36 [MINI] F1 Score
[MINI] F1 Score
Data Skeptic
 37 Causal Impact
Causal Impact
Data Skeptic
 38 2016 Holiday Special
2016 Holiday Special
Data Skeptic
 39 Machine Learning on Images with Noisy Human-centric Labels
Machine Learning on Images with Noisy Human-centric Labels
Data Skeptic
 40 The Library Problem
The Library Problem
Data Skeptic
 41 Stealing Models from the Cloud
Stealing Models from the Cloud
Data Skeptic
 42 Data Science at eHarmony
Data Science at eHarmony
Data Skeptic
 43 Multiple Comparisons and Conversion Optimization
Multiple Comparisons and Conversion Optimization
Data Skeptic
 44 Election Predictions
Election Predictions
Data Skeptic
 45 [MINI] Calculating Feature Importance
[MINI] Calculating Feature Importance
Data Skeptic
 46 [MINI] Receiver Operating Characteristic (ROC) Curve
[MINI] Receiver Operating Characteristic (ROC) Curve
Data Skeptic
 47 MS Connect Conference
MS Connect Conference
Data Skeptic
 48 [MINI] Paxos
[MINI] Paxos
Data Skeptic
 49 Music21
Music21
Data Skeptic
 50 The Police Data and the Data Driven Justice Initiatives
The Police Data and the Data Driven Justice Initiatives
Data Skeptic
 51 Studying Competition and Gender Through Chess
Studying Competition and Gender Through Chess
Data Skeptic
 52 [MINI] Goodhart's Law
[MINI] Goodhart's Law
Data Skeptic
 53 Trusting Machine Learning Models with LIME
Trusting Machine Learning Models with LIME
Data Skeptic
 54 [MINI] Leakage
[MINI] Leakage
Data Skeptic
 55 Predictive Policing
Predictive Policing
Data Skeptic
 56 Mutli-Agent Diverse Generative Adversarial Networks
Mutli-Agent Diverse Generative Adversarial Networks
Data Skeptic
 57 [MINI] Convolutional Neural Networks
[MINI] Convolutional Neural Networks
Data Skeptic
 58 Unsupervised Depth Perception
Unsupervised Depth Perception
Data Skeptic
 59 [MINI] Max-pooling
[MINI] Max-pooling
Data Skeptic
 60 MS Build 2017
MS Build 2017
Data Skeptic
Autoencoders, VAE, VQ-VAE - Explained!
Next Up
Autoencoders, VAE, VQ-VAE - Explained!
CodeEmporium