Activation Function | Why Non Linearity is important in Deep Learning ? | Sigmoid | ReLU | Softmax

RoboSathi ยท Beginner ยท๐Ÿงฌ Deep Learning ยท3mo ago

About this lesson

๐Ÿ“˜ Notes: https://robosathi.com/docs/deep_learning/activation-function/ ๐ŸŽฅ NLP Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxcDlHCeNiKbRhLWKVunQaxn ๐ŸŽฅ Deep Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxe749nPGDV2cd6SR6zIZIJl ๐ŸŽฅ Machine Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxeydAqz2lsSMFYinbrJy9mu ๐ŸŽฅ Full Maths Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxen-R6NytSMigAri7piPhFp Pre-Requisites: ๐Ÿ“˜ Differentiation Notes: https://robosathi.com/docs/maths/calculus/calculus-fundamentals/ ๐ŸŽฅ Differentiation Video: https://www.youtube.com/watch?v=Vw35N4zDF-I ๐Ÿ•” Time Stamp ๐Ÿ•˜ 00:00:00 - 00:00:30 Introduction 00:00:31 - 00:01:25 Why do we Need Activation Function ? 00:01:26 - 00:03:35 Why is Non Linearity Important ? 00:03:36 - 00:04:45 Universal Approximation Theorem 00:04:46 - 00:08:10 What will happen If we Do Not Use Activation Function ? 00:08:11 - 00:09:01 Common Activation Functions 00:09:02 - 00:12:43 Sigmoid Activation Function 00:12:44 - 00:14:50 Hyperbolic Tangent (TanH) Activation Function 00:14:51 - 00:18:20 ReLU Activation Function 00:18:21 - 00:20:02 Leaky ReLU Activation Function 00:20:03 - 00:22:56 Softmax Activation Function 00:22:57 - 00:25:09 Softmax Example 00:25:10 - 00:25:53 Next: Optimization Methods

Original Description

๐Ÿ“˜ Notes: https://robosathi.com/docs/deep_learning/activation-function/ ๐ŸŽฅ NLP Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxcDlHCeNiKbRhLWKVunQaxn ๐ŸŽฅ Deep Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxe749nPGDV2cd6SR6zIZIJl ๐ŸŽฅ Machine Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxeydAqz2lsSMFYinbrJy9mu ๐ŸŽฅ Full Maths Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxen-R6NytSMigAri7piPhFp Pre-Requisites: ๐Ÿ“˜ Differentiation Notes: https://robosathi.com/docs/maths/calculus/calculus-fundamentals/ ๐ŸŽฅ Differentiation Video: https://www.youtube.com/watch?v=Vw35N4zDF-I ๐Ÿ•” Time Stamp ๐Ÿ•˜ 00:00:00 - 00:00:30 Introduction 00:00:31 - 00:01:25 Why do we Need Activation Function ? 00:01:26 - 00:03:35 Why is Non Linearity Important ? 00:03:36 - 00:04:45 Universal Approximation Theorem 00:04:46 - 00:08:10 What will happen If we Do Not Use Activation Function ? 00:08:11 - 00:09:01 Common Activation Functions 00:09:02 - 00:12:43 Sigmoid Activation Function 00:12:44 - 00:14:50 Hyperbolic Tangent (TanH) Activation Function 00:14:51 - 00:18:20 ReLU Activation Function 00:18:21 - 00:20:02 Leaky ReLU Activation Function 00:20:03 - 00:22:56 Softmax Activation Function 00:22:57 - 00:25:09 Softmax Example 00:25:10 - 00:25:53 Next: Optimization Methods
Watch on YouTube โ†— (saves to browser)
Sign in to unlock AI tutor explanation ยท โšก30

Related Reads

Chapters (13)

00:00:30 Introduction
0:31 00:01:25 Why do we Need Activation Function ?
1:26 00:03:35 Why is Non Linearity Important ?
3:36 00:04:45 Universal Approximation Theorem
4:46 00:08:10 What will happen If we Do Not Use Activation Function ?
8:11 00:09:01 Common Activation Functions
9:02 00:12:43 Sigmoid Activation Function
12:44 00:14:50 Hyperbolic Tangent (TanH) Activation Function
14:51 00:18:20 ReLU Activation Function
18:21 00:20:02 Leaky ReLU Activation Function
20:03 00:22:56 Softmax Activation Function
22:57 00:25:09 Softmax Example
25:10 00:25:53 Next: Optimization Methods
Up next
RNNs Explained in 60 Seconds #ai #coding #machinelearning
Ascent
Watch โ†’