FastText Embedding for Rare (OOV) Words | Explained with Example | FastText Vs GloVe Vs Word2Vec

RoboSathi · Beginner ·📐 ML Fundamentals ·2mo ago

About this lesson

📘 Notes: https://robosathi.com/docs/natural_language_processing/text-embedding/#fast_text 🎥 NLP Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxcDlHCeNiKbRhLWKVunQaxn 🎥 Deep Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxe749nPGDV2cd6SR6zIZIJl 🎥 Machine Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxeydAqz2lsSMFYinbrJy9mu 🎥 Full Maths Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxen-R6NytSMigAri7piPhFp 🎥 Word2Vec: https://youtu.be/zBpili1p2Io 🎥 GloVe: https://youtu.be/Te9qLvHpBRk ✅ This video describes in detail the FastText embedding technique invented by Facebook in 2016, that was designed to handle rare words or out of vocabulary words, which are very common on social networks. 🕔 Time Stamp 🕘 00:00:00 - 00:01:53 Introduction 00:01:54 - 00:05:55 What is Distributed Text Representation ? 00:05:56 - 00:09:27 What is FastText ? 00:09:28 - 00:14:47 FastText Cost Function Explained 00:14:48 - 00:16:17 FastText Example 00:16:18 - 00:19:34 FastText Vs GloVe Vs Word2Vec Comparison & Use Cases 00:19:35 - 00:20:22 Next: RNN

Original Description

📘 Notes: https://robosathi.com/docs/natural_language_processing/text-embedding/#fast_text 🎥 NLP Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxcDlHCeNiKbRhLWKVunQaxn 🎥 Deep Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxe749nPGDV2cd6SR6zIZIJl 🎥 Machine Learning Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxeydAqz2lsSMFYinbrJy9mu 🎥 Full Maths Course: https://www.youtube.com/playlist?list=PLnpa6KP2ZQxen-R6NytSMigAri7piPhFp 🎥 Word2Vec: https://youtu.be/zBpili1p2Io 🎥 GloVe: https://youtu.be/Te9qLvHpBRk ✅ This video describes in detail the FastText embedding technique invented by Facebook in 2016, that was designed to handle rare words or out of vocabulary words, which are very common on social networks. 🕔 Time Stamp 🕘 00:00:00 - 00:01:53 Introduction 00:01:54 - 00:05:55 What is Distributed Text Representation ? 00:05:56 - 00:09:27 What is FastText ? 00:09:28 - 00:14:47 FastText Cost Function Explained 00:14:48 - 00:16:17 FastText Example 00:16:18 - 00:19:34 FastText Vs GloVe Vs Word2Vec Comparison & Use Cases 00:19:35 - 00:20:22 Next: RNN

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

I Taught an AI to Recognize the Shadows of Four-Dimensional Objects

Learn how a neural network was taught to recognize the shadows of four-dimensional objects, expanding our understanding of high-dimensional geometry

SVD y PCA: cómo el álgebra lineal comprime miles de dimensiones

Aprende a reducir dimensiones con SVD y PCA, técnicas de álgebra lineal que sostienen el machine learning moderno

The Baseline I Actually Picked for My Kaggle Pokémon Agent, and Why

Learn how to approach building a Kaggle Pokémon agent by understanding the baseline model selection process and its importance in competitive machine learning challenges

Medium · Machine Learning

From Data to Decisions: A Beginners Guide to Understanding Machine Learning

Learn the basics of machine learning to make informed decisions from data

Medium · Machine Learning

Chapters (7)

00:01:53 Introduction

1:54 00:05:55 What is Distributed Text Representation ?

5:56 00:09:27 What is FastText ?

9:28 00:14:47 FastText Cost Function Explained

14:48 00:16:17 FastText Example

16:18 00:19:34 FastText Vs GloVe Vs Word2Vec Comparison & Use Cases

19:35 00:20:22 Next: RNN

QR Decomposition is Just Gram-Schmidt with Receipts