Text Generation with GPT ๐Ÿค— NLP Tutorial with Hugging Face

Evren Ozkip ยท Beginner ยท๐Ÿง  Large Language Models ยท2y ago

About this lesson

Today, we covered how to perform text generation with the quantization technique using the Hugging Face ecosystem. 00:16 Installing libraries 00:46 Quantization config 02:49 Loading the model in 4-bit 05:01 Loading the tokenizer 06:21 Text generation ๐Ÿ”— https://github.com/TirendazAcademy/Hugging-Face-Tutorials/blob/main/PEFT-Tutorial/Text-Generation-with-Quantization.ipynb ๐Ÿ”ฅ Thanks for watching. Don't forget to subscribe, like the video, and leave a comment. Let's connect ๐Ÿ‘‡ ๐Ÿš€ Medium: https://tirendazacademy.medium.com ๐Ÿš€ X: https://x.com/tirendazacademy ๐Ÿš€ Linkedin: https://www.linkedin.com/in/tirendaz-academy โ–ถ๏ธ LLMs Tutorials: https://www.youtube.com/playlist?list=PLbQRubTta6fei76ldUYKTo-1B54mPfM5- โ–ถ๏ธ HuggingFace Tutorials: https://www.youtube.com/playlist?list=PLbQRubTta6ffTYE3aBfpuddiih0ieTmOt โ–ถ๏ธ LangChain Tutorials: https://www.youtube.com/playlist?list=PLbQRubTta6ffXhdurtaowW_p0BcweMYpj #ai #nlp #huggingface

Original Description

Today, we covered how to perform text generation with the quantization technique using the Hugging Face ecosystem. 00:16 Installing libraries 00:46 Quantization config 02:49 Loading the model in 4-bit 05:01 Loading the tokenizer 06:21 Text generation ๐Ÿ”— https://github.com/TirendazAcademy/Hugging-Face-Tutorials/blob/main/PEFT-Tutorial/Text-Generation-with-Quantization.ipynb ๐Ÿ”ฅ Thanks for watching. Don't forget to subscribe, like the video, and leave a comment. Let's connect ๐Ÿ‘‡ ๐Ÿš€ Medium: https://tirendazacademy.medium.com ๐Ÿš€ X: https://x.com/tirendazacademy ๐Ÿš€ Linkedin: https://www.linkedin.com/in/tirendaz-academy โ–ถ๏ธ LLMs Tutorials: https://www.youtube.com/playlist?list=PLbQRubTta6fei76ldUYKTo-1B54mPfM5- โ–ถ๏ธ HuggingFace Tutorials: https://www.youtube.com/playlist?list=PLbQRubTta6ffTYE3aBfpuddiih0ieTmOt โ–ถ๏ธ LangChain Tutorials: https://www.youtube.com/playlist?list=PLbQRubTta6ffXhdurtaowW_p0BcweMYpj #ai #nlp #huggingface
Watch on YouTube โ†— (saves to browser)
Sign in to unlock AI tutor explanation ยท โšก30

Related Reads

๐Ÿ“ฐ
What Actually Happens When You Press Enter in ChatGPT?
Discover what happens when you press Enter in ChatGPT and learn about the underlying AI technology
Medium ยท AI
 ๐Ÿ“ฐ
What Actually Happens When You Press Enter in ChatGPT?
Discover what happens when you press Enter in ChatGPT and how it processes your input
Medium ยท Machine Learning
 ๐Ÿ“ฐ
I Built an AI-Powered LeetCode Auto Solver Chrome Extension (Using JavaScript + LLM APIs)
Learn how to build a Chrome extension that uses LLM APIs to automatically solve LeetCode problems, and discover the potential of AI-powered coding tools
Medium ยท LLM
 ๐Ÿ“ฐ
I Tested Every Major AI Model for 30 Days. Hereโ€™s What Nobody Tells You.
Discover the unspoken truths about major AI models after a 30-day testing period, and learn how to apply these insights to your own workflow
Medium ยท ChatGPT

Chapters (5)

0:16 Installing libraries
0:46 Quantization config
2:49 Loading the model in 4-bit
5:01 Loading the tokenizer
6:21 Text generation
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch โ†’