Tokenization Hands-on | Bunny Labs | Text Processing | LLM | NLU | NLP | Text

Bunny Labs · Beginner ·🧠 Large Language Models ·2y ago

About this lesson

Bunny Labs is a division of Bunny Choo Choo, a NLP-based startup focused on education. We created this course to share the knowledge and experience we gained when building Bunny Choo Choo. We are exploring AI voice technology. Please like the video and subscribe us if you cannot distinguish whether the voice is from AI. Please comment if you know that this voice is generated by AI. IG: @bunny.choo.choo Pinterest: @BunnyChooChoo Youtube: @BunnyLabs Website: bunnychoochoo.com This course covers the hands-on exercises of tokenization includes charactered-based, word-based, subword-based and sentence-based tokenization.

Original Description

Bunny Labs is a division of Bunny Choo Choo, a NLP-based startup focused on education. We created this course to share the knowledge and experience we gained when building Bunny Choo Choo. We are exploring AI voice technology. Please like the video and subscribe us if you cannot distinguish whether the voice is from AI. Please comment if you know that this voice is generated by AI. IG: @bunny.choo.choo Pinterest: @BunnyChooChoo Youtube: @BunnyLabs Website: bunnychoochoo.com This course covers the hands-on exercises of tokenization includes charactered-based, word-based, subword-based and sentence-based tokenization.

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

Kimi K3 Beats Fable 5 and ChatGPT 5.6. It deserves more attention than another benchmark chart.

Kimi K3 outperforms Fable 5 and ChatGPT 5.6 with its 2.8 trillion parameter open-weight model and lower API pricing

2-Step RAG in Langchain

Learn to build a 2-step RAG using LangChain and FAISS to enhance LLMs with external knowledge

I Built an AI Letter Generator with GPT: Here's What I Learned

Learn how to build an AI-powered letter generator using GPT and discover its potential to transform professional writing

The Future of Bengali Large Language Models (LLMs)

Learn about the potential of Bengali Large Language Models (LLMs) and their impact on the global AI landscape, particularly for the 300 million native Bangla speakers

Medium · Machine Learning

5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems

Dave Ebbelaar (LLM Eng)