SQLV2 Q4 demo

Patrick Devaney · Intermediate ·🧠 Large Language Models ·2y ago

Key Takeaways

This video demonstrates training a 4bit quantized LLM for writing SQL queries

Original Description

Demoing a 4bit quantized LLM trained towards writing SQL queries. With adequate hardware, this LLM is arguably faster and better than GPT-4 for its domain. It could help data scientists and web developers scaffold complex or repetitive sequences of queries based on natural language requests.
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Playlist UUY0xk_A4qJTQWcV2_3sqvJw · Patrick Devaney · 9 of 15

← Previous Next →

Related Reads

📰
The Future of Bengali Large Language Models (LLMs)
Learn about the potential of Bengali Large Language Models (LLMs) and their impact on the global AI landscape, particularly for the 300 million native Bangla speakers
Medium · Machine Learning
 📰
AI Prompt #1: First-Principles Thinking
Apply first-principles thinking to craft effective AI prompts and unlock better results
Medium · ChatGPT
 📰
How LLMs Decide What to Forget: KV Cache Eviction Explained
Learn how LLMs manage memory by evicting items from the KV cache to generate new tokens when GPU memory is full
Medium · AI
 📰
How LLMs Decide What to Forget: KV Cache Eviction Explained
Learn how LLMs manage memory by evicting items from the KV cache when GPU memory is full, and why this matters for efficient language model performance
Medium · LLM
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →