🚀 Deploy a PRIVATE Chroma Vector DB to AWS | Step by step 🚀

Tim Carambat · Beginner ·🔍 RAG & Vector Search ·2y ago

Skills: Vector Stores90%

Cloudformation template: https://s3.us-west-1.amazonaws.com/public.mintplexlabs.com/chromadb-with-api-key.json Script to reboot Docker: https://gist.github.com/timothycarambat/754969f00b9815459153ff4f66a5910f Hey there! This is the second video in a three-part series on how to launch Chroma (trychroma.com) and have it be fully private with no unauthorized access so you can store your vectors without worrying about your database being reset by a bad-actor! Using persistence and the built-in chroma authentication we can do this quite easily now! 🎉JOIN THE MINTPLEX LABS DISCORD🎉 Our Discord is the place for AI Developers to talk about new tools and also discuss and get early access & deals to Mintplex Labs tools like AnythingLLM and VectorAdmin. 🔥 https://discord.gg/6UyHPeGZAC 🔥 CHAPTERS: 0:00 Introduction to Chroma on AWS 0:48 Current Official Chroma AWS template 1:11 Problems with the official template 1:20 New and improved template with persistence and API protection 1:48 New template deep-dive for nerds 4:56 Deploy the template on AWS via Cloudformation 7:05 Connect to the new EC2 instance running Chroma 8:15 Sending our first request to the EC2 ChromaDB 10:25 How to update the API Key on the instance 12:09 How to reboot with new API key set 13:50 How to delete the instance on AWS 14:00 Costs, Limitations & Conclusion of running ChromaDB via Cloudformation #aws #opensource #rag #retrieval #chromadb #ai #aitools #vectordatabase #vectordata #tutorial #tech #technology #techtips #techtutorial #startups

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

More on: Vector Stores

View skill →

FULLY LOCAL Mistral AI PDF Processing [Hands-on Tutorial]

FULLY LOCAL Mistral AI PDF Processing [Hands-on Tutorial]

AI-Powered Resumes with Super People & Weaviate

AI-Powered Resumes with Super People & Weaviate

Weaviate vector database

Build Advanced Retrieval-Augmented Generation (RAG) with MongoDB Vector Search

Build Advanced Retrieval-Augmented Generation (RAG) with MongoDB Vector Search

Creating & Ingesting Your Own Embeddings in Weaviate | Vector Databases for Beginners | Part 7

Creating & Ingesting Your Own Embeddings in Weaviate | Vector Databases for Beginners | Part 7

Data Science Dojo

Configuring Vector Search in AlloyDB

Configuring Vector Search in Spanner

Related AI Lessons

The Future of RAG: Dead, Evolving… or Becoming the Brain of AI?

Learn about the future of RAG, from its current state to emerging trends like Agentic RAG and multimodal AI

Medium · Machine Learning

Smart Routing, Transfer Family Ingestion, and Voice Chat — Permission-Aware RAG v4.2

Learn about the latest features in Permission-Aware RAG v4.2, including Smart Routing, Transfer Family Ingestion, and Voice Chat, and how to apply them in your projects

Dev.to · Yoshiki Fujiwara(藤原善基)@AWS Community Builder

Most Companies Doing GenAI Are Really Just Doing RAG: RAGOps Explained for analysts

Learn why RAGOps is becoming the preferred approach for GenAI projects and how it differs from agent-based approaches

RAG - Sliding Window, Token Based Chunking and PDF Chunking Packages

Learn about RAG chunking mechanisms, including Sliding Window, Token Based, and PDF Chunking, to improve your AI model's text processing capabilities

Chapters (12)

Introduction to Chroma on AWS

0:48 Current Official Chroma AWS template

1:11 Problems with the official template

1:20 New and improved template with persistence and API protection

1:48 New template deep-dive for nerds

4:56 Deploy the template on AWS via Cloudformation

7:05 Connect to the new EC2 instance running Chroma

8:15 Sending our first request to the EC2 ChromaDB

10:25 How to update the API Key on the instance

12:09 How to reboot with new API key set

13:50 How to delete the instance on AWS

14:00 Costs, Limitations & Conclusion of running ChromaDB via Cloudformation

Watch this before applying for jobs as a developer.