Box AI with Ben Kus and Bob van Luijt - Weaviate Podcast #120!

Ben walks us through Box's three-layer infrastructure puzzle: First, the mind-boggling base infrastructure (think millions of interactions per second and trillions of files). Second, their unique multi-tenant security challenge - unlike most SaaS platforms, Box users share content across company boundaries, making traditional tenant isolation impossible. And third, ensuring AI respects all these complex permissions while still delivering value. The podcast then dives further into how vector embeddings can balloon file sizes - a few hundred bytes of text can require 4-6KB of vector data storage! We also dig into why RAG remains essential despite growing context windows, and how Box is developing AI agents that transform painful enterprise processes like RFP responses. A fun, insightful look at what happens when cutting-edge AI meets enterprise-grade security and scale requirements! Chapters 0:00 Weaviate Podcast #120! 0:20 Welcome Ben! 1:10 Exabyte Scale at Box 8:10 Infrastructure Rent vs. Buy 12:30 Founder-Led AI Adoption 19:37 Embeddings, RAG, and The AI Tipping Point 28:05 How many Vectors per Data Object? 37:20 Storage Tiers and Dynamic Indices in Retrieval 45:00 Agents 51:15 Agents for RFPs