Unlimited private web-scraping for AI Agents | AnythingLLM

Tim Carambat · Beginner ·🧠 Large Language Models ·8mo ago
Hey everyone, Today we release [AnythingLLM Desktop 1.8.3](https://anythingllm.com/desktop), which includes our new **Authenticated Web Scraper** tool. Now, your AI agents are not just limited to the **public** internet. They can now also access authenticated, paywalled, or password-protected content that you can already access in a normal browser. Scraping the "private web" often has the most contextually personalized and relevant information for agents. Short of custom solutions and a ton of code, there is no simple way to do this until AnythingLLM Authenticated Web Scraping! Now, the int…
Watch on YouTube ↗ (saves to browser)

Chapters (7)

Introduction of AnythingLLM
0:36 Web Scraping + AI tools as of today
1:50 The big issue with Web Scraping today
2:00 About AnythingLLM Authenticate Web Scraping
3:28 Let's just run an example with my LinkedIn account
7:00 Authenticated Web Scraping works EVERYWHERE!
7:41 Conclusions and the future of AnythingLLM Desktop
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Next Up
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)