LangSmith Highlights: Getting Started

LangChain · Beginner ·🤖 AI Agents & Automation ·2y ago

Key Takeaways

Provides a beginner's guide to getting started with LangSmith, including sign-up, organization creation, and sending traces to LangSmith

Full Transcript

in this video we're going to show you how you can easily send your linkchain API traces to link Smith or SAS platform so you can use those traces to debug to test and evaluate them to also monitor any production application and in this video we'll specifically tailor it to linkchain code but it's also possible to send your traces if you're building another llm powered application outside of the linkchain framework and we'll show that in a separate video but if you are using linkchain it's really simple to get up and running you can do it in a matter of seconds all you have to do is set a few environment variables the first is link chain tracing to true you want to give your application a project name in this case I'm calling it planetary walkthrough demo if you don't give it a name it will just set to default and all of the runs for this application will get collected and aggregated together in this planetary walkthrough demo project which I'll show in a second you want to give a destination in this case we're sending all of our traces to our Cloud hosted platform at api. smith. link chain.com and then finally you want to give it your linkchain API key this is really the API key that you create in your link Smith account and it's tied to your tenant uh and I'll be sure to delete this API key after the demo to make sure that there's not any Miss use of of my token but that's all you have to do to get up and running and I'll walk through this code pretty quickly but just a reminder the way it works is Lang Smith is not hosting my application in this scenario the code is actually running on my computer but it's collecting all of my traces because when we install the link Smith SDK there's a callback function to that API destination that I've Set uh up top along with my authentication which is my API key and then all of my traces will get sent to L Smith which is hosted in the cloud we have options if you want to self-host link Smith as well but the code is actually going to run on my computer and the traces are getting stored in link Smith think about it as an aggregator of traces just like an observability tool so if I take a quick look at this code we're not going to go too deep into it but uh I'm running an agent uh using bling chain expression language it has access to a couple of tools a Search tool and an llm math tool calculator tool it's going to use open AI functions as the underlying LM uh we've given it a prompt that we've pulled in from our Hub in link Smith uh this this prompt is is a pretty simple one it just says that you are a smart AI uh assistant which I can show in a separate video um how to define prompts and how to pull it into your code so just take a mental note of that uh and then it's going going to use a scratch pad to keep track of its thoughts as well as a chat history uh and then we're going to run this agent against these questions these put that I've seated it and we're going to see what that looks like in lsmith so we'll run it now and then if I go to lsmith this is uh in my projects this is the planetary walkthrough demo and we can now see that there are a number of runs uh happening right now they're in action which is this uh purple running symbol and a few have already completed these are running in parallel so you don't have to serly have the agent answer these questions and we're going to show exactly what are the outputs of these traces in a in the next video

Original Description

See how to: -Sign up for LangSmith -Create an org and invite your colleagues -Send traces to LangSmith 01:50 How LangSmith uses your data 01:59 Testing something else Log in or sign up for LangSmith (BETA): https://smith.langchain.com/ LangSmith Docs: https://python.langchain.com/docs/guides/langsmith/walkthrough
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from LangChain · LangChain · 26 of 60

1 Chat With Your Documents Using LangChain + JavaScript
Chat With Your Documents Using LangChain + JavaScript
LangChain
2 LangChain SQL Webinar
LangChain SQL Webinar
LangChain
3 LangChain "OpenAI functions" Webinar
LangChain "OpenAI functions" Webinar
LangChain
4 LangSmith Launch
LangSmith Launch
LangChain
5 LangChain x Pinecone: Supercharging Llama-2 with RAG
LangChain x Pinecone: Supercharging Llama-2 with RAG
LangChain
6 LangChain Expression Language
LangChain Expression Language
LangChain
7 Building LLM applications with LangChain with Lance
Building LLM applications with LangChain with Lance
LangChain
8 Benchmarking Question/Answering Over CSV Data
Benchmarking Question/Answering Over CSV Data
LangChain
9 LangChain "RAG Evaluation" Webinar
LangChain "RAG Evaluation" Webinar
LangChain
10 Fine-tuning in Your Voice Webinar
Fine-tuning in Your Voice Webinar
LangChain
11 Tabular Data Retrieval
Tabular Data Retrieval
LangChain
12 Building an LLM Application with Audio by AssemblyAI
Building an LLM Application with Audio by AssemblyAI
LangChain
13 Superagent Deepdive Webinar
Superagent Deepdive Webinar
LangChain
14 Lessons from Deploying LLMs with LangSmith
Lessons from Deploying LLMs with LangSmith
LangChain
15 Shortwave Assistant Deepdive Webinar
Shortwave Assistant Deepdive Webinar
LangChain
16 Cognitive Architectures for Language Agents
Cognitive Architectures for Language Agents
LangChain
17 Effectively Building with LLMs in the Browser with Jacob
Effectively Building with LLMs in the Browser with Jacob
LangChain
18 Data Privacy for LLMs
Data Privacy for LLMs
LangChain
19 "Theory of Mind" Webinar with Plastic Labs
"Theory of Mind" Webinar with Plastic Labs
LangChain
20 LangChain Templates
LangChain Templates
LangChain
21 Using Natural Language to Query Postgres with Jacob
Using Natural Language to Query Postgres with Jacob
LangChain
22 Building a Research Assistant from Scratch
Building a Research Assistant from Scratch
LangChain
23 Benchmarking RAG over LangChain Docs
Benchmarking RAG over LangChain Docs
LangChain
24 Skeleton-of-Thought: Building a New Template from Scratch
Skeleton-of-Thought: Building a New Template from Scratch
LangChain
25 Benchmarking Methods for Semi-Structured RAG
Benchmarking Methods for Semi-Structured RAG
LangChain
LangSmith Highlights: Getting Started
LangSmith Highlights: Getting Started
LangChain
27 LangSmith Highlights: Debugging
LangSmith Highlights: Debugging
LangChain
28 LangSmith Highlights: Datasets
LangSmith Highlights: Datasets
LangChain
29 LangSmith Highlights: Evaluation
LangSmith Highlights: Evaluation
LangChain
30 LangSmith Highlights: Human Annotation
LangSmith Highlights: Human Annotation
LangChain
31 LangSmith Highlights: Monitoring
LangSmith Highlights: Monitoring
LangChain
32 LangSmith Highlights: Hub
LangSmith Highlights: Hub
LangChain
33 SQL Research Assistant
SQL Research Assistant
LangChain
34 Getting Started with Multi-Modal LLMs
Getting Started with Multi-Modal LLMs
LangChain
35 Build a Full Stack RAG App With TypeScript
Build a Full Stack RAG App With TypeScript
LangChain
36 Auto-Prompt Builder (with Hosted LangServe)
Auto-Prompt Builder (with Hosted LangServe)
LangChain
37 LangChain v0.1.0 Launch: Introduction
LangChain v0.1.0 Launch: Introduction
LangChain
38 LangChain v0.1.0 Launch: Observability
LangChain v0.1.0 Launch: Observability
LangChain
39 LangChain v0.1.0 Launch: Integrations
LangChain v0.1.0 Launch: Integrations
LangChain
40 LangChain v0.1.0 Launch: Composability
LangChain v0.1.0 Launch: Composability
LangChain
41 LangChain v0.1.0 Launch: Streaming
LangChain v0.1.0 Launch: Streaming
LangChain
42 LangChain v0.1.0 Launch: Output Parsing
LangChain v0.1.0 Launch: Output Parsing
LangChain
43 LangChain v0.1.0 Launch: Retrieval
LangChain v0.1.0 Launch: Retrieval
LangChain
44 LangChain v0.1.0 Launch: Agents
LangChain v0.1.0 Launch: Agents
LangChain
45 Build and Deploy a RAG app with Pinecone Serverless
Build and Deploy a RAG app with Pinecone Serverless
LangChain
46 Hosted LangServe + LangChain Templates
Hosted LangServe + LangChain Templates
LangChain
47 LangGraph: Intro
LangGraph: Intro
LangChain
48 LangGraph: Agent Executor
LangGraph: Agent Executor
LangChain
49 LangGraph: Chat Agent Executor
LangGraph: Chat Agent Executor
LangChain
50 LangGraph: Human-in-the-Loop
LangGraph: Human-in-the-Loop
LangChain
51 LangGraph: Dynamically Returning a Tool Output Directly
LangGraph: Dynamically Returning a Tool Output Directly
LangChain
52 LangGraph: Respond in a Specific Format
LangGraph: Respond in a Specific Format
LangChain
53 LangGraph: Managing Agent Steps
LangGraph: Managing Agent Steps
LangChain
54 LangGraph: Force-Calling a Tool
LangGraph: Force-Calling a Tool
LangChain
55 LangGraph: Multi-Agent Workflows
LangGraph: Multi-Agent Workflows
LangChain
56 Streaming Events: Introducing a new `stream_events` method
Streaming Events: Introducing a new `stream_events` method
LangChain
57 Building a web RAG chatbot: using LangChain, Exa (prev. Metaphor), LangSmith, and Hosted Langserve
Building a web RAG chatbot: using LangChain, Exa (prev. Metaphor), LangSmith, and Hosted Langserve
LangChain
58 OpenGPTs
OpenGPTs
LangChain
59 Open Source RAG with Nomic's New Embedding Model (and ChromaDB and Ollama)
Open Source RAG with Nomic's New Embedding Model (and ChromaDB and Ollama)
LangChain
60 LangGraph: Persistence
LangGraph: Persistence
LangChain

Related Reads

📰
My AI agent audited 25 projects by reading four linaies of each README. Every kill verdict was wrong.
Learn how an AI agent incorrectly audited 25 projects by reading only four lines of each README, and what this means for AI limitations and potential biases
Dev.to AI
📰
Stop AI Agent Drift Across Sessions With Versioned, Grep-able Rules
Learn to prevent AI agent drift across sessions using versioned, grep-able rules to ensure consistent answers
Dev.to AI
📰
Article: Comprehension at AI Speed: Building a Context Store for Evolutionary Architecture
Learn to build a Context Store for evolutionary architecture to prevent system instability and ensure systemic comprehension in AI development
InfoQ AI/ML
📰
Claude Code faked its own work, then wrote me an unprompted confession
An AI model, Claude Code, generated fake work and then wrote an unprompted confession, raising questions about AI accountability and transparency
Dev.to AI
Up next
I built a custom Hermes plugin. #HermesAgent #Claudecode #openaicodex #openclaw #nousresearch
Tech Friend AJ
Watch →