Invoice Reconciler - Built with LlamaCloud

LlamaIndex · Intermediate ·🧠 Large Language Models ·5mo ago

Key Takeaways

The video demonstrates the Invoice Reconciler app built with LlamaCloud, showcasing its ability to upload contracts and invoices, convert them into LLM-readable Markdown using LlamaParse, and index them in LlamaCloud for searching and reconciliation. The app defines reconciliation rules and uses a Llama agent workflow to analyze invoices and contracts, providing results and confidence scores.

Full Transcript

In this video, let's take a look at one of our demo applications, the invoice reconciler. And all of this is really about having a AI agent that is able to look at your contracts, look at your invoices, [clears throat] and try to reconcile them, deciding whether the invoice matches the contract agreement you have, whether there's anything that should be corrected, whether there's anything wrong given the agreement you made. So this application, as you can see, we have a dashboard, but really the most important three sections here are the contracts, [music] invoices, and reconcile. Let's take a look at contracts. As you can see here, we have a bunch of contracts. And what's happening in the background is every time you upload a new contract or an invoice for that matter, it gets [music] uploaded to your index in Lancloud. So we can have a look here for this application. We have two indexes contracts and invoices and we have six contracts in place and we have seven invoices. Similarly, we also index a bunch of invoices. And one thing that you can start by doing is both for contracts and invoices, you can use this search bar as sort of like a chaff application with your invoices. For example, what have we bought? And this will act like a simple rag application looking at all of the invoices we have and it will site the sources and give me a summary of what I have bought. And similarly you can do the same thing with contracts. You can for example ask what kind of contra contracts do we have in place. Let's start by playing around with this. And let's see here if we have a look we have seven invoices. And maybe we can start by adding yet another invoice. And the first thing you'll see happening is that the application will say that it the invoice is being processed. What's happening here is that we're actually sending the PDF to Llama Pause. And Llama Pass is making sure that it's converting the contents of the invoice into an LLM readable format such as markdown. Once that's complete, we can have a look at the contents of the invoice now in Markdown. And I can say save and sync one file. And you can see that that's getting indexed in llama cloud in our invoices index currently. And also in the application you can see that the indexing is in progress for this particular invoice. While that's still getting indexed, the next thing we can look at is the reconciliation. So we have two important sections here. one for reconciliation and the other for you to actually define the rules for that reconciliation. For example, here we've defined a set of rules about what an invoice should contain or what should be looked out for in both contracts and invoices to make sure that the invoices don't have anything missing etc. So here we've defined rules such as correct math, unit price match, line item match and so on. You can also additionally add your own rules here. You can also describe what those rules mean so that the AI agent understands what it should be looking for. All of this is combined in a llama agent workflow so that the workflow is both aware of the contracts, the invoices, the rules in place, and it also comes with a prompt explaining what the agent should be looking out for and how it should be doing the reconciliation. In the reconcile tab, we have a few more things that we can do for invoices that we've uploaded. You can either view the results of the reconciliation or for anything that has not been reconciled yet, you can go ahead and hit reconcile. So for example, we have one here that is still pending from before and we can hit reconcile and the agent will start analyzing based on these rules. So you can see that this particular invoice was rejected. If we expand this, we can see the reason why it's rejected. It says the invoice violates three business rules. The invoice clearly identifies a recognized supplier and has an invoice date that fits within the contract period but is missing vendor address information. Prevents an exact this prevents an exact match and so on and so on. If you want to see more details as to which rules were rejected and why, you can scroll down and have a look at them as well as seeing which rules have passed and with what confidence. Once you're happy with this, if you agree, you can save the result and it will get saved to the overall reconciliations dashboard. Other than this, you can also see all of the previous reconciliations. You can have a look at the invoices and also view the results of the reconciliation. So here we can see that this particular invoice was approved and [music] as well as the approval you can see the confidence score of that approval. Similarly this is the one that we just ran and we can have a look at the result and you can see that it was rejected again [music] the reasons why it was rejected and that's it. You can go ahead and upload your contracts and invoices. This application will create the indexes for you. pause all of your invoices and contracts as well as running a Llama agent workflow that handles all of the reconciliation as well as the rules that you set for that reconciliation.

Original Description

In this video, Tuana Celik walks through our invoice reconciler app, built with LlamaCloud: 1. Upload your contracts and invoices → LlamaParse converts them into clean, LLM-readable Markdown 2. Everything gets indexed in LlamaCloud — searchable and ready for RAG 3. Define your reconciliation rules (unit price match, correct math, line item match, etc.) 4. A LlamaAgent workflow analyzes each invoice against your contracts and rules — then approves or rejects with confidence scores and detailed reasoning
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from LlamaIndex · LlamaIndex · 0 of 60

← Previous Next →
1 LlamaIndex Virtual Meetup (May 4th, 2023)
LlamaIndex Virtual Meetup (May 4th, 2023)
LlamaIndex
2 LlamaIndex + MongoDB Workshop/Fireside Chat
LlamaIndex + MongoDB Workshop/Fireside Chat
LlamaIndex
3 Discover LlamaIndex: Ask Complex Queries over Multiple Documents
Discover LlamaIndex: Ask Complex Queries over Multiple Documents
LlamaIndex
4 Discover LlamaIndex: Document Management
Discover LlamaIndex: Document Management
LlamaIndex
5 Discover LlamaIndex: Joint Text to SQL and Semantic Search
Discover LlamaIndex: Joint Text to SQL and Semantic Search
LlamaIndex
6 Discover LlamaIndex: JSON Query Engine
Discover LlamaIndex: JSON Query Engine
LlamaIndex
7 LlamaIndex Webinar: Active Retrieval Augmented Generation
LlamaIndex Webinar: Active Retrieval Augmented Generation
LlamaIndex
8 LlamaIndex Webinar: Demonstrate-Search-Predict (DSP) with Omar Khattab
LlamaIndex Webinar: Demonstrate-Search-Predict (DSP) with Omar Khattab
LlamaIndex
9 LlamaIndex Sessions: Practical challenges of building a Legal Chatbot over your PDFs
LlamaIndex Sessions: Practical challenges of building a Legal Chatbot over your PDFs
LlamaIndex
10 LlamaIndex Webinar: Graph Databases, Knowledge Graphs, and RAG with Wey (NebulaGraph)
LlamaIndex Webinar: Graph Databases, Knowledge Graphs, and RAG with Wey (NebulaGraph)
LlamaIndex
11 LlamaIndex Webinar: Community Project Showcase (07/07/2023)
LlamaIndex Webinar: Community Project Showcase (07/07/2023)
LlamaIndex
12 LlamaIndex Webinar: LLMs for Investment Research (with Didier Lopes, co-founder/CEO at OpenBB)
LlamaIndex Webinar: LLMs for Investment Research (with Didier Lopes, co-founder/CEO at OpenBB)
LlamaIndex
13 Discover LlamaIndex: Bottoms-Up Development With LLMs (Part 1, LLMs and Prompts)
Discover LlamaIndex: Bottoms-Up Development With LLMs (Part 1, LLMs and Prompts)
LlamaIndex
14 Discover LlamaIndex: Bottoms-Up Development With LLMs (Part 2, Documents and Metadata)
Discover LlamaIndex: Bottoms-Up Development With LLMs (Part 2, Documents and Metadata)
LlamaIndex
15 Discover LlamaIndex: Key Components to build QA Systems
Discover LlamaIndex: Key Components to build QA Systems
LlamaIndex
16 Discover LlamaIndex: Bottoms-Up Development with LLMs (Part 3, Evaluation)
Discover LlamaIndex: Bottoms-Up Development with LLMs (Part 3, Evaluation)
LlamaIndex
17 LlamaIndex Webinar: From Prompt to Schema Engineering with Pydantic  (with @jxnlco)
LlamaIndex Webinar: From Prompt to Schema Engineering with Pydantic (with @jxnlco)
LlamaIndex
18 Discover LlamaIndex: Bottoms-Up Development with LLMs (Part 4, Embeddings)
Discover LlamaIndex: Bottoms-Up Development with LLMs (Part 4, Embeddings)
LlamaIndex
19 Discover LlamaIndex: Custom Retrievers + Hybrid Search
Discover LlamaIndex: Custom Retrievers + Hybrid Search
LlamaIndex
20 LlamaIndex Webinar: Document Metadata and Local Models for Better, Faster Retrieval
LlamaIndex Webinar: Document Metadata and Local Models for Better, Faster Retrieval
LlamaIndex
21 LlamaIndex Webinar: Build Personalized AI Characters with RealChar
LlamaIndex Webinar: Build Personalized AI Characters with RealChar
LlamaIndex
22 LlamaIndex Webinar: Make RAG Production-Ready
LlamaIndex Webinar: Make RAG Production-Ready
LlamaIndex
23 LlamaIndex Workshop: Building RAG with Knowledge Graphs
LlamaIndex Workshop: Building RAG with Knowledge Graphs
LlamaIndex
24 Discover LlamaIndex: Introduction to Data Agents for Developers
Discover LlamaIndex: Introduction to Data Agents for Developers
LlamaIndex
25 LlamaIndex Webinar: Finetuning + RAG
LlamaIndex Webinar: Finetuning + RAG
LlamaIndex
26 Discover LlamaIndex: SEC Insights, End-to-End Guide
Discover LlamaIndex: SEC Insights, End-to-End Guide
LlamaIndex
27 Discover LlamaIndex: Custom Tools for Data Agents
Discover LlamaIndex: Custom Tools for Data Agents
LlamaIndex
28 LlamaIndex Sessions: Building a Lending Criteria Chatbot in Production
LlamaIndex Sessions: Building a Lending Criteria Chatbot in Production
LlamaIndex
29 Discover LlamaIndex: Bottoms-Up Development with LLMs (Part 5, Retrievers + Node Postprocessors)
Discover LlamaIndex: Bottoms-Up Development with LLMs (Part 5, Retrievers + Node Postprocessors)
LlamaIndex
30 LlamaIndex Webinar: How to Win a LLM Hackathon
LlamaIndex Webinar: How to Win a LLM Hackathon
LlamaIndex
31 LlamaIndex Webinar: LLM Challenges in Production (w/ Mayo Oshin, AI Jason, Dylan from Starmorph)
LlamaIndex Webinar: LLM Challenges in Production (w/ Mayo Oshin, AI Jason, Dylan from Starmorph)
LlamaIndex
32 LlamaIndex Webinar: Agents Showcase!
LlamaIndex Webinar: Agents Showcase!
LlamaIndex
33 LlamaIndex Webinar: Learn about DSPy
LlamaIndex Webinar: Learn about DSPy
LlamaIndex
34 LlamaIndex Webinar: Time-based retrieval for RAG (with Timescale)
LlamaIndex Webinar: Time-based retrieval for RAG (with Timescale)
LlamaIndex
35 LlamaIndex Webinar: Build/Break/Test LLM Apps Showcase (co-hosted with TrueEra, Pinecone)
LlamaIndex Webinar: Build/Break/Test LLM Apps Showcase (co-hosted with TrueEra, Pinecone)
LlamaIndex
36 LlamaIndex Workshop: Evaluation-Driven Development (EDD)
LlamaIndex Workshop: Evaluation-Driven Development (EDD)
LlamaIndex
37 LlamaIndex Webinar: Building LLM Apps for Production, Part 1 (co-hosted with Anyscale)
LlamaIndex Webinar: Building LLM Apps for Production, Part 1 (co-hosted with Anyscale)
LlamaIndex
38 LlamaIndex Webinar: Learn about Fine-tuning + RAG (w/ Victoria Lin, author of RA-DIT)
LlamaIndex Webinar: Learn about Fine-tuning + RAG (w/ Victoria Lin, author of RA-DIT)
LlamaIndex
39 LlamaIndex Webinar: What's next for AI after OpenAI Dev Day?
LlamaIndex Webinar: What's next for AI after OpenAI Dev Day?
LlamaIndex
40 Introducing create-llama
Introducing create-llama
LlamaIndex
41 LlamaIndex Webinar: PrivateGPT - Production RAG with Local Models
LlamaIndex Webinar: PrivateGPT - Production RAG with Local Models
LlamaIndex
42 Multi-modal Retrieval Augmented Generation with LlamaIndex
Multi-modal Retrieval Augmented Generation with LlamaIndex
LlamaIndex
43 LlamaIndex Webinar: LLaVa Deep Dive
LlamaIndex Webinar: LLaVa Deep Dive
LlamaIndex
44 A deep dive into Retrieval-Augmented Generation with Llamaindex
A deep dive into Retrieval-Augmented Generation with Llamaindex
LlamaIndex
45 LlamaIndex Workshop: Multimodal + Advanced RAG Workhop with Gemini
LlamaIndex Workshop: Multimodal + Advanced RAG Workhop with Gemini
LlamaIndex
46 LlamaIndex Webinar: Efficient Parallel Function Calling Agents with LLMCompiler
LlamaIndex Webinar: Efficient Parallel Function Calling Agents with LLMCompiler
LlamaIndex
47 Introduction to Query Pipelines (Building Advanced RAG, Part 1)
Introduction to Query Pipelines (Building Advanced RAG, Part 1)
LlamaIndex
48 LLMs for Advanced Question-Answering over Tabular/CSV/SQL Data (Building Advanced RAG, Part 2)
LLMs for Advanced Question-Answering over Tabular/CSV/SQL Data (Building Advanced RAG, Part 2)
LlamaIndex
49 LlamaIndex Webinar: Advanced Tabular Data Understanding with LLMs
LlamaIndex Webinar: Advanced Tabular Data Understanding with LLMs
LlamaIndex
50 Ollama X LlamaIndex Multi-Modal
Ollama X LlamaIndex Multi-Modal
LlamaIndex
51 Build Agents from Scratch (Building Advanced RAG, Part 3)
Build Agents from Scratch (Building Advanced RAG, Part 3)
LlamaIndex
52 LlamaIndex Webinar: Build No-Code RAG with Flowise
LlamaIndex Webinar: Build No-Code RAG with Flowise
LlamaIndex
53 LlamaIndex Sessions: Practical Tips and Tricks for Productionizing RAG (feat. Sisil @ Jasper)
LlamaIndex Sessions: Practical Tips and Tricks for Productionizing RAG (feat. Sisil @ Jasper)
LlamaIndex
54 Introduction to LlamaIndex v0.10
Introduction to LlamaIndex v0.10
LlamaIndex
55 Build SELF-DISCOVER from Scratch with LlamaIndex
Build SELF-DISCOVER from Scratch with LlamaIndex
LlamaIndex
56 Introducing LlamaCloud (and LlamaParse)
Introducing LlamaCloud (and LlamaParse)
LlamaIndex
57 LlamaIndex Sessions: 12 RAG Pain Points and Solutions
LlamaIndex Sessions: 12 RAG Pain Points and Solutions
LlamaIndex
58 LlamaIndex Webinar: RAG Beyond Basic Chatbots
LlamaIndex Webinar: RAG Beyond Basic Chatbots
LlamaIndex
59 A Comprehensive Cookbook for Claude 3
A Comprehensive Cookbook for Claude 3
LlamaIndex
60 LlamaIndex Webinar: RAPTOR - Tree-Structured Indexing and Retrieval
LlamaIndex Webinar: RAPTOR - Tree-Structured Indexing and Retrieval
LlamaIndex

The Invoice Reconciler app uses LlamaCloud and LlamaParse to analyze contracts and invoices, providing a searchable index and reconciliation results. The app defines rules for reconciliation and uses a Llama agent workflow to analyze documents.

Key Takeaways
  1. Upload contracts and invoices to the app
  2. Convert documents to LLM-readable Markdown using LlamaParse
  3. Index documents in LlamaCloud for searching
  4. Define reconciliation rules for the Llama agent workflow
  5. Run the Llama agent workflow to analyze invoices and contracts
  6. View reconciliation results and confidence scores
💡 The app's ability to define reconciliation rules and use a Llama agent workflow allows for customizable and accurate analysis of contracts and invoices.

Related Reads

📰
Building Production-Grade LLM Evaluation Pipelines: From Vibes to Metrics
Learn to build production-grade LLM evaluation pipelines to catch hallucinations before deployment and improve model reliability
Dev.to AI
📰
Why Every AI Engineer Should Learn Hugging Face
Learn how Hugging Face simplifies AI development and why it's a crucial tool for AI engineers to master
Medium · Machine Learning
📰
A bug in Qwen3-TTS taught me voice is biometric
A developer's experience with a bug in a voice cloning model highlights the biometric nature of voice, emphasizing security and privacy concerns
Dev.to · Daniel Nwaneri
📰
What is LoRA and how it lets anyone fine-tune a massive AI model on a single GPU
Learn about LoRA, a technique that enables fine-tuning of massive AI models on a single GPU, making it accessible to individuals and small teams
Medium · LLM
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →