Databricks Clean Rooms Product Demo

Databricks · Intermediate ·🔄 Data Engineering ·1y ago

Key Takeaways

Databricks Clean Rooms is demonstrated for secure collaboration on a joint fraud detection initiative between two banks, leveraging data from sources like Snowflake for analytics and compliance.

Full Transcript

my name is nille Gad I lead product management for data Andi collaboration at data brecks today I'm excited to walk you through a demo of data R clean rooms as a quick refresher clean rooms enables organizations to securely collaborate with their customers and partners on sensitive data without compromising privacy for this demo imagine that I'm a member of a fraud detection team at a large Bank bank a and we're collaborating with another financial institution Bank B to conduct a joint fraud analysis I as Bank a have data about my customers their transactions history and also a proprietary AI model that have built that analyzes transactions data my collaborator Bank B also has data about transactions merchants and customer risk profiles that they want to use however there are a few challenges we need to overcome first we cannot share sensitive information about our customers or transactions with each other second our data is on different clouds and data platforms but we still want to be able to collaborate without having to replicate or move the data finally we also want to leverage proprietary code and AI models inside of a clean room for analysis we're going to use datab brick clean terms to overcome these challenges and collaborate in a secure privacy safe environment to identify fraudulent activities let's check it out all right I'm going to start off in the workspace of Bank a and in a few steps I will go create a cleaner I'll give this cleaner a name and for my cloud region I'm using it us and US West 2 what's amazing is that it doesn't matter whether my collaborator is on different Cloud regions or data platforms they can still participate in the cleaner I know that my collaborator Bank B is already on data bricks so I will invite them using their clean room sharing identifier lastly I can also choose to restrict all outbound access to the internet and network resources but I'll keep this one simple and proceed with full internet access once the cleaner is set up I can now start to bring in my data assets first I will add my transactions and customers data I can also add unstructured data and AI models so here I'm going to include a private library that calls an AI function to help me with my fraud detection task my clean room is ready for my collaborator to join let's switch gears now I'm Bank B and I can join the clean room that has been created by my banking partner and see all the pre- added data assets and actually when I click into the transactions data table you can notice that I can only see the underlying metadata but not the actual data itself now it's my turn to bring data into the cleaner so as Bank B I'm going to add in my customer risk profiles and all the fraud transactions data which is actually sitting in the snowflake data warehouse I can use lake house Federation to connect to my snake Warehouse without needing to do any ETL or data copy next I choose to add a notebook that I can collaborate with that is mutually agreed between me Bank B and Bank a this notebook essentially will let us analyze both of your data assets and identify fraudulent transactions let's move ahead to bank a once I hit refresh I can see that there is a new notebook that has been added into the cleaner I can inspect the notebook making sure it contains all the code that we mutually agreed on and choose to run it this will then kick off a serverless job and within a few seconds I should be able to see the results of my analyses all right I can see the output generated by The Notebook which even contain some rich visuals that help me understand which transactions I can flag based on things originating country all right let's summarize what we just saw two organizations were able to bring their respective data assets into a secure data RIS clean roomm without needing to expose or reveal the underlying data they were even able to bring their proprietary ml or AI models it didn't really matter if they were on different clouds regions or data platforms they were able to use the power of Delta sharing and lakeh house Federation to share data assets lastly they are able to run mutually approved jobs against their data to detect fraud patterns I hope you enjoyed this demo thank you

Original Description

In our latest demo, we showcase how 2 banks collaborate on a joint fraud detection initiative using Databricks Clean Room to identify suspicious transaction patterns and potential fraudsters. The demo highlights how users can securely bring their data and fraud detection models into a clean room from various sources, including Snowflake. The banks then execute agreed-upon analytics and share approved results—all while ensuring data governance and compliance.
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Databricks · Databricks · 46 of 60

1 Building AI Agent Systems with Databricks
Building AI Agent Systems with Databricks
Databricks
2 Databricks Workflows
Databricks Workflows
Databricks
3 Automate Unity Catalog Upgrade with UCX Part 1: Overview
Automate Unity Catalog Upgrade with UCX Part 1: Overview
Databricks
4 Automate Unity Catalog Upgrade with UCX Part 2: Installation
Automate Unity Catalog Upgrade with UCX Part 2: Installation
Databricks
5 Automate Unity Catalog Upgrade with UCX Part 3 - Assessment
Automate Unity Catalog Upgrade with UCX Part 3 - Assessment
Databricks
6 Automate Unity Catalog Upgrade with UCX  Part 4 - Group Migration
Automate Unity Catalog Upgrade with UCX Part 4 - Group Migration
Databricks
7 Table Migration and Catalog Design with UCX | Part 5
Table Migration and Catalog Design with UCX | Part 5
Databricks
8 Setting Up Azure Access for UCX Table Migration | Part 6
Setting Up Azure Access for UCX Table Migration | Part 6
Databricks
9 UCX Table Migration: Creating Catalogs and Schemas | Part 7
UCX Table Migration: Creating Catalogs and Schemas | Part 7
Databricks
10 Automate Unity Catalog Upgrade with UCX  Part 8: Code Migration
Automate Unity Catalog Upgrade with UCX Part 8: Code Migration
Databricks
11 Streaming to Kafka Just Got Easier with DLT Pipelines
Streaming to Kafka Just Got Easier with DLT Pipelines
Databricks
12 Data Engineering From Data to Dashboards with DABs: Crunching the Cookies Dataset
Data Engineering From Data to Dashboards with DABs: Crunching the Cookies Dataset
Databricks
13 Epsilon helps businesses connect with their consumers using Databricks Data Intelligence Platform
Epsilon helps businesses connect with their consumers using Databricks Data Intelligence Platform
Databricks
14 Unilever transforms operations with GenAI using the Databricks Data Intelligence Platform
Unilever transforms operations with GenAI using the Databricks Data Intelligence Platform
Databricks
15 ActionIQ enables businesses to unlock customer data with the Databricks Data Intelligence Platform
ActionIQ enables businesses to unlock customer data with the Databricks Data Intelligence Platform
Databricks
16 Mixed Attention & LLM Context | Data Brew | Episode 35
Mixed Attention & LLM Context | Data Brew | Episode 35
Databricks
17 Inside Databricks SQL: Engineering innovation with Hans
Inside Databricks SQL: Engineering innovation with Hans
Databricks
18 Inside Databricks: Engineering innovation with Michael Armbrust
Inside Databricks: Engineering innovation with Michael Armbrust
Databricks
19 The Money Team at Databricks: driving revenue and customer growth
The Money Team at Databricks: driving revenue and customer growth
Databricks
20 Unity Catalog unveiled: engineering data governance at scale
Unity Catalog unveiled: engineering data governance at scale
Databricks
21 Create a view in Databricks and share it with Power BI using Delta Sharing
Create a view in Databricks and share it with Power BI using Delta Sharing
Databricks
22 NDUS leverages Databricks Data Intelligence Platform to revolutionize higher education management
NDUS leverages Databricks Data Intelligence Platform to revolutionize higher education management
Databricks
23 EMEA Data + AI World Tour 2024
EMEA Data + AI World Tour 2024
Databricks
24 GenAI: The Shift to Data Intelligence - Customer Panel on Industry Use Cases
GenAI: The Shift to Data Intelligence - Customer Panel on Industry Use Cases
Databricks
25 GenAI: The Shift to Data Intelligence - Ft. Ash Jhaveri, VP of Reality Labs Partnerships at Meta
GenAI: The Shift to Data Intelligence - Ft. Ash Jhaveri, VP of Reality Labs Partnerships at Meta
Databricks
26 Virtue Foundation leverages the Databricks Data Intelligence Platform to advance global health
Virtue Foundation leverages the Databricks Data Intelligence Platform to advance global health
Databricks
27 Announcing Synthetic Data Generation in Mosaic AI Agent Evaluation
Announcing Synthetic Data Generation in Mosaic AI Agent Evaluation
Databricks
28 AI/BI Dashboards Embedding - A tutorial
AI/BI Dashboards Embedding - A tutorial
Databricks
29 Bayer transforms global data management with the Databricks Data Intelligence Platform
Bayer transforms global data management with the Databricks Data Intelligence Platform
Databricks
30 Databricks at AWS re:Invent 2024
Databricks at AWS re:Invent 2024
Databricks
31 Hive Metastore and AWS Glue Federation in Unity Catalog
Hive Metastore and AWS Glue Federation in Unity Catalog
Databricks
32 Data + AI World Tour Paris 2024
Data + AI World Tour Paris 2024
Databricks
33 Retail reimagined: Currys data-first strategy to driving growth and improving operations
Retail reimagined: Currys data-first strategy to driving growth and improving operations
Databricks
34 Mixture of Memory Experts (MoME) | Data Brew | Episode 36
Mixture of Memory Experts (MoME) | Data Brew | Episode 36
Databricks
35 Verana Health Data Curation and Innovation with Databricks and AWS
Verana Health Data Curation and Innovation with Databricks and AWS
Databricks
36 Securing SaaS Applications: Obsidian Security on Their Journey with Databricks and AWS
Securing SaaS Applications: Obsidian Security on Their Journey with Databricks and AWS
Databricks
37 Twilio Eng VP on Data Intelligence & AI at AWS re:Invent 2024
Twilio Eng VP on Data Intelligence & AI at AWS re:Invent 2024
Databricks
38 Chegg Eng SVP on Data-Driven Approach to Student Success with Databricks and AWS
Chegg Eng SVP on Data-Driven Approach to Student Success with Databricks and AWS
Databricks
39 Ibotta Personalized Rewards Innovation with Databricks and AWS
Ibotta Personalized Rewards Innovation with Databricks and AWS
Databricks
40 Simplify AI governance with #databricks AI Gateway
Simplify AI governance with #databricks AI Gateway
Databricks
41 Databricks SQL and Power BI Integration
Databricks SQL and Power BI Integration
Databricks
42 Databricks Serverless SQL Warehouses
Databricks Serverless SQL Warehouses
Databricks
43 7 West powers audience growth with the Databricks Data Intelligence Platform
7 West powers audience growth with the Databricks Data Intelligence Platform
Databricks
44 Secret to Production AI: Tools & Infrastructure | Data Brew | Episode 37
Secret to Production AI: Tools & Infrastructure | Data Brew | Episode 37
Databricks
45 Skyflow CEO on Data Privacy with Databricks at AWS re:Invent
Skyflow CEO on Data Privacy with Databricks at AWS re:Invent
Databricks
▶ Databricks Clean Rooms Product Demo
Databricks Clean Rooms Product Demo
Databricks
47 Dun & Bradstreet Enrichment & Monitoring, powered by Delta Sharing & Databricks Marketplace
Dun & Bradstreet Enrichment & Monitoring, powered by Delta Sharing & Databricks Marketplace
Databricks
48 Unpacking Libraries in Databricks
Unpacking Libraries in Databricks
Databricks
49 Providence uses an AI agent system from Databricks to help doctors improve their communication
Providence uses an AI agent system from Databricks to help doctors improve their communication
Databricks
50 How State Street Uses AI to Transform Millions of Trades Daily
How State Street Uses AI to Transform Millions of Trades Daily
Databricks
51 Vevo Therapeutics CEO on Curing Disease with Data at AWS re:Invent
Vevo Therapeutics CEO on Curing Disease with Data at AWS re:Invent
Databricks
52 Over Architected with Nick & Holly: Databricks updates for Feb 2025
Over Architected with Nick & Holly: Databricks updates for Feb 2025
Databricks
53 The Power of Synthetic Data | Data Brew | Episode 38
The Power of Synthetic Data | Data Brew | Episode 38
Databricks
54 Use Databricks Lakehouse Federation to break down data silos
Use Databricks Lakehouse Federation to break down data silos
Databricks
55 AI's rugby score: National Rugby League rallies fans with analytics and unified data
AI's rugby score: National Rugby League rallies fans with analytics and unified data
Databricks
56 Open Variant Data Type in Delta Lake and Apache Spark
Open Variant Data Type in Delta Lake and Apache Spark
Databricks
57 How would you sort Ætheldred in the alphabet using Databricks?
How would you sort Ætheldred in the alphabet using Databricks?
Databricks
58 A guide on how to operationalize the Databricks AI Security Framework (DASF)
A guide on how to operationalize the Databricks AI Security Framework (DASF)
Databricks
59 Future-Proof Your Asset Performance Management with Generative AI - Field Assistant Live Demo
Future-Proof Your Asset Performance Management with Generative AI - Field Assistant Live Demo
Databricks
60 6 New SQL features in Databricks
6 New SQL features in Databricks
Databricks

This demo showcases how Databricks Clean Rooms enables secure collaboration between two banks on a joint fraud detection initiative, highlighting the importance of data governance and compliance in financial services. By leveraging Databricks Clean Rooms, users can bring their data and fraud detection models into a secure environment for analysis. The demo emphasizes the value of secure data sharing and collaboration in identifying suspicious transaction patterns and potential fraudsters.

Key Takeaways
  1. Bring data into Databricks Clean Rooms from various sources
  2. Execute agreed-upon analytics on shared data
  3. Share approved results while ensuring data governance and compliance
  4. Leverage fraud detection models for identifying suspicious patterns
  5. Collaborate securely with other parties
💡 Databricks Clean Rooms provides a secure environment for collaboration and data sharing, enabling financial institutions to work together on initiatives like fraud detection while maintaining data governance and compliance.

Related Reads

📰
Excavating Legacy ETL: The AI Never Asserts a Fact It Could Look Up
Learn how to excavate legacy ETL using AI, focusing on data extraction and transformation without asserting facts that can be looked up
Dev.to AI
📰
Announcing Orchestra and n8n | The ultimate way to automate workflows
Learn to automate workflows with Orchestra and n8n, a powerful tool for data science and engineering
Medium · Data Science
📰
ELT is moving back to best-of-breed and Orchestration is the missing piece
Learn why ELT is shifting back to best-of-breed and how orchestration is the key missing piece, and why it matters for data engineering efficiency
Medium · Data Science
📰
Azure Data Engineer Course in Telugu: Build a Successful Data Engineering Career
Learn how to build a successful data engineering career with Azure Data Engineer Course in Telugu
Medium · DevOps
Up next
From Cricket Romance To Murder Probe | Mo of Everything
MO
Watch →