Building a Personalized Newsletter with Apache Airflow 3.0 & AWS (Full Tutorial)
Skills:
AI Workflow Automation90%
Learn how to build an automated personalized newsletter system using Apache Airflow 3.0, AWS Bedrock for AI generation, and Amazon SQS for event-driven scheduling. Join Darko and Kenten from Astronomer as they demonstrate how to leverage Airflow's new features including DAG versioning, assets, and backfills.
Explore Open Source @ AWS 👉 https://go.aws/453ciiV
Resources:
Apache Airflow 3 E-book: https://go.aws/45ey8QN
Apache Airflow Documentation: https://go.aws/3IUW4zU
Astronomer Platform: https://go.aws/40StKEj
AWS Bedrock: https://go.aws/4oojf5A
Amazon SQS: https://go.aws/45pXiup
Follow AWS Developers!
📺 Instagram: https://go.aws/45lxLCq...
🆇 X: https://go.aws/4flKw4C
💼 LinkedIn: https://go.aws/3J3d1Z2
👾 Twitch: twitch.tv/aws
Chapters:
00:00 - Introduction
02:24 - What is Apache Airflow?
04:02 - ETL Pipeline Overview
08:55 - Working with Assets in Airflow 3
14:38 - Implementing Gen AI with AWS Bedrock
20:43 - DAG Versioning Feature
24:05 - Event-Driven Scheduling with SQS
27:37 - Backfills in Airflow 3
28:31 - Deploying to Production
30:25 - Use Cases Beyond ETL
#ApacheAirflow #DataEngineering #Python #ETL
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from AWS Developers · AWS Developers · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Using Microsoft Active Directory across On-premises and Cloud Workloads
AWS Developers
What is Cloud Computing with AWS? | Hebrew Webinar
AWS Developers
Best Practices for Getting Started with AWS | Hebrew Webinar
AWS Developers
Best Practices for Using AWS Identity and Access Management (IAM) Roles
AWS Developers
Building Scalable Web Apps | Hebrew Webinar
AWS Developers
Dev & Test on the AWS Cloud | Hebrew Webinar
AWS Developers
Storage & Backup on AWS | Hebrew webinar
AWS Developers
Disaster Recovery on AWS | Hebrew Webinar
AWS Developers
AWS Israel News | Episode 1
AWS Developers
Security Best Practices on AWS | Hebrew Webinar
AWS Developers
Ready: Introduction to AI on AWS | Hebrew Webinar
AWS Developers
Set: What is ML for developers? | Hebrew Webinar
AWS Developers
Go!: Building your own ChatBot with Amazon Lex | Hebrew Webinar
AWS Developers
And Beyond: Amazon Sagemaker | Hebrew Webinar
AWS Developers
Building API-Driven Microservices with Amazon API Gateway - AWS Online Tech Talks
AWS Developers
Understanding AWS Secrets Manager - AWS Online Tech Talks
AWS Developers
Best Practices for Building Enterprise Grade APIs with Amazon API Gateway - AWS Online Tech Talks
AWS Developers
Build, Train and Deploy Machine Learning Models on AWS with Amazon SageMaker - AWS Online Tech Talks
AWS Developers
AWS Israel News | Episode 2 | re:Invent
AWS Developers
AWS Floor28 News - January
AWS Developers
AWS Floor28 News - February - Hebrew
AWS Developers
AWS Floor28 News - March - Hebrew
AWS Developers
AWS Floor28 News - April - Hebrew
AWS Developers
AWS Floor28 News - May - Hebrew
AWS Developers
Authentication for Your Applications: Getting Started with Amazon Cognito - AWS Online Tech Talks
AWS Developers
AWS Floor28 News - June - Hebrew
AWS Developers
AWS Floor28 News - July - Hebrew
AWS Developers
Enriching your app with Image Recognition and AWS AI Services - AWS Webinar - Hebrew
AWS Developers
Personalize, Forcast, and Textract - AWS Webinar - Hebrew
AWS Developers
Managing Your ML Development Lifecycle with Amazon SageMaker - AWS Webinar - Hebrew
AWS Developers
Running your ML code in Amazon Sagemaker - AWS Webinar - Hebrew
AWS Developers
Get Started in Minutes with Amazon Connect in Your Contact Center - AWS Online Tech Talks
AWS Developers
AWS Floor28 News - August - Hebrew
AWS Developers
AWS Floor28 News - September - Hebrew
AWS Developers
Deep Dive on Amazon EventBridge - AWS Online Tech Talks
AWS Developers
Advanced Serverless Orchestration with AWS Step Functions - AWS Online Tech Talks
AWS Developers
Living on the Edge - an Introduction to Amazon CloudFront and Lambda@Edge - Hebrew Webinar
AWS Developers
AWS Floor28 News - October - Hebrew - YouTube
AWS Developers
What's New with AWS Storage - AWS Online Tech Talks
AWS Developers
How to Build a Compelling Migration Business Case Using TSO Logic - AWS Online Tech Talks
AWS Developers
Configuring and Managing Amazon S3 Replication - AWS Online Tech Talks
AWS Developers
AWS Floor28 News - November - Hebrew
AWS Developers
Using Relational Databases with AWS Lambda - Easy Connection Pooling - AWS Online Tech Talks
AWS Developers
AWS Floor28 News - December 2019 - Hebrew
AWS Developers
AWS Floor28 News - January 2020 - Hebrew
AWS Developers
Top 10 Data Migration Best Practices - AWS Online Tech Talks
AWS Developers
How to Use Azure Active Directory with AWS SSO - AWS Online Tech Talks
AWS Developers
AWS Tips & Tricks - Amazon Redshift Advisor - Hebrew
AWS Developers
AWS Tips & Tricks - Amazon Redshift Elastic Resize - Hebrew
AWS Developers
AWS Tips & Tricks - Amazon Redshift Spectrum - Hebrew
AWS Developers
AWS Tips & Tricks - Savings Plans & Cost Explorer - Hebrew
AWS Developers
AWS Tips & Tricks - Amazon Redshift Concurrency Scaling - Hebrew
AWS Developers
AWS Tips & Tricks - Training Models with Amazon SageMaker - Hebrew
AWS Developers
AWS Tips & Tricks - Auto Model Tuning with Amazon SageMaker - Hebrew
AWS Developers
AWS Tips & Tricks - Amazon Comprehend - Hebrew
AWS Developers
Understanding High Availability and Disaster Recovery Features for Amazon RDS for Oracle
AWS Developers
Amazon Forecast – Forecasting - From Months to Days (Hebrew)
AWS Developers
Visualize your data with Amazon QuickSight (Hebrew)
AWS Developers
Amazon Kendra (Hebrew)
AWS Developers
AWS Floor28 News - AI/ML Special Edition
AWS Developers
More on: AI Workflow Automation
View skill →
Related AI Lessons
⚡
⚡
⚡
⚡
I Found $50,400 in Wasted Business Spending Using One AI Prompt (Here’s the Prompt)
Medium · AI
I Found $50,400 in Wasted Business Spending Using One AI Prompt (Here’s the Prompt)
Medium · Startup
From Site Photos to Proposals: How AI Automates Takeoff for Trades
Dev.to AI
This new Claude skill saves you from bad contracts - and costs less than a lawyer
ZDNet
Chapters (10)
Introduction
2:24
What is Apache Airflow?
4:02
ETL Pipeline Overview
8:55
Working with Assets in Airflow 3
14:38
Implementing Gen AI with AWS Bedrock
20:43
DAG Versioning Feature
24:05
Event-Driven Scheduling with SQS
27:37
Backfills in Airflow 3
28:31
Deploying to Production
30:25
Use Cases Beyond ETL
🎓
Tutor Explanation
DeepCamp AI