Snowflake - Build and Architect Data Pipelines Using AWS

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

Snowflake - Build and Architect Data Pipelines Using AWS

Coursera · Advanced ·🔄 Data Engineering ·3mo ago

Key Takeaways

Architects data pipelines using Snowflake and Amazon Web Services

Original Description

This course features Coursera Coach! A smarter way to learn with interactive, real-time conversations that help you test your knowledge, challenge assumptions, and deepen your understanding as you progress through the course. Learn how to design and build robust data pipelines using Snowflake and AWS in this comprehensive course. You will explore Snowflake's architecture, including its virtual warehouses, billing components, and object hierarchy, to fully understand how to leverage this powerful platform. In addition to that, you'll dive into key areas like data ingestion, partitioning, clustering, and performance optimization techniques, while getting hands-on experience with labs to reinforce your learning. By the end of the course, you will be able to create optimized, cost-effective data pipelines that integrate seamlessly with AWS services like S3, Lambda, and Glue. The journey includes building tasks and queries, utilizing streams for real-time data tracking, and understanding how to set up user-defined and external functions. As you progress, you will also explore advanced concepts such as Snowpark for Data Science, streaming with Kafka, and data governance techniques to ensure your data pipeline meets security and compliance standards. This course is designed for those seeking hands-on expertise in building scalable data pipelines using Snowflake and AWS. Whether you're an aspiring data engineer or an experienced professional looking to sharpen your skills, this course will provide you with the tools and knowledge to implement real-world data engineering solutions effectively.
Watch on External: Coursera ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
I Built My Second ETL Pipeline. This Time, I Started Thinking Like a Data Engineer
Learn how to build a production-ready ETL pipeline with Python, Docker, PostgreSQL, and Kestra by thinking like a data engineer
Towards Data Science
📰
JuiceFS Sync for PB-Scale Data Transfers: Resumable Sync, Encryption, and Bandwidth Control
Learn how to efficiently transfer large volumes of data using JuiceFS Sync, which offers resumable sync, encryption, and bandwidth control, ideal for PB-scale data transfers.
Dev.to AI
📰
How Airflow is using AI to make data engineering more resilient, not more complex
Airflow uses AI to make data engineering more resilient by detecting data drift, resuming failed pipelines, and fixing issues automatically, reducing complexity and improving reliability.
Medium · AI
📰
What Can We Do When Memory Becomes the New Bottleneck in Data Engineering?
Learn how to overcome memory bottlenecks in data engineering using Pandas chunking, Dask, and Polars, and why it matters for processing large datasets
Towards Data Science
Up next
A Moment Frozen in Time | Arnav Iyengar | TEDxJenks Youth
TEDx Talks
Watch →