Data Storage and Management for Big Data

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

Data Storage and Management for Big Data

Coursera · Beginner ·🔄 Data Engineering ·3mo ago

Key Takeaways

Provides an overview of data storage and management for big data

Original Description

This course provides a comprehensive overview of data storage and management approaches for big data. Learners will explore structured, semi-structured, and unstructured data formats, compare SQL and NoSQL database technologies, and implement data lakes and data warehouses. The course includes working with various file formats and understanding the differences between batch and real-time processing approaches. Course Learning Objectives: By the end of this course, you will be able to: - Compare and implement SQL and NoSQL database solutions for different big data scenarios - Work effectively with structured, semi-structured, and unstructured data formats - Design and implement data lakes and data warehouses for big data workloads - Build data pipelines using ETL and ELT approaches with Azure Data Factory - Differentiate between batch and real-time processing methodologies and implement appropriate solutions
Watch on External: Coursera ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
How Airflow is using AI to make data engineering more resilient, not more complex
Airflow uses AI to make data engineering more resilient by detecting data drift, resuming failed pipelines, and fixing issues automatically, reducing complexity and improving reliability.
Medium · AI
📰
What Can We Do When Memory Becomes the New Bottleneck in Data Engineering?
Learn how to overcome memory bottlenecks in data engineering using Pandas chunking, Dask, and Polars, and why it matters for processing large datasets
Towards Data Science
📰
Migrate from Ponder to Envio HyperIndex
Learn to migrate your indexer from Ponder to Envio HyperIndex to scale your data management
Dev.to · Envio
📰
Data Backfilling with Apache Airflow: Architectures and Implementations for Historical Data Processing
Learn how to implement data backfilling with Apache Airflow for historical data processing and improve your data pipeline's accuracy and reliability
Dev.to · Wangila russell
Up next
A Moment Frozen in Time | Arnav Iyengar | TEDxJenks Youth
TEDx Talks
Watch →