Articles

Explore five free hands-on workshops covering data engineering, machine learning, MLOps, LLMs, AI agents, and AI development through practical lessons, homework

Sixty organisations have joined an effort to make semantic models portable between tools. Snowflake started it. Databricks, dbt Labs… Continue reading on Toward

The AI wave has transformed the way how software professionals write code, allowing them to deliver fast with just a few prompts. However… Continue reading on M

There was a time when building a data warehouse meant thinking about servers, storage capacity, database administration, infrastructure… Continue reading on Wri

How a single Python list controls the storage layout of ~180 CDC tables and why the busiest tables get the fewest buckets Continue reading on Medium »

Initially, organizations relied heavily on data warehouses, storing structured data in traditional databases like MySQL and building… Continue reading on Medium

Today’s pipelines send alerts. Tomorrow’s pipelines will investigate, validate, and recover before engineers even wake up. Continue reading on Towards Data Engi

If you’ve spent any time around a data team, you’ve probably heard people throw around words like “data lake,” “warehouse,” “lakehouse,”… Continue reading on Me

Efficiently manage and terminate Spark sessions in PySpark using Apache Iceberg for optimized data workflows and resource utilization Continue reading on Medium

Databricks has been moving data engineering toward a declarative model. Lakeflow Declarative Pipelines is the current framework for… Continue reading on Medium

Why PDFs, images and documents are becoming part of the modern lakehouse — and what this means for AI, RAG and data engineering Continue reading on Medium »

Enterprise AI is moving beyond models. The real competition is about data, context, governance, and task ownership.

Introduction Continue reading on Towards AI »

Databricks was founded in 2013 by the original creators of Apache Spark at UC Berkeley’s AMPLab. The founders open-sourced Spark and then… Continue reading on M

Databricks was founded in 2013 by the original creators of Apache Spark at UC Berkeley’s AMPLab. The founders open-sourced Spark and then… Continue reading on M

Databricks was founded in 2013 by the original creators of Apache Spark at UC Berkeley’s AMPLab. The founders open-sourced Spark and then… Continue reading on M

Atlan MCP transforms metadata into real-time control for Snowflake, Databricks, and AI agents Continue reading on Medium »

llm evaluation for data pipelines is the load-bearing correctness discipline of the 2026 data stack — the difference between a RAG chatbot… Continue reading on

Subtitle: From “hope and pray” to “validate early, validate often” — how to catch bad data before it reaches your CEO’s dashboard. Continue reading on Medium »

The Agentic Data Operations Platform (ADOP) is a reference architecture on Amazon Bedrock that uses specialized AI agents to automate the full Bronze-to-Silver-

Healthcare data platforms are evolving beyond ETL, using AI for anomaly detection, entity matching, forecasting, compliance, and data quality.

Migrating ~1000 stored procedures and ~100 SSIS jobs to dbt with Claude Code: equivalence testing, decomposition, context engineering. Continue reading on Mediu

Most production data pipelines do not fail because their underlying mathematical algorithms are flawed they implode because human domain… Continue reading on IL

Data Engineering, Lakehouse, Medallion, Streaming, Data Mesh, Data Vault & Modern Platform Architecture Continue reading on Medium »