📰 Medium · DevOps

If you work in Data Engineering then your codebase is likely a chaotic cocktail of Python (for Airflow, Prefect or PySpark), massive… Continue reading on Medium

Just like on a rink, two developers enter the shared BI app to compete for the same measure. Only one will survive. By morning there’s a… Continue reading on Me

Welcome to the Spark 4 Freak Show — the only carnival where defaults bite, configs whisper from the walls, and the architecture finally… Continue reading on Tow

3–5 sets (or more) of SQL alert queries are needed to write for each Databricks table we are managing, and we have 1000+ tables in our… Continue reading on Medi

Built for Lakerunner, the lakehouse engine behind Cardinal⁠. Measured against Parquet + DuckDB and Vortex on 1.46M real log rows. Continue reading on Medium »

If someone had told me a few years ago that I’d be learning Python, analyzing datasets, and interviewing for Business Intelligence Analyst… Continue reading on

A green job status is not the same as fresh output. In data-heavy systems, old records can hide a broken step. Continue reading on Medium »

Modern bir veri platformu geliştirmek; orkestrasyon, dağıtık işleme, depolama ve veri ambarı katmanlarının birbiriyle pürüzsüz bir şekilde… Continue reading on

Most performance issues aren’t caused by a lack of hardware, but by a lack of respect for how the query optimizer actually thinks. Continue reading on T3CH »

Every data scientist on their own laptop is chaos. Centralize it on Kubernetes — without learning Helm yourself. Continue reading on Medium »

Modern analytics workloads demand fast, distributed query processing across massive datasets. Traditional databases often struggle with… Continue reading on Med

A Python project that parses YouTube watch history from Google Takeout, enriches it with metadata, and turns it into a local analytics… Continue reading on Medi

From LinkedIn’s internal tool to the de facto standard for event streaming, how Kafka changed the way we think about data in motion. Continue reading on Towards

Most engineers look at averages. The ones who understand histograms look at shapes. Continue reading on Observability is Engineering »

Sebagai praktisi yang berkutat dengan data di lingkungan produksi, kita semua tahu betapa krusialnya menjaga integritas, auditabilitas… Continue reading on Medi

At T-Mobile, we started noticing a pattern that will probably feel very familiar if you’ve spent any time on an analytics team. Continue reading on Medium »