Scaling Data Pipelines with Terraform

Matillion · Beginner ·☁️ DevOps & Cloud ·2mo ago

About this lesson

Learn how to use the Streaming Terraform provider to manage data pipelines at scale. This tutorial covers how to automate the lifecycle of pipelines and runners, including SQL Server, Postgres, and Snowflake integrations, moving beyond manual UI configuration to efficient Infrastructure as Code.

Original Description

Learn how to use the Streaming Terraform provider to manage data pipelines at scale. This tutorial covers how to automate the lifecycle of pipelines and runners, including SQL Server, Postgres, and Snowflake integrations, moving beyond manual UI configuration to efficient Infrastructure as Code.

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

nvprobe Zero-Setup GPU Benchmarking: How I Automated HPL, MLPerf, and CUDA Audits

Automate GPU benchmarking with nvprobe, a zero-setup CLI for NVIDIA GPUs, to save hours of compilation time

Medium · DevOps

Lesson 4: Deployments — Managing Pods the Kubernetes Way

Learn to manage pods using Kubernetes deployments and scale your application efficiently

Medium · DevOps

Why your GitHub App can't see your personal Projects

Learn why GitHub Apps can't access personal projects and how to resolve the issue

Dev.to · Matt Fauveau

Migrating from Promtail to Alloy for Log Collection

Learn to migrate from Promtail to Alloy for log collection due to Promtail's end of life

Dev.to · Justyn Larry

How to Code with Distrobox on the Steam Deck