How do you transfer data in migrations?

📰 Reddit r/webdev

Hey guys. I started writing migrations some time back for my app. Works really great. But the issue always remained that for big datasets of 2-3gb you can't really put them in git. What's the standard way to transfer those? I was doing some brainstorming and thought I could potentially put the data in parquet or something to an s3 storage or something. And then in the migration itself it can be like: A) make schema. B) Load parquet/sql/dum

Published 27 Jun 2026

Full Article

Hey guys. I started writing migrations some time back for my app. Works really great. But the issue always remained that for big datasets of 2-3gb you can't really put them in git. What's the standard way to transfer those? I was doing some brainstorming and thought I could potentially put the data in parquet or something to an s3 storage or something. And then in the migration itself it can be like: A) make schema. B) Load parquet/sql/dum
Read full article → ← Back to Reads