Ask HN: How would you store 10PB of data for your startup today?

📰 Hacker News · philippb

I'm running a startup and we're storing north of 10PB of data and growing. We're currently on AWS and our contract is up for renewal. I'm exploring other storage solutions. Min requirements of AWS S3 One Zone IA ( https://aws.amazon.com/s3/storage-classes/?nc=sn&loc=3 ) How would you store >10PB if you'd be in my shoes? Thought experiment can be with and without data transfer cost our of current S3 buckets. Please mention also what your experience is based on. Ideally you store large amounts of data yourself and speak of first hand experience. Thank you for your support!! I will post a thread once we got to a decision on what we ended up doing. Update: Should have mentioned earlier, data needs to be accessible at all time. It’s user generated data that is downloaded in the background to a mobile phone, so super low latency is not important, but less than 1000ms required. The data is all images and videos, and no queries need to b

Published 23 Apr 2021
Read full article → ← Back to Reads