I got rate limited scraping 100 pages. Here's what actually worked

Spent 3 days fighting rate limits while scraping product data. Here's what finally worked (spoiler: it's not just delays).