ES version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
25% Positive
Analyzed from 127 words in the discussion.
Trending Topics
#meta#don#why#scrapers#requests#money#still#worse#search#engine

Discussion (2 Comments)Read Original on HackerNews
Meta presumably has some at least marginally competent people on hand that don’t need random bloggers to tell them to sort out their scraping tech…
It's up to 1.5 million requests now, sigh. My guess is that Meta has too much money and is in the "move fast and break things" stage where they're just throwing money at a problem. Not setting a max crawl depth is hilarious though.