Are you up to a Petabyte of storage yet?
When I come across something, it's usually some shit site that wants you to click through for every file so you see adds. I usually inspect the page first to see if there's an obvious pattern. If not, I build a map and use read with wget.
2
