Introducing PoWned, a WordPress Plugin that makes Crawlers pay for what they take using Proof of Work.
In short, Bots get PoWned.
PoWned works by forcing bots visitors to mine a block before they reach the "expensive" pages: double SHA-256 below a target, exactly like Bitcoin, just with a difficulty a phone solves in a blink. Humans wait about a second, once. Bots that hammer you from 10k rotating IPs pay that on every single request.
It exists because my WP got farmed by a residential-proxy crawler using tens of thousands of filter combinations like (?filter_pa_color=…&filter_pa_size=…), about 10,000 IPs per half hour, one request each. Page loads went from 0.3 to 25 seconds.
Of course I tried IP bans and rate limits. Every IP shows up once. Nothing to ban. User-agent filters. It claims to be Chrome. Sure bro. Tried hiding the links behind JavaScript. It read the JavaScript and came back. Nothing worked.
What works is to make every request cost CPU time. Proof of work. The thing Bitcoin has been doing since 2009.
How well does it work?
In the first hour after going live on
http://gobrrr.me, the crawler fired about 31,800 filter requests from thousands of rotating IPs: Most were rejected, but 487 reached PoWned's mining page.
Real visitors mined 39 blocks and browsed on without noticing much, one headless-Chrome crawler instance mined exactly two pages, and the rest never even solved a single block.
As an immediate effect, the server load dropped to about 0.5% and pages load in 0.3s again.
The crawler gave up after roughly 45 minutes. GG

In the backend you choose which URLs cost work. Query parameters with wildcards, or paths. The defaults cover WooCommerce filters out of the box.
You set the base difficulty (18 bits need about 260,000 hashes), how long a solved block lasts and whether it’s bound to the network, the exact IP or nothing. Under load the difficulty goes up by itself, up to 16x the work. Bitcoin retargets every 2016 blocks. PoWned retargets on every challenge. Accent color, logo and texts are yours too.

The server stores nothing per visitor. The challenge is HMAC-signed, and checking a solution costs two SHA-256 runs and one HMAC. The bot does 260,000 hashes, the server does three. GG
No CAPTCHAs, no external scripts, no tracking. The challenge page is a few kilobytes and answers in about 40 ms. The progress bar is only an estimate, because nobody knows how close a block is. Not even the miner.
PoWned is open-source and free to use, but has only existed for a few hours so please report any issues you might encounter. I will extend this with more features like statistics and maybe additional options if the crawler inevitably comes back with something new.
Fork it, run it, PoWn some bots:
https://github.com/gobrrrme/PoWned