HeadlinesBriefing favicon HeadlinesBriefing.com

Anubis Protects Against AI Scraping

Hacker News •
×

The Hacker News website is currently protected by Anubis, a system designed to deter aggressive AI scraping. This protection is necessary because AI companies can overload servers, making resources inaccessible. Anubis employs a Proof-of-Work scheme, similar to Hashcash used for email spam, to increase the cost and difficulty for mass scrapers.

This system is a temporary measure. The ultimate goal is to develop methods for fingerprinting and identifying headless browsers, such as by analyzing their font rendering. This will allow the Proof-of-Work challenge page to be bypassed for users who are more likely to be legitimate.

Users may need to disable certain browser plugins, like JShelter, as Anubis relies on modern JavaScript features. Disabling these plugins for the domain will ensure proper access.