HeadlinesBriefing favicon HeadlinesBriefing.com

Anubis: New Defense Against AI Scraping

Hacker News •
×

Website administrators are deploying Anubis, a protection system against aggressive AI scraping that causes website downtime. This solution addresses scraping operations that exhaust server resources and make content inaccessible to legitimate users. Anubis strikes a balance between security and usability by targeting large-scale scrapers while minimizing impact on regular visitors.

Anubis implements a Proof-of-Work mechanism inspired by Hashcash. At individual visit levels, the additional computational load remains negligible. However, when deployed across mass scraping operations, the accumulated cost becomes substantial, making automated data extraction economically unfeasible for large-scale operations.

Currently positioned as a temporary solution, Anubis development focuses on fingerprinting headless browsers through techniques like font rendering analysis. The goal is to present challenges only to suspicious visitors while allowing legitimate users seamless access. Administrators should note that Anubis requires modern JavaScript features, conflicting with privacy plugins like JShelter.