A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what’s working now.

  • undefinedTruth@lemmy.zip
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    Why would a website owner use this over Anubis. Not bashing it or anything, just curious how it differentiates?

    • melroy@kbin.melroy.org
      link
      fedilink
      arrow-up
      1
      ·
      1 month ago

      I wanted to have high performance. See my benchmarks. I’m able to reach 150k-180k reqs/sec allowing me to handle ddos attacks as well. Even under very heavy load. Anubis will fall apart.

      Great question BTW!