Lemmy
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
fattyfoods@feddit.nl to Open Source@lemmy.ml · 19 hours ago

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

external-link
message-square
76
fedilink
  • cross-posted to:
  • [email protected]
  • [email protected]
416
external-link

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

fattyfoods@feddit.nl to Open Source@lemmy.ml · 19 hours ago
message-square
76
fedilink
  • cross-posted to:
  • [email protected]
  • [email protected]
Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
  • unexposedhazard@discuss.tchncs.de
    link
    fedilink
    arrow-up
    73
    ·
    edit-2
    14 hours ago

    Non paywalled link https://archive.is/VcoE1

    It basically boils down to making the browser do some cpu heavy calculations before allowing access. This is no problem for a single user, but for a bot farm this would increase the amount of compute power they need 100x or more.

    • Mubelotix@jlai.lu
      link
      fedilink
      arrow-up
      44
      ·
      14 hours ago

      Exactly. It’s called proof-of-work and was originally invented to reduce spam emails but was later used by Bitcoin to control its growth speed

      • RandomTester@lemmybefree.net
        link
        fedilink
        arrow-up
        1
        ·
        1 hour ago

        it wasn’t made for bitcoin originally? didn’t know that!

    • lazynooblet@lazysoci.al
      link
      fedilink
      English
      arrow-up
      6
      ·
      14 hours ago

      Thank you for the link. Good read

Open Source@lemmy.ml

opensource@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

  • Open Source Initiative
  • Free Software Foundation
  • Electronic Frontier Foundation
  • Software Freedom Conservancy
  • It’s FOSS
  • Android FOSS Apps Megathread

Rules

  • Posts must be relevant to the open source ideology
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

  • [email protected]
  • [email protected]
  • [email protected]
  • [email protected]
  • [email protected]

Community icon from opensource.org, but we are not affiliated with them.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 718 users / day
  • 1.4K users / week
  • 2.91K users / month
  • 10.5K users / 6 months
  • 1 local subscriber
  • 38.7K subscribers
  • 2.34K Posts
  • 34.2K Comments
  • Modlog
  • mods:
  • Evan@lemmy.ml
  • kevincox@lemmy.ml
  • CrypticCoffee@lemmy.ml
  • Lettuce eat lettuce@lemmy.ml
  • BE: 0.19.9
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org