• VoterFrog@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 days ago

      An AI crawler is both. It extracts useful information from websites using LLMs in order to create higher quality data for training data. They’re also used for RAG.