• VoterFrog@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    An AI crawler is both. It extracts useful information from websites using LLMs in order to create higher quality data for training data. They’re also used for RAG.