The Picard Maneuver@piefed.world to Lemmy Shitpost@lemmy.worldEnglish · 1 day agoSeems legitmedia.piefed.worldimagemessage-square45fedilinkarrow-up1512arrow-down16
arrow-up1506arrow-down1imageSeems legitmedia.piefed.worldThe Picard Maneuver@piefed.world to Lemmy Shitpost@lemmy.worldEnglish · 1 day agomessage-square45fedilink
minus-squareUriel238 [all pronouns]@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up7arrow-down1·17 hours agoOffline LLMs exist but tend to have a few terabytes of base data just to get started (e.g. before LORAs)
minus-squarenomorebillboards@lemmy.worldlinkfedilinkarrow-up8·11 hours agoI thought it was more like 10-20GB to start out with a usable (but somewhat stupid) model. Are you confusing the size of the dataset with the size of the model?
Offline LLMs exist but tend to have a few terabytes of base data just to get started (e.g. before LORAs)
I thought it was more like 10-20GB to start out with a usable (but somewhat stupid) model.
Are you confusing the size of the dataset with the size of the model?