lens0021@programming.dev to AI@lemmy.ml · 13 days agoDocker Model Runner is now Generally Availablewww.docker.comexternal-linkmessage-square1fedilinkarrow-up15arrow-down10file-textcross-posted to: [email protected]
arrow-up15arrow-down1external-linkDocker Model Runner is now Generally Availablewww.docker.comlens0021@programming.dev to AI@lemmy.ml · 13 days agomessage-square1fedilinkfile-textcross-posted to: [email protected]
minus-squarevermaterc@lemmy.mllinkfedilinkarrow-up3·edit-213 days agoDo you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)
Do you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)