☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Memes@lemmygrad.mlEnglish · 6 days agoUse The New Means And The Oldlemmygrad.mlimagemessage-square49fedilinkarrow-up153arrow-down110
arrow-up143arrow-down1imageUse The New Means And The Oldlemmygrad.ml☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Memes@lemmygrad.mlEnglish · 6 days agomessage-square49fedilink
minus-squaresudo_halt@lemmygrad.mllinkfedilinkarrow-up2·4 days agoOn another note Ollama is really shitty and they’re trying to push their own API format, please consider using the one true community deriven gigachad Russian developed ‘llama.cpp’. KoboldCPP even has a nice web UI for use.
minus-square☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOPlinkfedilinkarrow-up2·4 days agooh thanks for the heads up, I’ve heard of llama.cpp, but never bothered looking into taking it for a spin.
On another note Ollama is really shitty and they’re trying to push their own API format, please consider using the one true community deriven gigachad Russian developed ‘llama.cpp’. KoboldCPP even has a nice web UI for use.
oh thanks for the heads up, I’ve heard of llama.cpp, but never bothered looking into taking it for a spin.