• 2 Posts
  • 990 Comments
Joined 11 months ago
cake
Cake day: December 19th, 2024

help-circle




  • Yup. I’ve run some on my gaming rig. They just have the normal lack of reasoning and therefore lack of use.

    The only reason the fuckheads running grok need that much water and power is because they have thousands of users pinging it. Shove the model in a toaster and it’ll run, just only for one user though.

    There are single board computers out there marketed for AI use like the Nvidia Jetson nano, and LattePanda’s boards. You can run generative AI on them, it’s just going to be a little slower.