• CriticalResist8@lemmygrad.ml
    link
    fedilink
    arrow-up
    25
    arrow-down
    1
    ·
    1 day ago

    Deepseek: completely free and with 128k context window (chatpgt has a measly 16k or something)

    Z-image turbo: completely free and can run on any modern GPU (6GB Vram for ggufs)

    Huanyuan: open-source txt2vid model, completely free too

    I think I know who’s winning…

      • CriticalResist8@lemmygrad.ml
        link
        fedilink
        arrow-up
        12
        ·
        1 day ago

        They have an API: https://platform.deepseek.com/usage; log in with your deepseek account and everything is on the left sidebar (including documentation and creating the key).

        I use the API with crush which is an agent, which is made to solve tasks/code, but can also just chat like the web interface. I posted an install guide for it in the sidebar of [email protected] because it’s that easy to set up lol, literally just 7 steps and it should work. With crush you just need to give it your deepseek API key when you first start crush and it should work.

        Deepseek’s API is also very cheap, I put 5$ in a couple months ago and I haven’t finished them yet, and I used literally hundreds of millions of tokens lol. On GPT or Claude this would have lasted me all of 10 minutes.

        • durduramayacaklar@lemmygrad.ml
          link
          fedilink
          arrow-up
          2
          ·
          23 hours ago

          So, No frontend available? If there’s no frontend available for this coding such a frontend to reach more audience would be helpful

          • CriticalResist8@lemmygrad.ml
            link
            fedilink
            arrow-up
            4
            ·
            22 hours ago

            setting up an API connection is definitely a bit more involved, but it allows people to use it for their specific needs that the API devs may not have thought of. For example to translate all of prolewiki english to french, I set up an API access to mistral to use their servers/models to do the actual translation. Basically I sent a chunk of text through the API, it did its magic on mistral’s servers side of things, and then their servers return the translated chunk of text. My script saves that returned text to a document, without ever caring what was going on mistral’s side.

            There are other programs for agent coding though I don’t have experience with them, but they might make it a bit easier for people to adopt the tools. I know Claude (Anthropic) has one that apparently works with models other than their own, and is a bit more graphical, i.e. you can use it with the mouse while crush is keyboard-only.

            But try out crush, it works on any computer and I promise it’s not as scary as it looks haha (if that’s what’s holding you back). Once you’re connected it works every time you’ll use it from then on.

              • CriticalResist8@lemmygrad.ml
                link
                fedilink
                arrow-up
                4
                ·
                10 hours ago

                I finished a guide yesterday, in the process of adding some pictures to it: https://lemmygrad.ml/post/9911266

                It’s really not that complicated to install crush! I promise haha. If she is on Windows it’s literally copy and paste a command in powershell (winget install charmbracelet.crush), close powershell, open cmd, cd to a folder, type ‘crush’ and send, and it will open.

                Then in crush panel type Thinking mode to get deepseek, hit enter,

                Then make a deepseek API key and top it up with 5$ on platform.deepseek.com, copy API key, paste with Ctrl+Shift+V, hit enter, and it will just work. Try to send hello to make sure you’re connected.

                • Maeve@lemmygrad.ml
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  10 hours ago

                  ❤️ I’m not sure if $5 is doable for our sister, she will be the one to assess that. I wish I could bring us all together in a big commune somewhere safe. If wishes were horses…

                  Thanks for your work.

                  • CriticalResist8@lemmygrad.ml
                    link
                    fedilink
                    arrow-up
                    5
                    ·
                    10 hours ago

                    I was actually thinking of having a deepseek api key for lemmygrad that people could freely top up and use so that we can all share, but I’m not sure how feasible it is on the trust system. I’ll take a closer look and make a post if there’s something I can set up