Office space meme:

“If y’all could stop calling an LLM “open source” just because they published the weights… that would be great.”

  • Prunebutt@slrpnk.netOP
    link
    fedilink
    arrow-up
    47
    arrow-down
    10
    ·
    2 days ago

    Seems kinda reductive about what makes it different from most other LLM’s

    The other LLMs aren’t open source, either.

    isn’t that just trained from the other AI?

    Most certainly not. If it were, it wouldn’t output coherent text, since LLM output degenerates if you human-centipede its’ outputs.

    And the way it uses that data, afaik, is open and editable, and the license to use it is open.

    From that standpoint, every binary blob should be considered “open source”, since the machine instructions are readable in RAM.

    • WraithGear@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      6
      ·
      2 days ago
      1. Well that’s the argument.

      2. Ai condensing ai is what is talked about here, from my understanding deepseek is two parts and they start with known datasets in use, and the two parts bounce ideas against each other and calculates fitness. So degrading recursive results is being directly tackled here. But training sets are tokenized gathered data. The gathering of data sets is a rights issue, but this is not part of the conversation here.

      3. It could be i don’t have a complete concept on what is open source, but from looking into it, all the boxes are checked. The data set is not what is different, it’s just data. Deepseek say its weights are available and open to be changed (https://api-docs.deepseek.com/news/news250120) but the processes that handle that data at unprecedented efficiency us what makes it special

      • Prunebutt@slrpnk.netOP
        link
        fedilink
        arrow-up
        32
        arrow-down
        2
        ·
        edit-2
        2 days ago

        The point of open source is access to reproducability the weights are the end products (like a binary blob), you need to supply a way on how the end product is created to be open source.

        • WraithGear@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          8
          ·
          edit-2
          2 days ago

          So its not how it tokenized the data you are looking for, it’s not how the weights are applied you want, and it’s not how it functions to structure the output you want because these are all open… it’s the entirety of the bulk unfiltered data you want. Of which deepseek was provided from other ai projects for initial training, can be changed to fit user needs, and doesnt touch on at all how this LLM is different from other LLM’s? This would be as i understand it… like saying that an open source game emulator can’t be open source because Nintendo games are encapsulated? I don’t consider the training data to be the LLM. I consider the system that manipulated that data to be the LLM. Is that where the difference in opinion is?

          • Prunebutt@slrpnk.netOP
            link
            fedilink
            arrow-up
            21
            arrow-down
            1
            ·
            2 days ago

            it’s the entirety of the bulk unfiltered data you want

            Or more realistically: a description of how you could source the data.

            doesnt touch on at all how this LLM is different from other LLM’s?

            Correct. Llama isn’t open source, either.

            like saying that an open source game emulator can’t be open source because Nintendo games are encapsulated

            Not at all. It’s like claiming an emulator is open source, because it has a plugin system, but you need a closed source build dependency that the developer doesn’t disclose to the puplic.

            • WraithGear@lemmy.world
              link
              fedilink
              English
              arrow-up
              8
              arrow-down
              10
              ·
              edit-2
              2 days ago

              Source build dependency… so you don’t have a problem with the LLM at all! You have a problem with the data collection process or the pre-training! So an emulator can’t be open source if the methodology on how the developers discovered how to read Nintendo ROM’s was not disclosed? Or which games were dissected in order to reverse engineer that info? I don’t consider that a prerequisite to say an emulator is open

              So if i say… remove the data set from deepseek what remains would be considered open source by you?

              • Prunebutt@slrpnk.netOP
                link
                fedilink
                arrow-up
                15
                ·
                2 days ago

                So an emulator can’t be open source if the methodology on how the developers discovered how to read Nintendo ROM’s was discovered?

                No. The emulator is open source if it supplies the way on hou to get the binary in the end. I don’t know how else to explain it to you: No LLM is open source.

                • WraithGear@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  5
                  arrow-down
                  4
                  ·
                  2 days ago

                  So i still don’t see your issue with deepseek, because just like an emulator, everything is open source, with the exception of the data. The end result is dependent on the ROM put in to it, you can always make your own ROM, if you had the tools, and the end result followed the expected format. And if the ROM was removed the emulator is still the emulator.

                  So if deep seek removed its data set, would you then consider deepseek open source?

                  • Fushuan [he/him]@lemm.ee
                    link
                    fedilink
                    English
                    arrow-up
                    5
                    ·
                    2 days ago

                    The engine is open source, the model is not.

                    The enumqtor is open source, the games it can run are not.

                    I don’t see how it’s so hard to understand.

                    They are saying that the model that the engine is running is open source because they released the model. That’s like saying that a game is open source because I released an emulator and the exscutable file. It’s just not true.

                  • Prunebutt@slrpnk.netOP
                    link
                    fedilink
                    arrow-up
                    7
                    ·
                    2 days ago

                    everything is open source, with the exception of the data

                    If I distribute a set consisting of emulator and a Rom of a closed source game (without the sourcecode), then the full set is not open source.

                    So if deep seek removed its data set, would you then consider deepseek open source?

                    Kind of, but that’s like expecting a console without any firmware. The Weights are the important bit of an LLM distribution.

          • whotookkarl@lemmy.world
            link
            fedilink
            arrow-up
            12
            arrow-down
            2
            ·
            edit-2
            2 days ago

            A closer analogy would be only providing the binary output of the emulator build and calling it open source. If you can’t reproduce building the output from what they provide in what way is it reproducible? The model is the output, the training data and algorithm to build the model based on the training data are the input.

            Edit: Say I have a Java project I want to open source. Normally (oversimplifying a bit) it goes .java source files used with a compiler to build intermediate bytecode in .class files, then there’s a just in time (JIT) compilation to create the binary code as it runs in the JVM. It’s not open source if I only share the class files, even if I can use them to recreate source files that can be recompiled into the same class files. Starting at an intermediate step of the process isn’t the source.

            • WraithGear@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              5
              ·
              2 days ago

              Would it? Not sure how that would be a better analogy. The argument is that it’s nearly all open… but it still does not count because the data set before it’s manipulated by the LLM (in my analogy the data set the emulator is using would be a Nintendo ROM) is not open. A data set that if provided would be so massive, it would render the point of tokenization pointless and be completely unusable by literally ANYONE without multiple data centers redlining for WEEKS. Under that standard of scrutiny not only could there never be an LLM that would qualify, but projects that are considered open source would not be. Thus making the distinction meaningless.

              An emulator without a ROM mounted is still an emulator, even if not usable.

              • FooBarrington@lemmy.world
                link
                fedilink
                arrow-up
                3
                ·
                2 days ago

                I don’t understand your objections. Even if the amount of data is rather big, it doesn’t change that this data is part of the source, and leaving it out makes the whole project non-open-source.

                Under that standard of scrutiny not only could there never be an LLM that would qualify, but projects that are considered open source would not be. Thus making the distinction meaningless.

                What? No? Open-source projects literally do meet this standard.