• 83 Posts
  • 1.98K Comments
Joined 3 years ago
cake
Cake day: June 23rd, 2023

help-circle
  • DeepSeek API isn’t free, and to use Qwen you’d have to sign up for Ollama Cloud or something like that

    To use Qwen, all you need is a decent video card and a local LLM server like LM Studio.

    Local deploying is prohibitive

    There’s a shitton of LLM models in various sizes to fit the requirements of your video card. Don’t have the 256GB VRAM requirements for the full quantized 8-bit 235B Qwen3 model? Fine, get the quantized 4-bit 30B model that fits into a 24GB card. Or a Qwen3 8B Base with DeepSeek-R1 post-trained Q 6-bit that fits on a 8GB card.

    There are literally hundreds of variations that people have made to fit whatever size you need… because it’s fucking open-source!



  • For a company named “Open” AI their reluctance to just opening the weights to this model and washing their hands of it seem bizarre to me.

    It’s not when you understand the history. When StabilityAI released their Stable Diffusion model as an open-source LLM and kickstarted the whole text-to-image LLM craze, there was a bit of a reckoning. At the time, Meta’s LLaMA was also out there in the open. Then Google put out an internal memo that basically said “oh shit, open-source is going to kick our ass”. Since then, they have been closing everything up, as the rest of the companies were realizing that giving away their models for free isn’t profitable.

    Meanwhile, the Chinese have realized that their strategy has to be different to compete. So, almost every major model they’ve released has been open-source: DeepSeek, Qwen, GLM, Moonshot AI, Kimi, WAN Video, Hunyuan Image, Higgs Audio. Black Forest Labs in Germany, with their FLUX image model, is the only other major non-Chinese company that has adopted this strategy to stay relevant. And the models are actually good, going toe-to-toe with the American close-sourced models.

    The US companies have committed to their own self-fulfilling prophecy in record time. Open source is actively kicking their ass. Yet they will spend trillions trying to make profitable models and rape the global economy in the process, while the Chinese wait patiently to stand on top of their corpses, when the AI bubble grenade explodes in their faces. All in the course of 5 years.

    Linux would be so lucky to have OS market share dominance in such an accelerated timeline, rather than the 30+ years it’s actually going to take. This is a self-fail speedrun.









  • Europeans being casually xenophobic about immigrants in The Americas and the dishes they bring from home, thus proving this new community’s point.

    No shit. Orange chicken was invented by a Chinese-American chef in Hawaii. Chicken alfredo was invented in the US by combining the Italian dish fettuccine al burro with cream and chicken. And breakfast tacos were an adaptation of a Mexican dish tacos de guisados, except Texans used eggs, instead of yesterday’s stewed leftovers. (Also, I’m not sure the OP and community admin even gets the point.)

    American is not just a single culture, it’s a melting pot of a bunch of different cultures. Same goes for Canada, just with a different mix of dominant cultures. American food is a reflection of that, sometimes remixing the idea so much that it turns into something else. Cajun food wouldn’t exist without a mixture of French and American influences.

    America may be constantly battling racism and xenophobia internally, but we recognize it for what it is: a shit behavior that should should be excised. European and Eastern cultures like Japan are so casually racist and xenophobic that they don’t even recognize it in themselves.

    The Axis powers came to be out of a combination of elements, but xenophobia was the biggest one. Germany got their shit together in the end, after brutal period of being forcefully separated themselves, and a period of self-reflection. Italy and Japan? Yeah, not so much.

    So, to the OP: I hope your new community isn’t yet another outlet to be racist.