- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
Claude bros know how to measure performance. They just don’t.
https://www.youtube.com/watch?v=xeU208KqeRc&list=UU9rJrMVgcXTfa8xuMnbhAEA - video
https://pivottoai.libsyn.com/20260113-if-ai-coding-is-so-good-where-are-the-performance-numbers - podcast
time: 7 min 34 sec
You must log in or register to comment.
In b4 METR drops the next shoddy study and the promptfondlers go wild
the most robust study in AI coding! cos they built it from toothpicks instead of toilet paper
There is an old principle in software development not to make the GUI too pretty until the back end works, because managers and customers will think its ready when they can click around buttons with nice shading and animations. I think slopware is like that. People see the demo that appears to work and don’t see what maintaining it and integrating it with other systems is like.
Hell, that’s the whole thing with these LLM-based business/product structures, isn’t it? The models are very good at creating something that looks right, leading to people being absolutely blindsided when they fail to actually do the thing that boosters and salesmen pretended they were doing.
Given that these are statistical models that function probabilistically, it seem like the obvious attitude to take would be to assume it’s a question of when they fail and do something wrong, rather than if. But accounting for that inevitability undermines most if not all of the actual economic value of these things because it turns out it takes just about as much time, effort, and skill to monitor and check these things as it would to just do the damn work yourself. But as soon as you start giving these things permissions to operate independently you are setting up a time bomb and putting duct tape over the timer. You will get fucked eventually.
When the bosses say “good” they don’t mean that it is better in any way. What they mean is that it is “good” enough to replace a human worker.
it turns out that people who can’t code make terrible judges of how good ai is at coding
The entire AI boom is management cumming all over their own faces at the thought of firing every human worker.
Not any different than offshoring devs. Saves money short-term, cost savings look great, managers get promotions, and they move on from that garbage code base that was created
don’t need to kink shame but yeah, pretty much… that and rich idiots who listen to excited grifters talking about how it’s the future… so fomo.
now in the future “ai free” is going to be a huge feature
10x, bro, trust me.
And now that you trust me, bonus me!
We cant estimate how much effort it will take to fix or maintain it. That’s the problem
We cant estimate how much effort it will take to fix or maintain it. That’s the problem
That’s the expected result of selling stuff that doesn’t exist or does not really work.
What you’re saying is there will be lucrative billable hours to fix it when this all shakes out? I guess short term pain…
In a few years. From the companies that haven’t died. During Great Depression 2.
Your not wrong, but I don’t like that much uncertainty in my life.
deleted by creator
