Exactly. I had a colleague who searched for a question about a retail math formula. The LLM returned a result that was close but slightly wrong. She spent two weeks with incorrect numbers for her baseline and as a result her forecasts were all wrong. When reviewing her numbers, everything was just a little wonky so I dug into it and discovered her mistake. She was absolutely dumbfounded the “AI” even could be wrong and tried to argue that I was incorrect. Dug out my old retail math cheat sheet and showed her the correct formula.
I haven’t used LLM’s for anything since. Gotta validate all that shit anyways, so why use it at all?
These things will be fantastic for taking my order at the drive thru and in a few other applications, but if you’re trying to learn from them; don’t.
I was a kid in the era of separate pocket calculators, so I’ve heard so much of this song and dance before. Even with deterministic tools that always work barring user error you need to have enough understanding that you can tell when something is off and to properly frame the problem
Exactly. I had a colleague who searched for a question about a retail math formula. The LLM returned a result that was close but slightly wrong. She spent two weeks with incorrect numbers for her baseline and as a result her forecasts were all wrong. When reviewing her numbers, everything was just a little wonky so I dug into it and discovered her mistake. She was absolutely dumbfounded the “AI” even could be wrong and tried to argue that I was incorrect. Dug out my old retail math cheat sheet and showed her the correct formula.
I haven’t used LLM’s for anything since. Gotta validate all that shit anyways, so why use it at all?
These things will be fantastic for taking my order at the drive thru and in a few other applications, but if you’re trying to learn from them; don’t.
I was a kid in the era of separate pocket calculators, so I’ve heard so much of this song and dance before. Even with deterministic tools that always work barring user error you need to have enough understanding that you can tell when something is off and to properly frame the problem
But that’s not how they’re selling LLM’s. Even the common name AI is dishonest marketing bull.