I’m not entirely convinced that you can just fine tune away the hallucinations like they’re claiming. A 75% abstention rate is borderline useless when you’re making an LLM. And creativity comes from making poor choices and then reining them back in.

In my opinion, what AI is missing is the ability to quickly iterate on and test theories against an external source of truth. Well, that and the ability to learn from and adapt to new information instead of being a static model.