I’m posting this because it’s a great example of how LLMs do not actually have their own thoughts, or any sort of awareness of what is actually happening in a conversation.
It also shows how completely useless it is to have a “conversation” with someone who is just in agreeability mode the whole time (a.k.a. “maximizing engagement mode”) – offering up none of their own thoughts, but just continually prompting you to keep talking. And honestly, some people act that way too. And other kinds of people crave a conversation partner who acts that way, because it makes them the center of attention. It makes you feel interesting when the other person is endlessly saying, “You’re right! Go on.”
LLMs work best when used as a mirror to help you reflect on your own thoughts, as that’s the only thinking going into the process. This isn’t how most people are using it.
I’m posting this because it’s a great example of how LLMs do not actually have their own thoughts, or any sort of awareness of what is actually happening in a conversation.
It also shows how completely useless it is to have a “conversation” with someone who is just in agreeability mode the whole time (a.k.a. “maximizing engagement mode”) – offering up none of their own thoughts, but just continually prompting you to keep talking. And honestly, some people act that way too. And other kinds of people crave a conversation partner who acts that way, because it makes them the center of attention. It makes you feel interesting when the other person is endlessly saying, “You’re right! Go on.”
LLMs work best when used as a mirror to help you reflect on your own thoughts, as that’s the only thinking going into the process. This isn’t how most people are using it.
this is an effect known for almost 60 years now https://en.wikipedia.org/wiki/ELIZA_effect
That is interesting, I hadn’t heard of that.