The last time I had fun with LLMs was back when GPT2 was cutting-edge, I fine-tuned GPT2-Medium on Twitch chat logs and it alternates between emote spam, complete incoherence, blatantly unhinged comments, and suspiciously normal ones. The bot is still in use as a toy, specifically because it’s deranged and unpredictable. It’s like a kaleidoscope for the slice of internet subculture it was trained on, much more fun than a plain flawless mirror.
yeah agreed! Back in the day I used to generate text for fun with n-grams and I never went higher than bigrams bc it was boring without those unexpected disfluencies. I thought of it being like an electric guitar, you want it to sound a little raw.
The last time I had fun with LLMs was back when GPT2 was cutting-edge, I fine-tuned GPT2-Medium on Twitch chat logs and it alternates between emote spam, complete incoherence, blatantly unhinged comments, and suspiciously normal ones. The bot is still in use as a toy, specifically because it’s deranged and unpredictable. It’s like a kaleidoscope for the slice of internet subculture it was trained on, much more fun than a plain flawless mirror.
yeah agreed! Back in the day I used to generate text for fun with n-grams and I never went higher than bigrams bc it was boring without those unexpected disfluencies. I thought of it being like an electric guitar, you want it to sound a little raw.