It hasn’t gone past the “idea” stage. I have an unfortunate habit of talking up all kinds of fancy stuff I want to do and only following through on like 20% of it, but I do think something like that would be a really good idea. If I do wind up executing on it I will reach out.
And yes, I think having multiple prompts to sort of analyze the comments thread and progress towards conclusions about it is the way to go. I was mucking around with, I think, a four-prompt setup to keep the LLM from going too far off the rails or try to bite off too much of the analysis at once (and also, to stop it from wanting to be “fair to everyone” which it seems like it otherwise really wants to do because of how it’s been trained to be supposedly-neutral).
It hasn’t gone past the “idea” stage. I have an unfortunate habit of talking up all kinds of fancy stuff I want to do and only following through on like 20% of it, but I do think something like that would be a really good idea. If I do wind up executing on it I will reach out.
And yes, I think having multiple prompts to sort of analyze the comments thread and progress towards conclusions about it is the way to go. I was mucking around with, I think, a four-prompt setup to keep the LLM from going too far off the rails or try to bite off too much of the analysis at once (and also, to stop it from wanting to be “fair to everyone” which it seems like it otherwise really wants to do because of how it’s been trained to be supposedly-neutral).