Posted by pjerem 4 hours ago
Would be interesting if someone said “I spent $2.50 using llm-council with the three top SOTA models and think this reply makes sense: {paste}”
(But better “not sure, though after spending a few bucks on model APIs, perhaps {human-written analysis} is in the right direction”)
Also like you, I did think on the angry version “they have the same AI you do” isn’t likely to be right in the consumer space since their AI is ChatGPT (free version?!) and yours is Claude or something.
Over time, it was impressive to see how much the output of the same prompt would differ between us, and it seems to be heavily influenced by the role of the user. I.e. answers coming from the agent of a Data Engineer, a Backend Engineer and a Domain Researcher would not be the same at all. Some of us use harnessing tools, some not, but regardless it we saw differences.
So, for example, when a backend engineer would send a question to a data engineer, there was *some* added value even when it was a lazy copy & paste.
There's responsible AI use (which I think you - and I, and many people here) do, and the "I don't care, I've outsourced my brain to OpenAI" type of people.
But this leading statement is not necessarily true:
“The person on the other side has the same tools you do”
Aren’t we all imbuing our AI with our own thought patterns? Folks I speak to spent a tremendous amount of time building tooling and (hierarchical) context around LLMs such that the output it produces is definitely not the same as what the stock model produces.