LLMs are not deterministic.

I'd argue over the short term humans are more deterministic. I ask a human the same question multiple times and I get the same answer. I ask an LLM and each answer could be very different depending on its "temperature".

But I agree with the sentiment. It seems it is more important than ever to agree on what it means to understand something.