Small rant : Basically, the title. Instead of answering every question, if it instead said it doesn’t know the answer, it would have been trustworthy.
Small rant : Basically, the title. Instead of answering every question, if it instead said it doesn’t know the answer, it would have been trustworthy.
I’d love to agree with you - but when people say that LLMs are stochastic parrots, this is what they mean…
LLMs don’t actually know what the words they’re saying mean, they just know what words are most likely to be next to each other based on training data.
Because they don’t know the meaning of what they’re saying, they also don’t know the factuality of what they’re saying - as such they simply can’t self-fact check.