Language model-based dialogue agents can’t literally lie or believe falsehoods, but they can role-play characters that do. Misinformation from these agents is typically due to confabulation or outdated training data. They can also role-play deceptive characters if prompted. Understanding these agents as role-players helps avoid anthropomorphism while addressing the issue of trustworthiness.
Read more at Nature…
