AI deepfakes have become so convincing that even close relatives, like an aunt, may struggle to distinguish between a real person and a deepfake. A sitting prime minister also faced challenges proving his authenticity amid concerns over AI-generated impersonations.

Using a language model to alter messages can obscure the original intent and authenticity of communication. This can lead to discomfort when receiving messages that have been sanitized or modified by AI.