Evidence suggests chatbot disclaimers may backfire, strengthening emotional bonds

Concerns that chatbot use can cause mental and physical harm have prompted policies that require AI chatbots to deliver regular or constant reminders that they are not human. In an opinion appearing in Trends in Cognitive Sciences, researchers argue that these policies may be ineffective or even harmful because they could exacerbate mental distress in already isolated individuals. The researchers say that reminding chatbot users of their companions' non-human nature may be useful in some contexts, but these reminders must be carefully crafted and timed to avoid unintended negative consequences.