Pope Leo’s Newest AI Warning: ‘Overly Affectionate’ Chatbots

Even the pope is apprehensive about how we’re speaking to chatbots.

In a written tackle for Saturday’s World Day of Social Communications, Pope Leo XIV warned in opposition to customized chatbots that may replicate pleasant or intimate habits.

“Overly affectionate chatbots, moreover being ever-present and available, can change into hidden architects of our emotional states, thereby invading and occupying the sphere of individuals’s intimacy,” the first-ever US-born pope wrote.

The pope known as for nationwide and worldwide rules to guard customers from forming emotional, misleading, or manipulative bonds with chatbots.

“All stakeholders — from the know-how business to policymakers, from inventive companies to academia, from artists to journalists and educators — have to be concerned in constructing and implementing a acutely aware and accountable digital citizenship,” the pope wrote.

The Holy See chief has spoken about AI and his considerations with the know-how a number of occasions since he was elected in Could.

In his first tackle since turning into pope, he stated he needed to make AI a spotlight of his papacy and that the know-how poses new challenges for “human dignity, justice, and labor.” In November, he wrote to AI leaders on X, calling on them to “domesticate ethical discernment” when constructing AI instruments.

On the finish of final 12 months, the pope met Megan Garcia, a lady whose 14-year-old son, Sewell Setzer, died by suicide after interacting with a Character.AI chatbot.

Florida-based Garcia filed a lawsuit in opposition to chatbot-building startup Character.AI, alleging that the corporate, which lets folks have in-depth and private conversations with AI chatbots, was answerable for the dying of her son, Sewell Setzer III.

Earlier this month, Google and the startup agreed to settle a number of lawsuits from households, together with Garcia, whose youngsters died by suicide or harm themselves after interacting with Character.AI’s bots. These negotiations are among the many first settlements in lawsuits that accuse AI instruments of contributing to psychological well being crises and suicides amongst youngsters.