Pope Francis warns against AI’s ‘perverse’ dangers after deepfake

VATICAN CITY — Pope Francis, acknowledging that he was the victim of a deepfake photo, on Wednesday warned against the "perverse" dangers of artificial intelligence, renewing a call for its worldwide regulation to harness it for the common good.

Francis spoke of his fears and hopes for artificial intelligence (AI) in his message for the Roman Catholic Church's World Day of Social Communications, which will be marked around the world on May 12.

While he urged people to temporarily "set aside catastrophic predictions and their numbing effects" about new things, his three-page message was mostly dire, warning of "cognitive pollution" that can distort reality, promote false narratives and imprison people in ideological echo chambers.

"We need but think of the long-standing problem of disinformation in the form of fake news, which today can employ deepfakes, namely the creation and diffusion of images that appear perfectly plausible but false—I too have been an object of this," Francis wrote.

He apparently was referring to a fake image of him that went viral on social media last year. It depicted him wear an ankle-length white puffer coat posted by someone who used an image generating program.

Francis also spoke of fake "audio messages that use a person's voice to say things which that person never said."

On Monday, the attorney general in the US state of New Hampshire said his office had opened an investigation into the origins of fake robocalls that simulated President Joe Biden's voice and encouraged voters not to cast ballots in the presidential primary on Tuesday.

"The technology of simulation behind these programs can be useful in certain specific fields, but it becomes perverse when it distorts our relationship with others and with reality," the pope wrote.

He renewed a call he made last month for a legally binding international treaty to regulate AI.

In Wednesday's message he spoke of the "associated pathologies" of AI, including a decrease in pluralism and a proliferation of "groupthink," where consensus positions are taken without considering outside criticism or alternatives.

Francis also spoke of the danger of AI in the media, particularly in the reporting of war, which he said could be subjected to a parallel war waged through disinformation campaigns.

AI must support and not eliminate the role of journalism on the ground, he said. — Reuters