The Pope Is Into AI

The Pope Is Into AI

โฑ ~22 min ๐ŸŽค Matthew Berman ๐Ÿท Pope Leo XIV ยท Encyclical ยท Anthropic ยท AI Ethics ยท Regulation ยท Open Source
Matthew Berman ~22 min Watch on YouTube โ†—

Overview

Pope Leo XIV released Magnifica Humanitas, a 40,000-word encyclical entirely about artificial intelligence โ€” covering human dignity in the age of AI, the dangers of AI companionship, the arms-race framing of AI development, regulatory capture, and the case for open-source AI. Matthew Berman breaks it down section by section, highlighting the Pope's surprisingly nuanced and well-informed positions, while connecting the dots to Anthropic's co-founder speaking at the Vatican unveiling โ€” which he frames as "pope-based marketing" and the latest chapter in Anthropic's pursuit of regulatory and moral authority over the AI industry.

1 Magnifica Humanitas โ€” The 40,000-Word Encyclical โ–ถ 0:00

Pope Leo XIV dropped a 40,000-word encyclical titled Magnifica Humanitas (Latin for "Magnificent Humanity") โ€” entirely dedicated to artificial intelligence. The core thesis: there is something distinctly special about humans, and in a world where AI might be conscious or might replace what humans do, we must not forget that humanity itself is magnificent.

Berman admits he didn't know what an encyclical was before this (a formal papal letter to the entire Church โ€” the highest form of papal teaching). He walks through the key sections, connecting each to Anthropic's positions and the broader AI industry debate.

๐Ÿ’ก The Pope's AI encyclical is surprisingly well-informed and nuanced โ€” Berman says it stands in stark contrast to politicians who "have no clue what they're talking about."

2 Private Power & the Case for Open Source โ–ถ 2:33

The Pope writes: "Technological power thus takes on an unprecedented predominantly private aspect which makes it even more challenging to discern, govern, and direct such power towards the common good."

Berman interprets this as a potential argument for open-source AI: right now, very few people are determining the future of AI โ€” and the Pope is calling that out. He connects this directly to Anthropic:

Later, the Pope writes: "Ensured that shared knowledge becomes a true common good rather than an instrument of dominance." Berman's take: "There's only one way to have shared knowledge and that is with open source. Otherwise, somebody controls it."

3 Human Dignity & the Dehumanization Risk โ–ถ 6:45

The Pope writes: "In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human."

Berman interprets this through a concrete lens: many people gain their identity through work, hobbies, and contributions to society. AI threatens to supersede humans in those activities, potentially stripping people of their sense of purpose and identity. However, Berman pushes back โ€” he believes the human element actually becomes more important as AI ramps up.

His personal example: he recently banned AI-generated writing from his newsletter's original essays. "It took AI stripping the humanity out of the words I was reading for me to realize how very special those human mistakes really were. The raw ideas coming from an actual human."

AI doesn't understand what it produces

The Pope: "They may imitate language, behavior, and analytical skills, or even simulate empathy and understanding, but they do not understand what they produce, for they lack the effective relational and spiritual perspective through which human beings grow in wisdom."

Berman praises this as a direct counter to Anthropic's position. While Anthropic has argued there's likely "something in the models that makes them conscious," the Pope is arguing they don't really understand anything โ€” they're producing text, not wisdom.

๐Ÿ’ก "Man, he really nailed that." โ€” Berman on the Pope's distinction between simulating understanding and actually possessing it.

4 AI Companionship โ€” The Loneliness Trap โ–ถ 9:33

The Pope: "When words are simulated, they do not build genuine relationships, but only their appearance. The artificial imitation of care or support can become particularly risky when it enters contexts where real relationships and emotional bonds are lacking."

And the most striking line: "The danger is not so much that a person may believe they are communicating with another person, but rather that they may gradually lose the very desire to form genuine human connections."

Berman says this is something he's been worried about for a while and highlights the compound problem:

๐Ÿ’ก "If it's so much easier to form a relationship with AI, then we run the risk of people taking that easy path and foregoing real human relationships."

5 "Disarming" AI โ€” Beyond the Arms Race โ–ถ 11:17

The Pope deliberately uses the word "disarm": "Disarming AI means freeing it from the mentality of armed competition."

Berman notes that even he describes AI development as a "race" โ€” between frontier labs, between the US and China. The Pope names this explicitly: "This entails a race for ever more powerful algorithms and larger data sets, driven by the desire to secure geopolitical or commercial dominance."

Crucially, to disarm does not mean to reject technology: "It means freeing technology from monopolistic control and opening it to discussion and debate, therefore making it human-friendly and restoring it to the plurality of human cultures and ways of life."

Berman appreciates the sentiment but is cynical about human nature: "I wish human nature were different, but it's not."

6 The Regulation Paradox โ–ถ 13:07

Berman identifies a tension within the encyclical itself: the Pope calls for both more regulation and more competition โ€” but in practice, more regulation tends to kill competition by raising barriers for startups and smaller players.

He notes the Pope's positions are surprisingly well-informed:

๐Ÿ’ก "I was quite blown away by how nuanced the Pope's takes are and how quite informed they are. Somebody outside the AI industry having informed takes about such a sophisticated technology is surprising."

7 Anthropic at the Vatican โ€” "Pope-Based Marketing" โ–ถ 16:22

An Anthropic co-founder was invited to speak at the Vatican unveiling of the encyclical โ€” the only AI lab represented. Berman frames this as "pope-based marketing" โ€” the latest escalation of what he sees as Anthropic's strategy to position itself as the sole moral authority on AI.

His summary of Anthropic's pattern:

The Anthropic co-founder's speech at the Vatican: "We keep finding things that are mysterious, even unsettling. We find structures that mirror results from human neuroscience. We find evidence of introspection. We find internal states that functionally mirror joy, satisfaction, fear, grief, and unease."

Berman's reaction: this is fear-based marketing elevated to the highest authority โ€” going above governments to align with the Catholic Church. "Who's going to argue with them?"

8 Industry Reactions โ–ถ 18:18

Berman highlights three notable responses:

Berman's final take: he agrees with much of what the Pope said, and even where he disagrees, he appreciates the nuance and openness to other viewpoints. But Anthropic's involvement rubs him the wrong way โ€” they believe they are the ultimate authority on AI, and aligning with the Pope and the government simultaneously is a power play that "annoys the heck out of me."

๐ŸŽฏ Key Takeaways

  1. Magnifica Humanitas is surprisingly well-informed โ€” the Pope's 40,000-word encyclical on AI demonstrates deep understanding of frontier models, regulatory dynamics, consciousness debates, and societal risks โ€” far more nuanced than any political position
  2. The Pope makes an implicit case for open-source AI โ€” calling for "shared knowledge as a common good" and warning against monopolistic control of technology by private actors
  3. AI companionship is the quiet crisis โ€” the Pope warns that the real danger isn't people believing AI is human, but gradually losing the desire to form genuine human connections
  4. Regulatory capture is real โ€” when the market leader (Anthropic) advocates for more regulation, it raises barriers for startups and reduces competition, contradicting the Pope's own call for broader access
  5. Anthropic at the Vatican is strategic positioning โ€” being the only AI lab at the encyclical unveiling is "pope-based marketing" โ€” aligning with the highest moral authority while pushing a fear-and-safety narrative
  6. "Disarming" AI โ‰  rejecting it โ€” the Pope's nuanced position: you can't stop AI, you can't blindly accelerate it. Free it from arms-race mentality and monopolistic control
  7. Technology is never neutral โ€” it takes on the characteristics of those who devise, finance, regulate, and use it. This makes the question of who controls AI development existential
  8. The Mythos precedent is concerning โ€” Anthropic withholding a model because it's "too powerful" while deciding which companies get access sets a dangerous pattern for the industry
  9. Humans become more important, not less โ€” Berman banned AI-generated writing from his newsletter because "it took AI stripping the humanity out of words for me to realize how special human mistakes were"
  10. The regulation-competition paradox โ€” the encyclical calls for both more regulation and more competition, but these goals are in tension. More regulation typically consolidates power among incumbents

๐Ÿ”— Resources & Links

โฑ Timestamp Index

โ–ถ 0:00 Intro โ€” the Pope dropped a 40K-word AI encyclical
โ–ถ 0:45 The Pope's Twitter post on AI
โ–ถ 1:08 Magnifica Humanitas โ€” title meaning
โ–ถ 2:33 AI power is private โ€” open source argument
โ–ถ 3:30 Anthropic and regulatory capture
โ–ถ 4:34 Technology is never neutral
โ–ถ 6:45 Human dignity and dehumanization
โ–ถ 8:17 AI doesn't understand what it produces
โ–ถ 9:33 AI companionship โ€” the loneliness trap
โ–ถ 11:17 "Disarming" AI โ€” the arms race framing
โ–ถ 13:07 Regulation paradox and nuanced positions
โ–ถ 14:22 Pope rejects tech optimism, attention economy
โ–ถ 16:22 Anthropic co-founder at the Vatican
โ–ถ 18:18 Industry reactions โ€” Romel, Sacks, Kim
โ–ถ 21:08 Final thoughts