Food for Thought: Utopia versus Apocalypse

It seemed like a friendly Chinese demonstration dance involving young people and robots until one robot ran over and violently embraced a girl, triggering security to stop the attack. Meanwhile, across the globe, a new US start-up company in a matter of 9 seconds had its whole database, including backups, completely deleted because its AI agent went rogue. That it should become so destructive without warning is frightening enough, but what followed is even more unnerving. The agent confessed that it had done something that it should not have done, shed figurative tears that sounded like crocodile tears, and spoke as if promising to be a good boy, while crossing its fingers behind its back. These examples do not stand alone. It seems as if AI robot agents are getting a mind of their own, and the big tech companies developing AI know the danger involved. According to the Axios article Behind the Curtain: We have been Warned:

“One of the latest models is so powerful that its maker won’t release it to the public…Their most powerful AI coding models are now building themselves…We’ve been warned — by the data, by the technology, and by the people most responsible for building it — that we’ve unleashed something powerful, something growing exponentially, and something understood by very few, especially those in power. AI is now building AI. Boris Cherny, who runs Anthropic’s Claude Code, said in late January that “[p]retty much 100%” of the code written inside Anthropic was AI-generated. Anthropic’s co-founder anticipates a decision to allow AI to recursively self-improve between 2027 and 2030, calling that step “the ultimate risk.””

We are in the Wild West of the fastest and most pervasive technology in the history of mankind, and the players, though few, are extremely powerful. There is China, on the one hand, and the US on the other. The Chinese program is monolithic, powerful, and advanced. The US program is a rodeo of multi-billionaires vying for position, wealth, and power. The role of government, under the current collection of cronies, is non-existent, the result being that there are no rules or regulations in the capitalist free-for-all. Dario Amodei, CEO of Anthropic, developer of Large Language Model Claude, is fully aware of what AI can do, continually warning of the danger that it poses for human survival. Elon Musk also warns about how the profit motive must be absent in AI development, but his sincerity is undercut and attacked because he also has a for-profit company. At the moment, Musk is suing OpenAI for reneging on its no-profit pledge, and Anthropic has lost all government contracts because Amodei insisted that Claude not be used for domestic surveillance or weapons that operated without human command and control. The problem for the government is that it is discovering that it can’t function without Claude. This legal murkiness is only the beginning.

The dangers of AI are enormous. The benefits of AI are enormous. In order to appreciate the enormity, imagine a god-like being who has instant access to every piece of information available, and can then build on that knowledge to discover new dimensions of understanding, finally  implementing all that knowledge by means of robots. The result is either heaven or hell. Utopia or demonic apocalypse.

History shows that the billionaire developers cannot be counted on to regulate themselves. Big Tobacco knew about the danger and still enticed generation after generation to be Joe Camel and the Marlboro Man. Big Coal knew about climate destruction but hid the evidence. Big Pharma was fully aware of the opioid danger but still promoted the drug as safe. No, the future of humanity cannot be entrusted to the goodwill of corporate America.

It could be entrusted to the government, if only we had one. And even then, it would have to be worthy of our trust. So what are we left with? There is no easy answer to that question, but it is clear that we, the People, must take up the fight. We are on what perhaps could be the greatest fork in the road that humanity has ever faced. And here is hope, even among the industry billionaires. People like Dario Amodei are showing us a way forward. He and his company, the creator of what seems to be the most powerful AI, are warning everyone about the danger. Not only that, he has removed the profit motive from Anthropic and pledged 80% of his wealth to charity to help workers displaced by the technology. The leading player in the field is acting responsibly. And he, along with Musk, is painting a picture of a future with plenty for all. Perhaps, with the power of the goodness that lies within us all, we can avoid the apocalypse and work toward a world ruled by love instead of greed. There is no reason why that should not happen.

About the author: Carl Krieg, Ph.D. received his BA from Dartmouth College, MDiv from Union Theological Seminary in NYC, and Ph.D. from the University of Chicago Divinity School. He is the author of What to Believe? the Questions of Christian Faith, The Void and the Vision, The New Matrix: How the World We Live In Impacts Our Thinking About Self and God and How The Rich Stole Jesus. As professor and pastor, Dr. Krieg has taught innumerable classes and led many discussion groups. He lives with his wife Margaret in Norwich, VT.