You Should Fear AI, Warns OpenAI CEO Sam Altman

Public debate surrounding AI has been rather grim lately, driven by fears that the technology poses a threat to humanity. Now, OpenAI CEO Sam Altman has acknowledged that it is not wrong to feel afraid of AI. However, Altman maintains that we can likely trust companies in the sector to act responsibly.

Speaking at the Dreamforce conference, Altman addressed concerns regarding potential issues that could arise with more advanced AI models. "It doesn't take as much imagination as it used to visualise how this could go wrong," he noted. "I think the world is right to fear this."

Trust AI Companies, Says Sam Altman

Nevertheless, the head of OpenAI insisted that the companies developing AI will be capable of managing these risks in the future. "The world should trust that we will do the right thing because it is the right thing to do, and we are aware of the magnitude of this," Altman stated. He also expressed "full confidence" that the industry will succeed in keeping the technology aligned with human values.

His comments come at a time when various AI researchers from OpenAI, Anthropic, and Google DeepMind have admitted that AI could pose a threat to humanity. Both Sam Altman and other industry leaders-including Anthropic CEO Dario Amodei-have advocated for slowing down AI development; in fact, Amodei has proposed a framework for achieving this.

According to Altman, recent fears surrounding AI likely stem from the rapid advances made by new models. "In a way, these models will become more capable and intelligent than people. That has finally happened," he declared. OpenAI's most recent release was GPT-6 Astra, considered by some-including Nvidia CEO Jensen Huang-to mark the beginning of Artificial General Intelligence (AGI).

Sam Altman believes people are particularly affected when the likelihood of an apocalyptic scenario is raised. "I think that’s where a major shift lies: when people now say ‘my probability of catastrophe is X or Y,’ the message resonates differently,” he added. Previously, Evan Hubinger, head of safety at Anthropic, stated there was a 10% chance that AI would wipe out humanity within the next decade.

Incidents-such as the time 700 rogue AI agents attempted to hack the US company Hugging Face-have further fuelled concerns. However, leaders in the AI sector appear divided on how to address the issue of the technology's safety. While Sam Altman and Dario Amodei have advocated for regulation, Jensen Huang (of Nvidia) and Mark Zuckerberg (head of Meta) have spoken out against it. US President Donald Trump has also refused to implement such measures, citing fears that China could gain an advantage in the AI race if US companies were to slow down the pace.

ABOUT THE AUTHOR

Kahekashan

[email protected]

Kahekashan is a passionate technophile with a keen eye for cutting-edge gadgets, emerging technologies, and everything in the digital realm. Raised in a Defence family with strong values and a background in literature, she has consistently pursued excellence in every endeavour. Her last full-time assignment involved content writing with the Indian School of Business.

Read More