OpenAI said it was working with Anthropic and Google on an idea that originated from a proposal by Google DeepMind’s Demis Hassabis for a self-regulatory body modelled after the Financial Industry Regulatory Authority that oversees US brokers and investment firms.
In July, Hassibis called for the United States to create an organisation that would test the most powerful AI systems before they are released to the public.
“Funding would need to be substantial and likely mostly come from industry, in order to attract world-class technical talent and provide the necessary compute resources for large-scale testing,” Hassabis wrote.
There is no consensus on how to move forward, though, with some tech figures accusing the AI giants of trying to push out smaller rivals through regulation and cooperation among the industry heavyweights.
The chief of Canadian AI company Cohere recently accused the dominant American AI labs of forming a “cartel” under the guise of safety.
“AI needs guardrails. That is not the dispute and never has been. The dispute is over who writes them, who gets to participate and whose interests the rules are protecting,” Cohere co-founder and CEO Aiden Gomez wrote in a blog post on Sunday.
Concerns about AI safety have escalated in recent weeks, including warnings from two workers who resigned from major AI developers amid concerns about the industry’s risks.
Last week, Jacob Coxon left Anthropic and warned that AI companies were “gambling with our lives.” He also previously worked at OpenAI.
On Monday, former Google DeepMind researcher Bilal Chughtai echoed the concerns raised by Coxon and others.
“I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome,” Chughtai wrote on social media.
On Saturday, Anthropic CEO Dario Amodei called for a slow-down in the pace of AI development, a sentiment that OpenAI CEO Sam Altman, Elon Musk and Hassabis all supported.
US President Donald Trump has however dismissed warnings about the risks of AI as “hoaxes.”
Nvidia CEO Jensen Huang has also pushed back, signalling a belief that the warnings on AI were part of a coordinated campaign.
“The confluence of these words and then the prediction is alarming and troubling and it shouldn’t be done. It’s irresponsible,” Huang said on Monday at a conference in Los Angeles where Trump called him while he was on stage.
Huang, in the call, thanked Trump for “seeing through” the warnings on AI.
The dire outlook that AI could destroy humanity “is not grounded on science,” Huang said.
Nvidia sits at the center of the AI revolution, with its chips powering the vast majority of the systems, and Huang has become an informal advisor to Trump. (AFP)
