Artificial Intelligence (AI) leaders urge global focus on mitigating risks of AI extinction

Top executives in the field of artificial intelligence (AI), including OpenAI CEO Sam Altman, have come together with experts and professors to raise concerns about the “risk of extinction from AI.” In a letter published by the nonprofit Center for AI Safety (CAIS), signed by over 350 individuals, they emphasized the need for policymakers to consider this risk on par with other global-scale threats such as pandemics and nuclear war.

Joining Altman in signing the letter were CEOs from prominent AI firms, including DeepMind and Anthropic, as well as executives from Microsoft and Google. Notable signatories also included Geoffrey Hinton and Yoshua Bengio, two of the “godfathers of AI” who received the prestigious Turing Award in 2018 for their contributions to deep learning. Professors from esteemed institutions such as Harvard and Tsinghua University in China also lent their support.

The absence of Yann LeCun, the third godfather of AI and a researcher at Meta, drew attention. CAIS director Dan Hendrycks stated that they had extended an invitation to Meta employees to sign the letter, but Meta did not respond to requests for comment at the time.

The letter coincided with the U.S.-EU Trade and Technology Council meeting in Sweden, where policymakers are expected to discuss the regulation of AI. Elon Musk and a group of AI experts and industry executives were the first to raise concerns about potential risks to society back in April. Hendrycks expressed hope that Musk would also sign the letter.

While recent AI developments offer promising applications in fields like medical diagnostics and legal brief writing, concerns have arisen about potential privacy violations, misinformation campaigns, and the prospect of “smart machines” making autonomous decisions.

This warning comes on the heels of a similar open letter issued two months prior by the nonprofit Future of Life Institute (FLI), which called for an urgent pause in advanced AI research due to risks to humanity. Musk and hundreds of others had signed that letter. Max Tegmark, FLI president, who also signed the recent letter, stated, “Our letter mainstreamed pausing; this mainstreams extinction. Now a constructive open conversation can finally start.”

AI pioneer Geoffrey Hinton, in a previous interview with Reuters, expressed the view that AI could pose a “more urgent” threat to humanity than climate change.

In a recent turn of events, OpenAI CEO Sam Altman initially criticized EU AI regulations as over-regulation, but he later reversed his stance following criticism from politicians. Altman, whose ChatGPT chatbot gained significant attention worldwide, is set to meet with European Commission President Ursula von der Leyen and EU industry chief Thierry Breton to discuss AI-related matters.