A group of prominent scientists, technology executives, and public figures, including the leadership of tech giants such as Google, Microsoft, and OpenAI, have issued a public statement warning of the potential existential threats posed by artificial intelligence (AI). The statement compares the dangers of AI’s rapid advancement to those of nuclear conflict and pandemics. The Center for AI Safety (CAIS), a nonprofit organization based in San Francisco, is stimulating a broader discussion about the imminent dangers associated with AI among experts, policymakers, journalists, and the general public.

The public declaration was supported by more than 350 notable figures, including representatives from leading artificial intelligence (AI) companies such as OpenAI, Google DeepMind, Microsoft, and Anthropic. Geoffrey Hinton, often referred to as the “Godfather of AI,” recently resigned from his position as vice president of Google to freely convey his concerns about the technology he played a significant role in developing. Sam Altman, CEO of OpenAI, and Demis Hassabis, director of Google’s AI division, are also notable signatories. These industry leaders have become increasingly vocal about their apprehensions regarding artificial intelligence and have demanded the establishment of technological safeguards and government regulations.

In addition to AI researchers, the list of signatories includes prominent figures such as Harvard University legal scholar Laurence Tribe, well-known climate change activist Bill McKibben, and musician and artist Grimes. Notably, Elon Musk, renowned for his leadership duties at Tesla and Twitter and his relationship with Grimes, is not among the signatories.

Concerns expressed by Hinton and Altman highlight the potential dangers of AI. After departing Google, Hinton voiced concern about the rapid development of artificial intelligence (AI) technology, particularly its early signs of developing simple cognitive reasoning. He proposed a bleak scenario in which humanity could be a mere transitional stage in the evolution of intelligence. In his testimony before the Senate, Altman warned of the possibility of AI developing the ability to self-replicate and spread into the wild.

Although the statement has garnered widespread attention, not everyone shares the extent of the expressed concerns. Some cybersecurity specialists, such as Michael Hamilton, co-founder of the risk management company Critical Insight, consider Hinton’s opinions extreme and unwarranted. They argue that artificial intelligence is fundamentally a platform for sophisticated programming that can only go as far as humans allow. These experts also emphasize AI’s immense potential to benefit humanity, ranging from applications in industry and education to augmenting the visual, auditory, and communicative abilities of disabled individuals.

The CAIS, which issued the public statement, asserts that while AI possesses significant potential benefits for society, it also has inherent risks, some of which are potentially catastrophic. By conducting safety research, fostering the field of AI safety researchers, and advocating for safety standards, the organization is committed to minimizing the societal risks associated with AI. It emphasizes that many fundamental AI safety issues remain unresolved.

The issue of AI safety has also captured the attention of Congress, which has held multiple hearings on the subject. A recent subcommittee hearing of the Senate Judiciary Committee featured a demonstration in which an AI chatbot was requested to deliver an opening statement, imitating the voice and concerns of Senator Richard Blumenthal. Following a meeting with tech industry leaders at the White House, the Biden administration announced a series of measures, including a $140 million investment in new research efforts, to promote responsible AI innovation and protect individuals’ rights and safety.

The National Science Foundation will establish seven new National AI Research Institutes as part of this initiative. These institutes are intended to promote collaboration between federal agencies, private-sector developers, and academic institutions to pursue ethical and responsible AI development that serves the public interest. The new institutions will concentrate on advancing artificial intelligence research and development in critical areas such as climate change, agriculture, energy, public health, education, and cybersecurity.