Researcher Nate Soares, based in Berkeley, is one of the experts sounding the alarm over the rapid advancements in artificial intelligence. According to him, allowing this technology to develop freely could lead to catastrophic consequences for humanity. This alarming manifesto raises questions about the responsibility humanity has in creating and controlling these new intelligences.
Nate Soares: An Expert’s Journey
Nate Soares has established himself in the field of artificial intelligence, notably through his professional experiences at Microsoft and Google. Today, at the helm of the Machine Intelligence Research Institute (MIRI) in Berkeley, he focuses his research on the potential risks posed by an artificial intelligence surpassing human intelligence. His commitment to this field places him among the most influential voices on the subject of superintelligence.
An Alarming Warning
In his co-authored book with Eliezer Yudkowsky, If Anyone Builds It, Everyone Dies, Soares presents a grim picture of the dangers associated with the creation of superintelligence. His message is clear: if humanity creates an AI that escapes its control, the consequences could be disastrous. According to him, allowing these technologies to evolve without strict regulation is akin to playing Russian roulette with humanity’s future.
Voices Rising for a Moratorium
This warning resonates with others calling for caution. Prominent figures like Nobel Prize-winning physicist Geoffrey Hinton and Turing Award winner Yoshua Bengio express their concerns about the rapid progression of AI. In early 2023 and again in October 2025, these experts signed open letters calling for a moratorium on the development of certain AI technologies, thus supporting Soares’ concerns.
An Alarming Reality for the Future
Soares’ pessimistic projections are shared by prominent figures in the tech sector. Elon Musk, for instance, mentioned a 10% to 20% probability that things could go wrong with AI development. This sentiment is echoed by the head of Anthropic, Dario Amodei, who admitted that the chances of a negative turn could reach 25%. These diverse concerns reinforce the idea that artificial intelligence is not just a technical issue, but also an ethical and societal one.
Why Vigilance is Necessary
As the development of AI becomes increasingly pervasive, it is crucial to consider the implications of its creation and to contemplate safeguards. Soares and his peers emphasize that humanity must prepare to manage these new powers rather than let them grow unchecked. The responsibility to design safe and beneficial systems lies entirely with today’s researchers and decision-makers. The question remains: will we rise to this challenge before it’s too late?
A Call to Action and Collective Responsibility
To prevent a large-scale catastrophe, Nate Soares calls for urgent dialogue among scientists, politicians, and civil societies regarding the responsible integration of AI. The technological landscape is evolving rapidly, and a collaborative approach seems essential to ensure a future where artificial intelligence serves the common good rather than becoming an existential threat. It is inevitable to ask the question: are we ready to regulate AI development or let it evolve at its own pace?
To explore more about the issues related to artificial intelligence, check out this article on digital apocalypse.
