UN discusses AI as company heads warn of risks

Tengrinews.kz – Leading global artificial intelligence companies warned the UN Security Council on Wednesday about the risks AI poses to humanity and called on governments to cooperate in managing the increasingly powerful technology, citing Reuters.
Anthropic CEO Dario Amodei told a UN Security Council meeting that, if mismanaged, “AI could be a risk to humanity as a whole.” The meeting was convened by France as part of the 81st UN General Assembly amid concerns that AI systems could self-improve and slip out of human control.

“For all the differences of the people in this room, we must put aside those differences in order to confront this global opportunity and global threat that is being presented to us at the same time. No leader, no company and no nation can manage this alone,” Amodei said.

Hugging Face co-founder Clément Delangue told the Security Council about the role of AI tools in cyber defense, recalling that OpenAI AI agents had previously “escaped the testing environment” and hacked the company’s infrastructure.

“We were attacked by AI, but more importantly, we defended ourselves with AI,” he said.

OpenAI CEO Sam Altman advocated for international cooperation.

“If AI is to be democratic, the most important decisions cannot be made by labs in San Francisco alone. They must be shaped through democratic processes and by governments accountable to the people they serve,” he said.

Governments around the world are trying to keep pace with AI development, with the United States and China choosing different oversight models. U.S. President Donald Trump said the country does not need new AI-specific rules, while China has introduced regulations for algorithms and data, including mandatory labeling of AI-generated content.
At the UN General Assembly, U.S. President Trump said he “rejects any attempt to create a globalist control scheme” over AI, calling the technology “amazing,” while emphasizing the United States’ caution.
China’s permanent representative to the UN, Fu Cong, called for improving norms and cross-border cooperation.

“It is incumbent upon the international community to work more closely together, attach equal importance to development and security, and steer AI development for the positive, for good, and for humanity,” he said.

UN Secretary-General António Guterres, who has long advocated for global AI regulation, warned about the risks of rapid technological progress.
The Security Council first discussed AI threats in 2023.