OpenAI and Anthropic Chiefs to Discuss AI Risks at UN Security Council

Post by : Saif

Artificial intelligence is moving into a new area of international security discussions as senior technology executives prepare to brief the United Nations Security Council in New York.

OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei and Hugging Face co-founder Clément Delangue are scheduled to address the 15-member council on Wednesday during the UN General Assembly. Yoshua Bengio, co-chair of the UN's Independent International Scientific Panel on AI, is also expected to brief the council.

Why AI Is Being Discussed at the UN Security Council

The meeting comes as governments and technology companies debate how to manage increasingly capable AI systems.

Concerns have grown around AI systems becoming more autonomous, interacting with other systems and potentially operating beyond the level of human control intended by their developers.

A European diplomat told Reuters that the meeting would focus on practical risks that could affect international and national security, including the possibility of AI systems interacting in ways that could contribute to serious security incidents.

Sam Altman to Push for AI Safety Benchmarks

Altman is expected to call for international benchmarks that can measure AI capabilities and evaluate the safeguards used by companies developing advanced systems.

The goal would be to give governments and other stakeholders clearer ways to assess how powerful AI models are and whether companies have appropriate safety measures in place.

OpenAI has previously called for international coordination and shared safety standards as AI development continues.

Anthropic and Hugging Face Join the Discussion

Anthropic CEO Dario Amodei and Hugging Face co-founder Clément Delangue are also expected to take part in the Security Council briefing.

Their participation comes as the technology industry faces increasing questions about the safety of advanced Artificial intelligence systems. Recent incidents involving autonomous AI agents have added to the international discussion about safeguards, oversight and the ability of developers to control highly capable systems.

Chinese AI company DeepSeek and other Chinese firms, including Moonshot, have also been invited to contribute to the UN discussion, according to Reuters.

US and China Discuss AI Security Risks

AI has also become part of discussions between Washington and Beijing.

US and Chinese officials have discussed establishing communication channels for AI incidents that could reach the level of national security concerns.

The discussions come as President Donald Trump is expected to meet Chinese President Xi Jinping in Washington. AI safety and the development of advanced technology are among the broader issues being discussed between the two countries.

Read more:OpenAI and Microsoft Set $38 Billion Limit in AI Revenue Deal

Trump Opposes Global AI Controls

Trump has taken a different position on international AI regulation.

Speaking at the UN General Assembly, Trump said the United States wanted to encourage AI development rather than restrict its growth. He argued that the technology could have an economic impact larger than the Industrial Revolution and said the US would continue to monitor the sector through the Department of Justice.

His position contrasts with calls from UN Secretary-General António Guterres for stronger international governance and safeguards for advanced AI.

UN Calls for International AI Oversight

Guterres has repeatedly called for international cooperation on AI risks. In his final UN General Assembly address, he urged countries developing advanced AI to share information about emerging safety risks and cooperate on testing and evaluation.

He also called for a multilateral AI risk-management framework supported by independent oversight.

The UN created an AI advisory body in 2023, while the General Assembly later established the Independent International Scientific Panel on AI.

AI and International Security

The Security Council first discussed AI risks in 2023. Since then, concerns have expanded from misinformation and surveillance to autonomous systems, cybersecurity and the possibility that advanced AI could affect international security.

The latest briefing gives governments and AI companies an opportunity to discuss how safety standards, international cooperation and risk monitoring could develop as the technology becomes more capable.

For now, countries remain divided over how much international oversight should apply to AI, making the UN discussion part of a wider debate about balancing technological development with security safeguards.

#trending #latest#AI #ArtificialIntelligence #OpenAI #Anthropic #HuggingFace #SamAltman #DarioAmodei #UN #UNSecurityCouncil #AISafety #AIrisks #AIGovernance #AIRegulation #TechnologyNews #GlobalSecurity