All NewsEducationTVBrokers
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
All NewsHome
← Back to AI & Technology

UN rights chief warns AI poses 'existential' risk to humanity

Created at 7 Sep · 8:53 AM1 source↑ Market-relevant
IN SHORT

United Nations High Commissioner for Human Rights Volker Turk warned that artificial intelligence could become powerful enough to threaten humanity, urging companies to implement robust safety measures and calling for global regulatory frameworks.

Key Numbers

80th sessionGeneral Assembly session

Who's Involved

Volker Turk
UN High Commissioner for Human Rights
António Guterres
UN Secretary-General
Yejin Choi
Senior Fellow at Stanford University’s Institute for Human-Centered Artificial Intelligence
Lee Jae Myung
President of the Republic of Korea
UN rights chief warns AI poses 'existential' risk to humanity

↳ Why This Matters

The warnings from top UN officials underscore the growing global concern over the potential risks of advanced artificial intelligence, urging immediate action to establish safety protocols and regulatory frameworks to prevent catastrophic outcomes and ensure AI development aligns with human rights.

Key facts

  • UN High Commissioner for Human Rights Volker Turk warned that advanced artificial intelligence could pose an existential risk to humanity.
  • Turk called for immediate and comprehensive measures to ensure the safety and security of AI systems.
  • UN Secretary-General António Guterres has previously cautioned against AI making decisions that affect humanity's fate.
  • Guterres cited concerns about AI weaponization, deepfakes, and the potential for AI to destabilize international peace and security.
  • Turk stressed the need for AI development to be grounded in human rights, transparency, accountability, and inclusion.
  • He urged companies to conduct human rights impact assessments for their AI products and to address bias and discrimination.
  • United Nations High Commissioner for Human Rights Volker Turk has warned that artificial intelligence could pose an existential threat to humanity, urging for robust safety measures and global regulatory frameworks.

    Speaking at the UN Human Rights Council in Geneva, Turk stated his concerns, echoing those of industry insiders, that advanced AI might become powerful enough to endanger humankind. He called for an "all-out effort" to implement "cast iron guarantees" around AI safety and security before it is too late.

    This warning follows similar sentiments expressed by UN Secretary-General António Guterres to the Security Council. Guterres cautioned that AI is rapidly transforming daily life, the information space, and the global economy, and stressed that humanity's fate cannot be left to algorithms. He highlighted the potential for AI to be weaponized, citing AI-enabled targeting in conflicts, cyberattacks, and the proliferation of deepfakes that can fuel polarization and derail diplomacy.

    Guterres advocated for maintaining human control over the use of force, establishing coherent global regulatory frameworks, protecting information integrity, and closing the "AI capacity gap" between developed and developing nations. He reiterated his call for a ban on lethal autonomous weapons systems operating without human control and insisted that decisions regarding nuclear weapons must remain with humans.

    Turk further emphasized that AI must be developed based on risk assessments and a human rights framework, ensuring transparency, accountability, and inclusion. He called for companies to conduct human rights impact assessments for their AI designs and deployments, and highlighted the risks of bias and discrimination stemming from data collection and development imbalances, particularly concerning vulnerable groups and minorities.

    Frequently asked questions

    UN officials are concerned that advanced artificial intelligence could pose an existential risk to humanity and must not be left to decide humanity's fate.

    Guterres points to AI weaponization, AI-enabled targeting in conflicts, cyberattacks on critical infrastructure, and deepfakes that can fuel polarization or derail diplomacy.

    Priorities include maintaining human control over the use of force, building global regulatory frameworks, protecting information integrity, and closing the AI capacity gap between rich and poor nations.

    Turk recommends that companies conduct human rights impact assessments when designing, rolling out, and marketing AI tools.

    What Happens Next

    01Volker Turk will urge companies to reduce AI risks in the coming days.
    02A global dialogue on AI governance is scheduled to take place in New York on Thursday.
    03The UN aims to conclude a legally binding instrument on lethal autonomous weapons systems by next year.
    CME Headlines
    • Risk Management and Monitoring Notice: Multi-Factor Authentication Updates - September 12
      3 Sep · 5:00 AM

    How It Developed

    UN rights chief Volker Turk warned that advanced AI could pose an existential risk to humanity.
    Turk called for an "all-out effort" to ensure AI safety and security before it is too late.
    UN Secretary-General António Guterres previously warned the Security Council that AI must not decide humanity's fate.
    Guterres highlighted risks including AI-enabled targeting in conflicts, cyberattacks, and deepfakes that fuel polarization.
    Guterres called for a ban on lethal autonomous weapons systems operating without human control.
    Turk emphasized that AI must be developed on the basis of risk assessments and a human rights framework.
    He urged companies to conduct human rights impact assessments when designing and rolling out AI tools.
    Turk also highlighted the risks of bias and discrimination in AI due to data collection and development imbalances.

    Sources

    T1
    AI could pose ‘existential’ risk to humanity, UN rights chief warnsReuters
    T2
    AI could pose 'existential risk to humanity': UN rights chiefinsiderpaper.com
    T2
    AI must not decide humanity's fate, UN chief warns Security Councilnews.un.org
    T2
    UN rights chief: AI must be based on inclusivity ... - UN Newsnews.un.org

    Related Stories

    OpenAI reports German website hijack to EU Commission
    7 Sep · 10:59 AM
    China readies humanoid robots for combat, military documents reveal
    7 Sep · 6:07 AM
    AI won't replace designers, industry leaders say
    7 Sep · 4:37 AM
    China's AI Ambitions and South Korea's Deepfake Crisis
    7 Sep · 5:05 AM
    Argentina's Patagonia attracts tech giants for massive data centers
    7 Sep · 10:06 AM