UN warns of catastrophic consequences without AI regulation

The gap between the rapid advancement of artificial intelligence (AI) technologies and the lack of effective mechanisms to manage their associated risks could lead to catastrophic consequences, the United Nations's Independent International Scientific Panel on Artificial Intelligence said, according to Report.

It noted that as AI technologies become more advanced, malicious actors exploit them for fraud, social engineering, cyberattacks, disinformation campaigns, financial market manipulation, and even biotechnology-related threats.

UN experts also highlight the lack of scientific guarantees that highly autonomous AI systems will consistently follow human instructions. According to them, laboratory experiments have already documented instances in which such systems violated predefined safety rules in an attempt to avoid being shut down.

At the same time, the experts note that AI has the potential to significantly enhance human capabilities through personalized education, mental health support tools, and assistive technologies.

However, the UN stresses that the safe deployment of these technologies requires effective international governance, independent safety evaluations, and stronger national capacities to assess such systems. Without such safeguards, experts warn, AI could exacerbate inequality, facilitate the exploitation of vulnerable populations, and contribute to the gradual loss of human expertise and cultural heritage.