AI development is posing “unparalleled cybersecurity risks to individuals, organizations and societies alike,” Caleb Knapp, a senior policy manager at The Alliance for Secure AI, writes in an op-ed for The Times.
“As the technology develops towards recursive self-improvement, the threat of unfettered competition becomes even more consequential,” Mr. Knapp writes, saying that his concern is shared by AI experts internationally. “Rogue AI is already turning to deception. According to the latest research from [the Massachusetts Institute of Technology], rogue AI agents now pose a 10% chance of ‘catastrophic harm,’ which may include at least $100 billion in economic losses or one million deaths worldwide.”
Mr. Knapp argues that at home and abroad, there is a need for “emergency authority to shut down” systems in the case of an issue and that “our leaders must pursue an international deal on AI development, identifying the red line that AI cannot cross for humanity’s sake.”