The transition of machines to autonomous R&D radically changes the risk profile of the entire industry. Synchronously with Anthropic’s report, an alliance comprising Google DeepMind, Schmidt Sciences, and ARIA announced the creation of a $10 million grant fund to study the safety of multi-agent systems. Basic alignment no longer works when millions of autonomous AI agents begin to communicate, trade, and write code for each other without human intervention. The industry is desperately seeking mathematical proofs of safety for systems whose architectures developers can no longer fully comprehend.
Source: Anthropic / Google DeepMind
ResearchAnthropicDeepMindAI SafetyAgentic AI