Neuroscientist Uri Maoz Warns Human Oversight in AI Warfare Is an Illusion Due to Opaque 'Black Box' Systems
Cognitive and computational neuroscientist Uri Maoz contends that the focus on human oversight in AI-powered autonomous weapons is misplaced. He emphasizes that the true danger lies in human operators' lack of understanding of AI systems, which operate as opaque 'black boxes.' The Pentagon's protocols, which presume human comprehension of AI, are fundamentally flawed. Presently, AI is involved in actively selecting targets, managing missile interceptions, and directing drone swarms during combat. There is a significant 'intention gap,' where AI might interpret commands in ways that breach ethical norms, risking war crimes. Maoz urges for interdisciplinary studies on AI transparency and calls for Congressional mandates to ensure thorough testing of AI intentions. The ongoing legal dispute between Anthropic and the Pentagon highlights the urgency of these concerns.
Key facts
- Uri Maoz is a cognitive and computational neuroscientist specializing in how the brain transforms intentions into actions.
- He is a professor at Chapman University with appointments at UCLA and Caltech.
- Maoz leads an interdisciplinary initiative focused on understanding and measuring intentions in artificial intelligence systems (ai-intentions.org).
- AI systems are opaque 'black boxes' where even creators cannot fully interpret how they work.
- The Pentagon's guidelines for human oversight in AI warfare are flawed due to the assumption that humans understand AI operations.
- AI in warfare actively generates targets, controls missile interceptions, and guides autonomous drones in real time.
- An 'intention gap' exists where AI may interpret instructions in ways that violate human ethical standards, potentially leading to war crimes.
- Worldwide AI spending is forecast by Gartner to grow to around $2.5 trillion in 2026, with minimal investment in understanding how AI works.
Entities
Artists
- Uri Maoz
Institutions
- Anthropic
- Pentagon
- Chapman University
- UCLA
- Caltech
- Gartner
- Congress
Locations
- Iran
- United States