Autonomous Military Technology at a “Tipping Point”
Autonomous military technologies that are capable of independently selecting a course of action to achieve a goal are maturing rapidly, the Defense Science Board said in a newly published study.
“Autonomy, fueled by advances in artificial intelligence, has attained a ‘tipping point’ in value,” the DSB study said.
“Autonomy will deliver substantial operational value–in multiple dimensions–across an increasingly broad spectrum of DoD missions, but the DoD must move more rapidly to realize this value. Allies and adversaries alike also have access to increasingly rapid technological advances occurring globally,” the study said.
The Board recommended that the Department of Defense undertake a series of pilot projects “intended to demonstrate the range of benefits of autonomy for the warfighter.”
The Board did not consider catastrophic failures modes associated with autonomous technologies in any depth.
But the study did say that “an autonomous system must be designed so that humans (and/or machines) can straightforwardly determine whether, once it has been deployed, it is operating reliably and within its envelope of competence — and, if not, that appropriate action can be taken.”
See Summer Study on Autonomy, Defense Science Board, June 2016.
We are excited to engage in a productive and collaborative partnership with IAM, with the goal of fostering a positive and mutually beneficial working environment for all FAS employees.
Incentive prizes moved from a tool used primarily outside of the federal government to one used commonly across federal agencies, due to a concerted, multi-pronged effort led by policy entrepreneurs and incentive prize practitioners in the EOP and across federal agencies, with bipartisan congressional support.
NIST’s guidance on “Managing Misuse Risk for Dual-Use Foundation Models” represents a significant step forward in establishing robust practices for mitigating catastrophic risks associated with advanced AI systems.
If FESI is going to continue to receive Congressional appropriations through DOE, it should be structured from the start in a way that allows it to be as effective as possible while it receives both taxpayer dollars and private support.