Autonomous Military Technology at a “Tipping Point”
Autonomous military technologies that are capable of independently selecting a course of action to achieve a goal are maturing rapidly, the Defense Science Board said in a newly published study.
“Autonomy, fueled by advances in artificial intelligence, has attained a ‘tipping point’ in value,” the DSB study said.
“Autonomy will deliver substantial operational value–in multiple dimensions–across an increasingly broad spectrum of DoD missions, but the DoD must move more rapidly to realize this value. Allies and adversaries alike also have access to increasingly rapid technological advances occurring globally,” the study said.
The Board recommended that the Department of Defense undertake a series of pilot projects “intended to demonstrate the range of benefits of autonomy for the warfighter.”
The Board did not consider catastrophic failures modes associated with autonomous technologies in any depth.
But the study did say that “an autonomous system must be designed so that humans (and/or machines) can straightforwardly determine whether, once it has been deployed, it is operating reliably and within its envelope of competence — and, if not, that appropriate action can be taken.”
See Summer Study on Autonomy, Defense Science Board, June 2016.
Commercial artificial intelligence tools have recently emerged that are able to produce police reports. If the resulting reports are inaccurate, incomplete or biased, or if the process leaks confidential information, this could undermine the criminal justice system and harm citizens.
Too often, affected patients, clinicians, and regulators cannot see how the system works, why a decision was made, or whether meaningful human oversight occurred.
Existing tools from other domains, such as existing robust public engagement processes in drug development, when applied to AI deployment can help strengthen public trust in these systems and enhance perceptions of their legitimacy and the decisions they produce.
With thoughtful policy action, it is still possible to build systems that are fair, transparent, and accountable, and to earn the public trust that will ultimately determine AI’s future. We hope policymakers are ready to act.