A/HRC/23/47
may result in a LAR deciding to launch an attack based not merely on incomplete but also
on flawed understandings of the circumstances.52 It should be recognized, however, that this
happens to humans as well.
72.
Proportionality is widely understood to involve distinctively human judgement. The
prevailing legal interpretations of the rule explicitly rely on notions such as “common
sense”, “good faith” and the “reasonable military commander standard.” 53 It remains to be
seen to what extent these concepts can be translated into computer programmes, now or in
the future.
73.
Additionally, proportionality assessments often involve qualitative rather than
quantitative judgements.54
74.
In view of the above, the question arises as to whether LARs are in all cases likely
(on the one hand) or never (on the other) to meet this set of cumulative standard. The
answer is probably less absolute, in that they may in some cases meet them (e.g. in the case
of a weapons system that is set to only return fire and that is used on a traditional
battlefield) but in other cases not (e.g. where a civilian with a large piece of metal in his
hands must be distinguished from a combatant in plain clothes). Would it then be possible
to categorize the different situations, to allow some to be prohibited and others to be
permitted? Some experts argue that certain analyses such as proportionality would at least
initially have to be made by commanders, while other aspects could be left to LARs. 55
D.
Legal responsibility for LARs
75.
Individual and State responsibility is fundamental to ensure accountability for
violations of international human rights and international humanitarian law. Without the
promise of accountability, deterrence and prevention are reduced, resulting in lower
protection of civilians and potential victims of war crimes. 56
76.
Robots have no moral agency and as a result cannot be held responsible in any
recognizable way if they cause deprivation of life that would normally require
accountability if humans had made the decisions. Who, then, is to bear the responsibility?
77.
The composite nature of LAR technology and the many levels likely to be involved
in decisions about deployment result in a potential accountability gap or vacuum.
Candidates for legal responsibility include the software programmers, those who build or
sell hardware, military commanders, subordinates who deploy these systems and political
leaders.
78.
Traditionally, criminal responsibility would first be assigned within military ranks.
Command responsibility should be considered as a possible solution for accountability for
52
53
54
55
56
14
Krishnan, (see note 31 above), pp. 98-99.
Tonya Hagmaier et al, “Air force operations and the law: A guide for air, space and cyber forces”
p. 21, available from http://www.afjag.af.mil/shared/media/document/AFD-100510-059.pdf; Andru
Wall “Legal and Ethical Lessons of NATO‟s Kosovo Campaign” p. xxiii, available from
http://www.au.af.mil/au/awc/awcgate/navy/kosovo_legal.pdf
Markus Wagner “The Dehumanization of International Humanitarian Law: Legal, Ethical, and
Political Implications of Autonomous Weapon Systems” (2012), available from
http://robots.law.miami.edu/wpcontent/uploads/2012/01/Wagner_Dehumanization_of_international_humanitarian_law.pdf note 96
and accompanying text.
Benjamin Kastan “Autonomous Weapons Systems: A Coming Legal „Singularity‟?” University of
Illinois Journal of Law, Technology and Policy (forthcoming 2013), p. 18 and further, available from
http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2037808
Human Rights Watch (see note 7 above), pp. 42-45.
Select target paragraph3
Connect to a paragraph
Connect to an entity
Disable highlights
Add to table of contents