NSF Award
0500133
Research concerning the relationship between technology and ethics has largely focused on responsible and irresponsible use of technology by human beings, with a few people being interested in how human beings ought to treat machines. In all cases, only human beings have engaged in ethical reasoning. The PIs believe the time has come to add an ethical dimension to at least some machines. Recognition of the ethical ramifications of behavior involving machines, and recent and potential developments in machine autonomy, necessitate this. In this project, the PIs will explore this dimension through investigation of what has been called machine ethics, which (in contrast to computer hacking, software property issues, privacy issues and other topics normally ascribed to computer ethics) is concerned with the consequences of behavior of machines towards human users and other machines. Clearly, relying on machine intelligence to effect change in the world without some restraint can be dangerous. Until fairly recently, the ethical impact of a machine's actions has either been negligible (e.g., a calculator) or, when considerable, has only been taken under the supervision of a human operator (e.g., robotic automobile assembly). As we increasingly rely upon machine intelligence with reduced human supervision, we will need to be able to count on a certain level of ethical behavior from them. And as machines are given more responsibility, an equal measure of accountability for their actions must be meted out to them if we are to avoid undesirable machine behavior. In this project, the PIs will implement prototype systems in limited domains, one that incorporates an ethical dimension to its advantage, and another that learns weights of competing duties to the end of providing a decision procedure for an ethical theory. The PIs hope these investigations will sharpen their understanding of the field, so that they can compose a well-argued position paper that clarifies the objectives of and answers objections to machine ethics, as a first step towards dealing with an issue that has been of concern since the beginning of the 20th century but has seen little serious scientific effort. <br/><br/>Broader Impacts: The PIs will develop a machine ethics website, and will organize a AAAI Machine Ethics symposium tentatively planned for fall 2005. The outcomes of this research will contribute to the development of autonomous intelligent agents that could be used to replace human effort in many subservient, dangerous, or undesirable tasks. In the longer run, an ethical dimension in machines could be used to alert humans who rely on machines before they do something that is ethically questionable, averting harm that might have been caused otherwise. Such capabilities might be harnessed to assist us in ethical decision-making; machine-machine relationships might also benefit, in that the new capabilities could provide a basis for resolving resource conflicts or predicting behavior of other machines. Perhaps most importantly, the behavior of more fully autonomous machines, guided by an ethical dimension, might be more socially acceptable in real-world environments than that of machines without such a dimension.
