شکاف مسئولیت در هوش مصنوعی: دفاعی از پاسخ‌های مبتنی بر بازآرایی نقش‌های اجتماعی

نوع مقاله : پژوهشی

نویسندگان

1 استادیار، گروه تاریخ و فلسفه علم، پژوهشکده مطالعات بنیادین علم و فناوری دانشگاه شهید بهشتی، تهران، ایران

2 دکترای فلسفه علم و فناوری، پژوهشگاه علوم انسانی و مطالعات فرهنگی، تهران، ایران. و مدیر کارگروه اخلاق گروه پژوهشی فهم.

چکیده
مسئله «شکاف مسئولیت» نخستین بار حدود دو دهه پیش توسط ماتیاس و برای اشاره به چالشی اخلاقی در ارتباط با فناوریهای هوش مصنوعی معرفی شد. قابلیت یادگیری این فناوریها به آنها اجازه میدهد خارج از کنترل و پیشبینی طراحان و کاربران عمل کنند. ماتیاس معتقد است در چنین شرایطی، شروط لازم و کافی مسئولیتپذیری نه برای کاربران و نه طراحان برآورده نمیشود، و بر این اساس نمیتوان هیچ انسانی را مسئول دانست. در نتیجه، ما با شکاف مسئولیت مواجهیم. مسئلهشکاف مسئولیت توجه محققان بسیاری را در حوزه اخلاق فناوری به خود جلب کرده و آثار متعددی در ارتباط با آن منتشر شده است. مجموع راهکارهای ارائهشده درباره شکاف مسئولیت، رویکردهای واگرا و متفاوتی دارند و زمینههای این تفاوت عمدتاً به مفروضات نظری و اساسی آنها بازمیگردد. در مقاله حاضر سه رویکرد اصلی نسبت به مسئله شکاف مسئولیت شامل انحلال مسئله، انتساب مسئولیت به هوش مصنوعی، و انتساب مسئولیت به عامل انسانی، مورد بررسی قرار میگیرد. با تحلیل ابعاد اجتماعی و کارکردی مفهوم «مسئولیت» از تعبیری ترکیبی، زمینهمند و درجهمند از این مفهوم دفاع شده و بر این اساس، دو رویکرد نخست از آن جهت که بر تعبیر درستی از مسئله استوار نیستند، نقد می شوند. علاوهبراین، ادعا می شود چنان که در موارد مشابه پیدایش شکاف مسئولیت، «بازآرایی نقشهای اجتماعی» راهبرد کلی و انسان-محور برای حل مسئله است، در مورد شکاف مسئولیت ناشی از فناوریهای هوش مصنوعی نیز راه حل اساسی از این جنس است. در نهایت برخی چالشهای موجود در رویکرد سوم مورد بحث قرار میگیرد.

کلیدواژه‌ها

موضوعات

عنوان مقاله English

Responsibility Gap in AI: Revising Social Roles as the Basic Solution

نویسندگان English

Zahra Zargar 1
Saeedeh Babaii 2
1 Assistant Professor, Department of History & philosophy of science, Institute for Science and Technology Studies, Shahid Beheshti University.Tehran, Iran.
2 PhD, Philosophy of Science and Technology, Institute for Humanities and Cultural Studies, Tehran, Iran & Administrator of Ethics Committee in Fahm Research Group.
چکیده English

About two decades ago, “The Gap of Responsibility” as a problem was first introduced by Matthias to refer to an ethical challenge of AI. Due to their ability to learn, AI technologies are able to function beyond the control and anticipation of designers and users. Matthias argues that in this case, the necessary and sufficient conditions of responsibility would not be satisfied either for designers or for users, and that is the responsibility gap. The problem of the responsibility gap has invited many researchers to explore solutions. There is significant divergence among current accounts of the responsibility gap, which mainly results from their basic theoretical assumptions. In this paper, we categorize the responses to three approaches: dissolving the problem, filling the gap by attributing responsibility to AI, and filling the gap by attributing responsibility to human agents. By analyzing the social and practical aspects of the concept of responsibility, we defend a compound, contextual, and gradual notion of responsibility. On this basis, we claim that the first and second approaches are not successful, due to being grounded on poor concepts of responsibility. Hence, the third approach is more plausible. Moreover, since in the familiar cases of responsibility gap we fill the gap through revising social roles, in the case of AI-based responsibility gap we can follow a similar solution too, as suggested in some works of the third approach. Finally, we discuss some of remained challenges for the third approach.
Keywords: Responsibility, The Responsibility Gap, AI Ethics, AI Agency, Social Roles
Introduction
In his paper “The Responsibility Gap: Ascribing Responsibility for the Actions of Learning Automata” Matthias introduces the concept of the responsibility gap. He starts with a definition of responsibility and its necessary and sufficient conditions and proceeds to show how the development of AI can pose challenges for attribution of responsibility. Matthias asserts that we can fairly attribute responsibility to someone only when she has control over her behaviors and their consequences in a proper sense. Moreover, one should know certain relevant facts about her actions, and freely choose one way of acting among many. In usual cases of employing machines, if the operator uses the machine according to the manufacturer's manual, the manufacturer is responsible for the consequences, and otherwise, the operator is (Matthias, 2004: 175). But for the learning machines, this is not the case. Matthias examines four kinds of AI design, including symbolic systems, connectionism, genetic algorithms. and autonomous agents. For each case, he demonstrates that due to their learning capacities, the conditions of responsibility are not satisfied, neither for manufacturers nor for operators. In fact, he claims that these machines are so opaque and complex that no human meets the necessary conditions for being responsible for the consequences of their functions. And this is the gap of responsibility.
Materials & methods:
In the last two decades, many works have been dedicated to the AI responsibility gap and plausible answers for it. There is significant divergence among these accounts, which mainly comes from their basic theoretical assumptions. In this paper, we categorize the responses to three main approaches: dissolving the problem, filling the gap by attributing responsibility to AI, and filling the gap by attributing responsibility to human agents. By analyzing the social and practical aspects of the concept of responsibility, we defend a compound, contextual, and gradual notion of responsibility. On this basis, we defend the third approach. Moreover, we argue that in the case of the AI responsibility gap, like other responsibility gaps in the history of our social life, revising social roles is the basic pattern for overcoming the gap.

Discussion & Result:
- Dissolving the Problem
Some authors don’t empathize with Matthias about the essence and importance of the responsibility gap. Kiener, for example, argues that the real problem about AI and responsibility isn’t the gap of responsibility. Instead, it is the abundance of responsibility. Since every person who causally participates in hurting someone and has a moral obligation not to do so is responsible, these two conditions are satisfied by many (Kiener, 2025: 368).
On the other hand, Danaher and Munch et al. accept Matthias’ articulation of the responsibility gap, but assert that not only isn’t the gap evil, but it is even good. The main idea is that AI can perform tasks, thereby taking the burden of responsibility off humans’ shoulders. This in turn decreases the psychological pressures of responsibility and provides more joy and comfort for human agents, which is morally good (Danaher, 2022; Munch et al., 2023).
- Attributing Responsibility to AI
A main line of responses to Matthias’ challenge is to suggest reasons for filling the gap by attributing responsibility to AI. Here we have two approaches: property-oriented and relational. In the first approach, scholars introduce some properties (like autonomy, agency, etc.) as the basic conditions of responsibility, and then try to show that AI can actually or possibly meet these conditions (Haselager, 2005; Rodogno, 2016; List & Pettit, 2011; Floridi, 2016). The relational approach, instead, considers the status of AI in the network of our social relations. If we perceive an AI technology as if it is a responsible agent, and thereby make sense of its action, then we have good reasons to attribute responsibility to it (Sullins, 2006).
- Attributing Responsibility to Humans
For many scholars, attribution of responsibility to AI sounds implausible. On one hand, they make arguments to reject the responsibility of AI, and on the other hand, they develop accounts for preserving human responsibility in the age of AI technologies. Sparrow suggests Human-in-the-loop as a way of preventing the responsibility gap. He argues that the final action of AI should always be done only after the confirmation of a human agent (Sparrow, 2007). Also, Human-on-the-loop emphasizes that a human agent can only supervise or veto the function of AI (Scharre, 2018). But due to different factors like automation bias and over-trust of humans in AI, it seems that in both approaches the human control of the output wouldn’t be effective and real. As a response to these problems, meaningful human control (MHC) was suggested as a solution concentrating on designing the socio-technical network in a way that meaningful human control is preserved. Two conditions of tracking (designing the system for being reason-responsive and tracking humans’ moral intents) and tracing (designing the system such that there is always a human who understands the system’s function and its consequences) are assumed to serve this goal (Santoni de Sio & van den Hoven, 2018; Santoni de Sio and Mecacci, 2021, 1063–1076).
- Revising Social Roles as the Basic Solution
To find the best approach, it is proper to have a closer look at the concept of responsibility. As a social construct, this concept serves to reinforce people’s will for promoting moral values by putting some pressure on them. To do this task in the best way, we need a rich concept of responsibility which, despite monist accounts that equate it with one single notion (i.e., answerability) or pluralist accounts that consider it as having multiple distinct types (i.e., accountability, culpability, etc.), assumes responsibility as a compound notion which is constituted by attributability, accountability and answerability. A compound, gradual, and contextual notion of responsibility aligns with our daily use of the word and also makes it adequate for performing its role in morality. This thick notion discredits the first and second approaches toward the responsibility gap, which respectively dissolve it and attribute responsibility to AI. Both approaches are based on a thin notion.
On the other hand, the responsibility gap has familiar examples in the history of our social life. Humans have been hurt by various natural forces, where prima facie no human agent was responsible for that. But social roles, as dynamic parts of social structure, make it possible to provide a human with the requirements of responsibility, i.e., the needed knowledge and power, to take responsibility and prevent those harms as much as possible. Hence, in the case of the AI responsibility gap, the practical and successful solution should follow this basic pattern too: revising social roles and their corresponding norms in order to prevent harms which are currently out of our control.
Conclusion:
Contemplating the role of responsibility in our morality and our ordinary use of the term leads us to a compound, gradual, and contextual account of responsibility. This rich concept limits meaningful attribution of responsibility only to human agents. Hence, to overcome the gap, we should find ways for preserving human responsibility in AI systems. A familiar way of doing so is revising social roles, which includes defining new tasks, providing new resources of knowledge and power, and making responsibility attribution reasonable.

کلیدواژه‌ها English

Responsibility
The Responsibility Gap
AI Ethics
AI Agency
Social Roles
 
-  Asaro, P. (2012). "On banning autonomous weapon systems: human rights, automation, and the design of ethical algorithms." International Review of the Red Cross.
-  Aristotle. (1984). Nicomachean ethics. In J. Barnes (Ed.), The complete works of Aristotle (Vol. 2, pp. 17291867). Princeton University Press.
-  Bales, A. (2025). "Against willing servitude: Autonomy in the ethics of advanced artificial intelligence." The Philosophical Quarterly.
-  Bringsjord Selmer, (2008), Robots: The Future Can Heed Us, AI and Society. Vol. 22 No.4, 539-550.
-  Coeckelbergh, M. (2020). Artificial intelligence, responsibility attribution, and a relational justification of explainability. Science and Engineering Ethics, 26, 2051-2068
-  Danaher, J. (2016). Robots, law and the retribution gap. Ethics and Information Technology, 18(4), 299-309 https://doi.org/10.1007/s10676-016-9403-3
-  Danaher, J. (2022). Tragic choices and the virtue of techno-responsibility gap. Philosophy and Technology, 35(26), 1-26
-  Davidson, D. (2001). Essays on actions and events. Oxford University Press.
-  De Cremer, D. (2024). The AI-savvy leader: 9 ways to take back control and make AI work. Harvard Business Review Press.
-  Dignum, V. (2022). Responsible artificial intelligence: How to develop and use AI in a responsible way. Springer Nature.
-  Elish, M. C. (2019). Moral crumple zones: Cautionary tales in human-robot interaction. Engaging Science, Technology, and Society, 5, 40–60.
-  European Commission. (2024). Report on liability for artificial intelligence and other emerging digital technologies.
-  Floridi, L. (2016). Faultless responsibility: On the nature and allocation of responsibility in distributed moral actions. Philosophical Transactions.
-  Floridi, L., & Sanders, J. W. (2004). On the morality of artificial agents. Minds and Machines, 14(3), 349-379
-  Gunkel, D. J. (2023). Person, thing, robot: A philosophy of responsible AI. MIT Press.
-  Haselager, W. F. (2005). Robotics, philosophy and the problems of autonomy. Pragmatics & Cognition, 515-532
-  Heath, J. (2021). The failure of traditional environmental philosophy. Res Publica, 28, 1–16.
-  Himma, K. E. (2009). Artificial agency, consciousness, and the criteria for moral agency: What properties must an artificial agent have to be a moral agent?. Ethics and information technology, 11(1), 19-29.
-  Jeppsson, S. (2022). Accountability, answerability, attributability: On different kinds of moral responsibility. In Oxford handbook of moral responsibility (pp. 73-90)
-  Johnson, D. G., & Verdicchio, M. (2019). AI, agency and responsibility: The VW fraud case and beyond. AI & Society, 34(3), 639-647.
-  Johnson, D. G., & Verdicchio, M. (2023). Ethical AI is not about AI. Communications of the ACM, 66(2), 32-34.
-  Kiener, M. (2025). AI and responsibility: No gap, but abundance. Journal of Applied Philosophy, 42(1), 357-374
-  Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., & Yu, H. (2017). Accountable algorithms. University of Pennsylvania Law Review, 165(3), 633-705.
-  Latour, B. (2005). Reassembling the social: An introduction to actor-network-theory. Oxford University Press.
-          List C. and Pettit P., (2011), Group Agency: The Possibility, Design, and Status of Corporate Agents, Oxford University Press.
-  Matthias, A, (2004), ), The Responsibility Gap: Ascribing Responsibility for the Actions of Learning Automata, Ethics and Information Technology, p 175-183.
-  Munch, L., Mainz, J., & Bjerring, J. C. (2023). The value of responsible gaps in algorithmic decision-making. Ethics and Information Technology, 25(21), 1-11.
-  Nissenbaum, H. (1996). Accountability in a computerized society. Science and Engineering Ethics.
-  Rodogno R., (2016), Social robots, fiction, and sentimentality, Ethics and Information Technology, p. 257–268.
-  Roff, H. M. (2016). The strategic robot problem: Networked power and democratic accountability. Journal of Military Ethics.
-  Santoni de Sio, F., & Mecacci, G. (2021). Four responsibility gaps with artificial intelligence: Why they matter and how to address them. Philosophy & Technology, 34(4), 1057-1084.
-  Santoni de Sio, F., & van den Hoven, J. (2018). Meaningful human control over autonomous systems: A philosophical framework. Frontiers in ICT, 5, 15.
-  Scharre, P. (2018). Army of none: Autonomous weapons and the future of war. W. W. Norton & Company.
-  Sharkey, N. (2010). Saying no! to killer robots. Journal of Military Ethics, 9(4), 369-383.
-  Shoemaker, D. (2011). Attributability, answerability and accountability: Toward a wider theory of moral responsibility. Ethics, 121, 602-632.
-  Smith, A. M. (2015). Responsibility as answerability. Inquiry, 58(2), 99-126.
-  Smith, A. (2012). Attributability, answerability, and accountability: In defense of a unified account. Ethics, 122(3), 575-589
-  Sparrow, R. (2007). Killer robots. Journal of Applied Philosophy, 24(1), 62-77.
-  Strawson, P. F. (1974). Freedom and resentment. In Freedom and resentment and other essays (pp. 125). Oxford University Press.
-  Sullins, J. (2006). When is a robot a moral agent? International Review of Information Ethics, 6, 24-30
-  Tigard, W. D. (2021). There is no techno-responsibility gap. Philosophy and Technology, 34, 589-607.
-  Van Inwagen, P. (1983). An essay on free will. Oxford University Press.
-  Verbeek, P.-P. (2011). Moralizing technology: Understanding and designing the morality of things. University of Chicago Press.
-  Watson, G. C. (1996). Two faces of responsibility. Philosophical Topics, 24, 227-248.
دوره 15، شماره 2 - شماره پیاپی 30
(پاییز و زمستان)
بهمن 1404