Advances in the Standards & Applied Sciences

Advances in the Standards & Applied Sciences

Prioritizing AI Standards: Integrating Requirements and Expert Criteria

Document Type : Original Article

Authors
1 Faculty of Strategic Management of Cyberspace, Supreme National Defense University, Tehran, Iran
2 Supreme National Defense University, and researcher at Innovation, ICT research Institute, Iran
Abstract
As artificial intelligence (AI) continues to advance in various aspects of our society, the need for explicit and comprehensive standards governing the development, deployment, and use of AI is gaining increasing importance. Establishing high priority standards in the field of AI is crucial to ensure responsible and ethical acceptance of this transformative technology. Numerous international standards have been developed in the field of AI. However, prioritizing these standards and assessing their alignment with the existing requirements from domestic stakeholders in standardization is necessary for their utilization in national contexts. To address this, adopting a multidimensional approach is necessary for classifying AI standardization based on various criteria and the inherent priority of their respective domains. By considering the preferences of the stakeholders, it becomes possible to rank and prioritize AI standards. In this study, drawing inspiration from the method proposed by the European Union for prioritizing AI standards, a systematic approach has been employed. This approach is based on expert criteria and indicators extracted by text mining in the standards. Ultimately, we have identified and introduced high-priority standards to serve as important references in the development of national standards.
Keywords
Subjects

[1]     E. Blasch, J. Sung, T. Nguyen, C. Daniel, and A. Mason, "Artificial Intelligence Strategies for National Security and Safety Standards," 11/07 2019.
[2]     Laux, Johann and Wachter, Sandra and Mittelstadt, Brent, Three Pathways for Standardisation and Ethical Disclosure by Default under the European Union Artificial Intelligence Act (February 20, 2023). Available at SSRN: https://ssrn.com/abstract=4365079 or http://dx.doi.org/10.2139/ssrn.4365079
[3]     Zielke, T. (2020). Is artificial intelligence ready for standardization?. In Systems, Software and Services Process Improvement: 27th European Conference, EuroSPI 2020, Düsseldorf, Germany, September 9–11, 2020, Proceedings 27 (pp. 259-274). Springer International Publishing.
[4]     Roberts, H., Cowls, J., Morley, J. et al. The Chinese approach to artificial intelligence: an analysis of policy, ethics, and regulation. AI & Soc 36, 59–77 (2021). https://doi.org/10.1007/s00146-020-00992-2
[5]     Ebers, Martin, Standardizing AI - The Case of the European Commission's Proposal for an Artificial Intelligence Act (August 6, 2021). The Cambridge Handbook of Artificial Intelligence: Global Perspectives on Law and Ethics, Available at SSRN: https://ssrn.com/abstract=3900378 or http://dx.doi.org/10.2139/ssrn.3900378
[6]     A. HLEG, "ETHICS GUIDELINES FOR TRUSTWORTHY AI," High-Level Expert Group on AI2019.
[7]     Um, T.-W., Kim, J., Lim, S., & Lee, G. M. (2022). Trust Management for Artificial Intelligence: A Standardization Perspective. Applied Sciences, 12(12), 6022. MDPI AG. Retrieved from http://dx.doi.org/10.3390/app12126022
[8]     W. Wahlster and C. Winterhalter, "German standardization roadmap on artificial intelligence," German Institute for Standardization and DKE German Commission for Electrical, Electronic & Information Technologies of DIN and VDE November, 2020
[9]     Ziegler, W. (2020). A Landscape Analysis of Standardisation in the Field of Artificial Intelligence. Journal of ICT Standardization, 8(2), 151–184. https://doi.org/10.13052/jicts2245-800X.824
[10] AI Standards Hub, The Alan Turing Institute, accessed July 19, 2023 <https://aistandardshub.org/>
[11] Miller, G. J. (2022). Stakeholder roles in artificial intelligence projects. Project Leadership and Society, 3, 100068
[12] "Discerning signal from noise:  The state of global AI standardization and what it means for Canada," Schwartz Reisman Institute for Technology and Society at the University of Toronto 2023.
[13] Jenkins, G. M., &Youle, P. V. (1968). A systems approach to management. Journal of the Operational Research Society, 19(sup1), 5-21.
[14] J. Soler Garrido et al., "AI Watch: Artificial Intelligence Standardisation Landscape Update," 2023, issue 1831-9424 (online)
[15] Applying AI: How to find and prioritize AI use cases, Applied AI
[16] Fisher, S., Rosella, L.C. Priorities for successful use of artificial intelligence by public health organizations: a literature review. BMC Public Health 22, 2146 (2022). https://doi.org/10.1186/s12889-022-14422-z
[17] Safari, E., & Ebrahimi, K. (2022). Prioritizing application areas to deploy artificial intelligence technology using thematic analysis and COPRAS. Production and Operations Management, 13(4), 91-110. doi: 10.22108/pom.2023.134630.1457
[18] BMWi, StrategieKünstlicheIntelligenz der Bundesregierung. Berlin, 2018. (June 25, 2023). Available at: www.ki-strategie-deutschland.de
[19] Murphy, B., & Lead, C. T. (Eds.). (2020). Artificial Intelligence Security Standardization White Paper (2019 Edition).
[20] Bosnić, Z., &Kononenko, I. (2009). An overview of advances in reliability estimation of individual predictions in machine learning. Intelligent Data Analysis, 13(2), 385-401.
[21] Saria, S., & Subbaswamy, A. (2019). Tutorial: safe and reliable machine learning. arXiv preprint arXiv:1904.07204.
[22] Lechterman, Theodore M. (Forthcoming). The concept of accountability in ai ethics and governance. In J. Bullock, Y.C. Chen, J. Himmelreich, V. Hudson, A. Korinek, M. Young, and B. Zhang (Eds.), The Oxford handbook of AI governance. Oxford University Press.
[23] Unsworth, H., Wolfram, V., Dillon, B., Salmon, M., Greaves, F., Liu, X., ... & Weller, A. (2022). Building an evidence standards framework for artificial intelligence-enabled digital health technologies. The Lancet Digital Health, 4(4), e216-e217.
[24] Baxter, S. L., & Lee, A. Y. (2021). Gaps in standards for integrating artificial intelligence technologies into ophthalmic practice. Current Opinion in Ophthalmology, 32(5), 431-438.
[25] Siebert, J., Joeckel, L., Heidrich, J. et al. Construction of a quality model for machine learning systems. Software Qual J 30, 307–335 (2022). https://doi.org/10.1007/s11219-021-09557-y.
[26] Manning, C. D. (2009). An introduction to information retrieval. Cambridge university press.
[27] Mitchell, R. K., Agle, B. R., & Wood, D. J. (1997). Toward a theory of stakeholder identification and salience: Defining the principle of who and what really counts. Academy of management review, 22(4), 853-886.