Metamorphic Testing For Machine Learning: Applicability, Challenges, and Research Opportunities

dc.contributor.authorRehman, Faqeer Ur
dc.contributor.authorSrinivasan, Madhusudan
dc.date.accessioned2024-01-18T18:37:12Z
dc.date.available2024-01-18T18:37:12Z
dc.date.issued2023-07
dc.descriptioncopyright IEE International Conference on Artificial Intelligence Testing (AITest)en_US
dc.description.abstractThe wide adoption and growth of Machine Learning (ML) have made tremendous advancements in revolutionizing a number of fields i.e., manufacturing, transportation, bio-informatics, and self-driving cars. Its ability to extract patterns from a large set of data and then use this knowledge to make future predictions is beyond the human imagination. However, the complex calculations internally performed in them make these systems suffer from the oracle problem; thus, hard to test them for identifying bugs in them and enhancing their quality. An application not properly tested can have disastrous consequences in the production environment. Metamorphic Testing (MT) has been widely accepted by researchers to address the oracle problem in testing both supervised and unsupervised ML-based systems. However, MT has several limitations (when used for testing ML) that the existing literature lacks in capturing them in a centralized place. Applying MT to test ML-based critical systems without prior knowledge/understanding of those limitations can cost organizations a waste of time and resources. In this study, we highlight those limitations to help both the researchers and practitioners to be aware of them for better testing of ML applications. Our efforts result in making the following contributions in this paper, i) providing insights into various challenges faced in testing ML-based solutions, ii) highlighting a number of key challenges faced when applying MT to test ML applications, and iii) presenting the potential future research opportunities/directions for the research community to address them.en_US
dc.identifier.citationRehman, F. U., & Srinivasan, M. (2023, July). Metamorphic Testing For Machine Learning: Applicability, Challenges, and Research Opportunities. In 2023 IEEE International Conference On Artificial Intelligence Testing (AITest) (pp. 34-39). IEEE.en_US
dc.identifier.urihttps://scholarworks.montana.edu/handle/1/18266
dc.language.isoen_USen_US
dc.publisherIEEEen_US
dc.rightscopyright IEEE 2023en_US
dc.subjectmetamorphic testingen_US
dc.subjectmachine learningen_US
dc.subjectapplicabilityen_US
dc.subjectresearch opportunitiesen_US
dc.titleMetamorphic Testing For Machine Learning: Applicability, Challenges, and Research Opportunitiesen_US
dc.typeArticleen_US
mus.citation.extentfirstpage1en_US
mus.citation.extentlastpage6en_US
mus.citation.journaltitle2023 IEEE International Conference On Artificial Intelligence Testing (AITest)en_US
mus.identifier.doi10.1109/AITest58265.2023.00014en_US
mus.relation.collegeCollege of Engineeringen_US
mus.relation.departmentComputer Science.en_US
mus.relation.universityMontana State University - Bozemanen_US

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
rehman-machine-2023.pdf
Size:
133.59 KB
Format:
Adobe Portable Document Format
Description:
metamorphic testing

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Copyright (c) 2002-2022, LYRASIS. All rights reserved.