Theses and Dissertations at Montana State University (MSU)
Permanent URI for this collectionhttps://scholarworks.montana.edu/handle/1/733
Browse
21 results
Search Results
Item Improving the effectiveness of metamorphic testing using systematic test case generation(Montana State University - Bozeman, College of Engineering, 2024) Saha, Prashanta; Chairperson, Graduate Committee: Clemente Izurieta; This is a manuscript style paper that includes co-authored chapters.Metamorphic testing is a well-known approach to tackle the oracle problem in software testing. This technique requires source test cases that serve as seeds for the generation of follow-up test cases. Systematic design of test cases is crucial for the test quality. Thus, source test case generation strategy can make a big impact on the fault detection effectiveness of metamorphic testing. Most of the previous studies on metamorphic testing have used either random test data or existing test cases as source test cases. There has been limited research done on systematic source test case generation for metamorphic testing. This thesis explores innovative methods for enhancing the effectiveness of Metamorphic Testing through systematic generation of source test cases. It addresses the challenge of testing complex software systems, including numerical programs and machine learning applications, where traditional testing methods are limited by the absence of a reliable oracle. By focusing on structural, mutation coverage criteria, and characteristics of machine learning datasets, the research introduces strategies to generate source test cases that are more effective in fault detection compared to random test case generation. The proposed techniques include leveraging structural and mutation coverage for numerical programs and aligning random values with machine learning properties for supervised classifier applications. These techniques are integrated into the METTester tool, automating the process and potentially reducing testing costs by minimizing the test suite without sacrificing quality. The thesis demonstrates that tailored source test case generation can significantly improve the fault detection capabilities of Metamorphic Testing, offering substantial benefits in terms of cost efficiency and reliability in software testing.Item Metamorphic relations ranking for reducing testing cost in scientific software(Montana State University - Bozeman, College of Engineering, 2017) Malallah, Safia Abdullhameed; Chairperson, Graduate Committee: Upulee KanewalaLack of automated test oracles is a major challenge faced when testing scientific software. An oracle is a mechanism determine whether test results are correct according to the expected behavior of the program. Metamorphic Testing (MT) is a testing technique that can be used to test such applications. This approach checks relations among multiple inputs and outputs of the program instead of checking the correctness of individual test outputs. Theses relationships are called Metamorphic Relations (MRs) and their violations indicates faults in System Under Test (SUT). Programs have several MRs with different fault detection effectiveness. Thus order in which they apply determines the efficiency of the testing process. Therefore in this work we propose a strategy to prioritize MRs based on their potential fault finding ability. Our strategy uses mutation testing to create a prioratized order of MRs for a given program. We evaluated our proposed approach using machine learning libraries in Weka as well as open source mathematical programs; these results show that our strategy is effective in developing a prioratized order of MRs that maximizes early fault detection. Our results show that in 126 methods we can detect 50.1%-100% faults using 25% of the MRs compared to a random order only detect 1.13%-100%.Item Rapid geometry interrogation for a uniform volume element-based Monte Carlo particle transport simulation(Montana State University - Bozeman, College of Engineering, 1998) Frandsen, Michael WilliamItem Visualizing Monte Carlo computed radiation energy values by using a density emitter(Montana State University - Bozeman, College of Engineering, 1994) Donahue, Brett A.Item Creating realistic images for Visual Analysis based on OpenGL(Montana State University - Bozeman, College of Engineering, 1997) Yue, Daniel YongItem MAXPLANAR : a graphical software package for testing maximal planar subgraph algorithms(Montana State University - Bozeman, College of Engineering, 1996) Zhao, KedanItem A computerized automated rapid weathering apparatus for determining total lime requirements for acid minesoils(Montana State University - Bozeman, College of Agriculture, 1985) Harvey, K. C.Item Support for the camera model(Montana State University - Bozeman, College of Engineering, 1992) Kincses, GaborItem Digital image processing for speckle images(Montana State University - Bozeman, College of Engineering, 1984) Huffman, Rodney D.Item Model implementation and image data compression in a decision support system(Montana State University - Bozeman, College of Engineering, 1997) Wang, Xiaobei
- «
- 1 (current)
- 2
- 3
- »