Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

A LARGE LANGUAGE MODEL APPROACH TO CLASSIFY FLAKINESS IN C++ PROJECTS

google+
Views: 360                 

Author :  Xin Sun, Daniel Ståhl, and Kristian Sandahl

Affiliation :  Linköping University

Country :  Sweden

Category :  Software Testing

Volume, Issue, Month, Year :  15, ISSN : 223, May, 2025

Abstract :


The role of regression testing in software testing is crucial as it ensures that any new modifications do not disrupt the existing functionality and behaviour of the software system. However, the presence of Flaky Tests undermines the reliability of regression testing results. In this paper, we propose an LLM-based approach for classifying the root cause of identified flaky tests in C++ projects at the code level. We compile a comprehensive collection of C++ project flaky tests sourced from GitHub. We finetune Mistral-7b, Llama2-7b and CodeLlama-7b models on the C++ dataset and an existing Java dataset and evaluate the performance. The results indicate that our models exhibit varying performance on the C++ dataset, while their performance is comparable to that of the Java dataset. Our results demonstrate the exceptional capability of LLMs to accurately classify flakiness in C++ and Java projects, providing a promising approach to enhance the efficiency of debugging flaky tests in practice.

Keyword :  Software testing

Journal/ Proceedings Name :  Computer Science & Information Technology (CS & IT)

URL :  https://airccse.org/csit/V15N10.html

User Name : xxx
Posted 06-06-2025 on 06:56:50 AEDT



Related Research Work

  • Jgghhj
  • Coupling Metrics For Aspect Oriented Software
  • Understanding The Characteristics, Benefits And Challenges Of Agile It Project Management: A Literature Based Perspective
  • Intelligent Unit Level Test Generator For Enhanced Software Quality

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals