Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

A Large Language Model Approach to Classify Flakiness in C++ Projects

google+
Views: 391                 

Author :  Xin Sun, Daniel Ståhl and Kristian Sandah

Affiliation :  Linköping University

Country :  Sweden

Category :  Software Engineering & Security

Volume, Issue, Month, Year :  15, 10, May, 2025

Abstract :


The role of regression testing in software testing is crucial as it ensures that any new modifications do not disrupt the existing functionality and behaviour of the software system. However, the presence of Flaky Tests undermines the reliability of regression testing results. In this paper, we propose an LLM-based approach for classifying the root cause of identified flaky tests in C++ projects at the code level. We compile a comprehensive collection of C++ project flaky tests sourced from GitHub. We finetune Mistral7b, Llama2-7b and CodeLlama-7b models on the C++ dataset and an existing Java dataset and evaluate the performance. The results indicate that our models exhibit varying performance on the C++ dataset, while their performance is comparable to that of the Java dataset. Our results demonstrate the exceptional capability of LLMs to accurately classify flakiness in C++ and Java projects, providing a promising approach to enhance the efficiency of debugging flaky tests in practice.

Keyword :  Software Testing, Flaky Tests, LLMs, Flakiness Classification

Journal/ Proceedings Name :  CS & IT

URL :  https://csitcp.org/abstract/15/1510csit17

User Name : alex
Posted 05-08-2025 on 23:56:57 AEDT



Related Research Work

  • Blockchain-based Approaches For Privacy And Security In Iot Applications: A Systematic Literature Review
  • Nextgen Agile Methods - Agile Rolling Wave Planning
  • Security Consideration In Peer-to-peer Networks With A Case Study Application
  • Self-organization And Autonomous Network Survey

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals