Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

A Large Language Model Approach to Classify Flakiness in C++ Projects

google+
Views: 251                 

Author :  Xin Sun, Daniel Ståhl and Kristian Sandah

Affiliation :  Linköping University

Country :  Sweden

Category :  Software Engineering & Security

Volume, Issue, Month, Year :  15, 10, May, 2025

Abstract :


The role of regression testing in software testing is crucial as it ensures that any new modifications do not disrupt the existing functionality and behaviour of the software system. However, the presence of Flaky Tests undermines the reliability of regression testing results. In this paper, we propose an LLM-based approach for classifying the root cause of identified flaky tests in C++ projects at the code level. We compile a comprehensive collection of C++ project flaky tests sourced from GitHub. We finetune Mistral7b, Llama2-7b and CodeLlama-7b models on the C++ dataset and an existing Java dataset and evaluate the performance. The results indicate that our models exhibit varying performance on the C++ dataset, while their performance is comparable to that of the Java dataset. Our results demonstrate the exceptional capability of LLMs to accurately classify flakiness in C++ and Java projects, providing a promising approach to enhance the efficiency of debugging flaky tests in practice.

Keyword :  Software Testing, Flaky Tests, LLMs, Flakiness Classification

Journal/ Proceedings Name :  CS & IT

URL :  https://csitcp.org/abstract/15/1510csit17

User Name : alex
Posted 05-08-2025 on 23:56:57 AEDT



Related Research Work

  • Leveraging Merge Request Data To Analyze Devops Practices: Insights From A Networking Software Solution Company
  • Smart Meter Security Issues: A Review Paper
  • An Effective Semantic Encrypted Relational Data Using K-nn Model
  • A Light Weight Solution For Detecting De-authentication Attack

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals