Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

Enterprise Large Language Model Evaluation Benchmark

google+
Views: 2                 

Author :  Liya Wang, David Yi, Damien Jose, John Passarelli, James Gao, Jordan Leventis, and Kang Li

Affiliation :  Atlassian

Country :  USA

Category :  Machine Learning

Volume, Issue, Month, Year :  15, 20, October, 2025

Abstract :


Large Language Models (LLMs) have demonstrated promise in boosting productivity across AI-powered tools, yet existing benchmarks like Massive Multitask Language Understanding (MMLU) inadequately assess enterprise-specific task complexities. We propose a 14-task framework grounded in Bloom’s Taxonomy to holistically evaluate LLM capabilities in enterprise contexts. To address challenges of noisy data and costly annotation, we develop a scalable pipeline combining LLM-as-a-Labeler, LLM-as-aJudge, and corrective retrieval-augmented generation (CRAG), curating a robust 9,700-sample benchmark. Evaluation of six leading models shows open-source contenders like DeepSeek R1 rival proprietary models in reasoning tasks but lag in judgment-based scenarios, likely due to overthinking. Our benchmark reveals critical enterprise performance gaps and offers actionable insights for model optimization. This work provides enterprises a blueprint for tailored evaluations and advances practicalLLM deployment.

Keyword :  Large Language Models (LLMs), Evaluation Benchmark, Bloom’s Taxonomy, LLM-as-a-Labeler, LLMas-a-Judge, Corrective Retrieval-Augmented Generation (CRAG)

Journal/ Proceedings Name :  CS&IT

URL :  https://aircconline.com/csit/abstract/v15n20/csit152001.html

User Name : alex
Posted 31-10-2026 on 16:35:06 AEDT



Related Research Work

  • Classification Of Machine Translation Outputs Using Nb Classifier And Svm For Post-editing
  • Community-aware Seed Selection For Graph Neural Network Training
  • Fault Diagnosis Using Clustering. What Statistical Test To Use For Hypothesis Testing?
  • A Machine Learning Method For Prediction Of Yogurt Quality And Consumers Preferencesusing Sensory Attributes And Image Processing Techniques

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals