Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

Multi-Domain ABSA Conversation Dataset Generation via LLMs for Real-World Evaluation and Model Comparison

google+
Views: 367                 

Author :  Tejul Pandit1, Meet Raval2 and Dhvani Upadhyay3

Affiliation :  1Palo Alto Networks, USA, 2University of Southern California, USA, 3Dhirubhai Ambani University

Country :  India

Category :  DBWorld: Database Management Systems

Volume, Issue, Month, Year :  15, 10, May, 2025

Abstract :


Aspect-Based Sentiment Analysis (ABSA) offers granular insights into opinions but often suffers from the scarcity of diverse, labeled datasets that reflect real-world conversational nuances. This paper presents an approach for generating synthetic ABSA data using Large Language Models (LLMs) to address this gap. We detail the generation process aimed at producing data with consistent topic and sentiment distributions across multiple domains using GPT-4o. The quality and utility of the generated data were evaluated by assessing the performance of three state-of-the-art LLMs (Gemini 1.5 Pro, Claude 3.5 Sonnet, and DeepSeek-R1) on topic and sentiment classification tasks. Our results demonstrate the effectiveness of the synthetic data, revealing distinct performance trade-offs among the models: DeepSeekR1 showed higher precision, Gemini 1.5 Pro and Claude 3.5 Sonnet exhibited strong recall, and Gemini 1.5 Pro offered significantly faster inference. We conclude that LLM-based synthetic data generation is a viable and flexible method for creating valuable ABSA resources, facilitating research and model evaluation without reliance on limited or inaccessible real-world labeled data.

Keyword :  Aspect-Based sentiment analysis (ABSA), Synthetic Data Generation, Large Language Models, GPT-4o, Gemini 1.5 Pro, Claude 3.5 Sonnet, Deepseek-R1, Comparative analysis of LLMs

Journal/ Proceedings Name :  CS & IT

URL :  https://csitcp.org/abstract/15/1510csit06

User Name : alex
Posted 23-07-2025 on 14:42:48 AEDT



Related Research Work

  • Empowering Developing Countries And Remote Communities: A Decentralized Iot Network Leveraging Distributed Ledger Technology And Dag For Connectivity And Financial Inclusion
  • Optimizing Virtual Machine Placement In Cloud Data Centers: Enhanced Ant Colony Optimization Approach
  • Harnessing Big Data Analytics In Education: Balancing Student Success With Privacy Concerns And Ethical Considerations In Greenfield University In Usa (pseudonym)
  • A Multi-scale Approach To Fine-grained Sentiment Analysis Using Debertav3

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals