Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

An Unsupervised Approach to Develop Stemmer

google+
Views: 9                 

Author :  Mohd. Shahid Husain

Affiliation :  Integral University

Country :  India

Category :  Linguistics

Volume, Issue, Month, Year :  1, 2, August, 2012

Abstract :


This paper presents an unsupervised approach for the development of a stemmer (For the case of Urdu & Marathi language). Especially, during last few years, a wide range of information in Indian regional languages has been made available on web in the form of e-data. But the access to these data repositories is very low because the efficient search engines/retrieval systems supporting these languages are very limited. Hence automatic information processing and retrieval is become an urgent requirement. To train the system training dataset, taken from CRULP [22] and Marathi corpus [23] are used. For generating suffix rules two different approaches, namely, frequency based stripping and length based stripping have been proposed. The evaluation has been made on 1200 words extracted from the Emille corpus. The experiment results shows that in the case of Urdu language the frequency based suffix generation approach gives the maximum accuracy of 85.36% whereas Length based suffix stripping algorithm gives maximum accuracy of 79.76%. In the case of Marathi language the systems gives 63.5% accuracy in the case of frequency based stripping and achieves maximum accuracy of 82.5% in the case of length based suffix stripping algorithm.

Keyword :  Stemming, Morphology, Urdu stemmer, Marathi stemmer, Information retrieval

Journal/ Proceedings Name :  International Journal on Natural Language Computing (IJNLC)

URL :  https://airccse.org/journal/ijnlc/papers/1212ijnlc02.pdf

User Name : Darren
Posted 06-10-2023 on 21:51:30 AEDT



Related Research Work

  • Ontology Service Center: A Datahub For Ontology Application
  • Political Opinion Analysis In Social Networks: Case Of Twitter And Facebook
  • Semantic Processing Mechanism For Listening And Comprehension In Vnscalendar System
  • Tuning Dari Speech Classification Employing Deep Neural Networks

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals