Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

FLEXIBLE LOG FILE PARSING USING HIDDEN MARKOV MODELS

google+
Views: 14                 

Author :  Nadine Kuhnert

Affiliation :  Friedrich-Alexander University

Country :  Germany

Category :  Computer Science & Information Technology

Volume, Issue, Month, Year :  9, 12, September, 2019

Abstract :


We aim to model unknown file processing. As the content of log files often evolves over time, we established a dynamic statistical model which learns and adapts processing and parsing rules. First, we limit the amount of unstructured text by focusing only on those frequent patterns which lead to the desired output table similar to Vaarandi [10]. Second, we transform the found frequent patterns and the output stating the parsed table into a Hidden Markov Model (HMM). We use this HMM as a specific, however, flexible representation of a pattern for log file processing. With changes in the raw log file distorting learned patterns, we aim the model to adapt automatically in order to maintain high quality output. After training our model on one system type, applying the model and the resulting parsing rule to a different system with slightly different log file patterns, we achieve an accuracy over 99%.

Keyword :  Hidden Markov Models, Parameter Extraction, Parsing, Text Mining, Information Retrieval

Journal/ Proceedings Name :  Computer Science & Information Technology

URL :  https://aircconline.com/csit/papers/vol9/csit91201.pdf

User Name : alex
Posted 16-02-2021 on 16:57:17 AEDT



Related Research Work

  • A Crowd-sourcing Mobile Platform For Textbook Selling And Exchange Using Information Retrieval
  • Granulated Testing. Tnt For The Peak Of The Hill
  • Matchcut Assist: A Mobile System To Automate Matchcut Process Using Computer Vision
  • An Adaptive And Smart System For Parental Control On Digital Games

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals