Incremental mining of system log format

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

78 Citations (Scopus)

Abstract

In modern computer system, system logs are important for problem determination in troubleshooting. Especially in the troubleshooting of systems, system administrators need to understand overview of the problems and identify the root causes quickly, and system logs can help the system administrators. However large numbers of unfamiliar system logs when are generated problems occur, and it's difficult to understand and use them. Most of the existing methods for interpreting system logs don't work immediately and are not useful for troubleshooting situations. We have devised a new method for mining log formats and retrieving log types and parameters in incremental log messages. By creating a structured tree using the nodes generated from log messages, we created a method for mining and refining log format continuously in realtime. Our experiments shows that our method can identify the formats of real system logs without prior knowledge.

Original languageEnglish
Title of host publicationProceedings - IEEE 10th International Conference on Services Computing, SCC 2013
Pages595-602
Number of pages8
DOIs
Publication statusPublished - 2013
Event2013 IEEE 10th International Conference on Services Computing, SCC 2013 - Santa Clara, CA, United States
Duration: 2013 Jun 272013 Jul 2

Publication series

NameProceedings - IEEE 10th International Conference on Services Computing, SCC 2013

Conference

Conference2013 IEEE 10th International Conference on Services Computing, SCC 2013
Country/TerritoryUnited States
CitySanta Clara, CA
Period13/6/2713/7/2

Keywords

  • data mining
  • log management

Fingerprint

Dive into the research topics of 'Incremental mining of system log format'. Together they form a unique fingerprint.

Cite this