Research and Implementation of a Method for Web Log Analysis Template Extraction

Abstract Extracting log template is a very effective method to deal with massive system logs. In this paper, based on Web system logs, the template extraction method based on label recognition tree is used to extract log template, and on this basis, the log preprocessing and template expression generation method are studied and improved. Aiming at the complex structure problem of system logs, the preprocessing method based on text similarity is adopted, and the classification of a log message is realized. The use of the maximum template matching method solves the problem of inconsistent log format and insufficient template matching caused by word segmentation. In the end, the log template extraction method is evaluated. The results show that the accuracy of the method is up to 96.4%, and the template matching degree is greatly increased.