Making Sense of Failure Logs in an Industrial DevOps Environment
Muhammad Abbas, Ali Hamayouni , Mahshid Helali Moghadam, Mehrdad Saadatmand , Per Erik Strandberg
In 20th International Conference on Information Technology : New Generations (ITNG 2023)
Abstract:
Processing and reviewing nightly test execution failure logs for large industrial systems is a tedious activity. Furthermore, multiple failures might share one root/common cause during test execution sessions, and the review might therefore require redundant efforts. This paper presents the LogGrouper approach for automated grouping of failure logs to aid root/common cause analysis and for enabling the processing of each log group as a batch. LogGrouper uses state-of-art natural language processing and clustering approaches to achieve meaningful log grouping. The approach is evaluated in an industrial setting in both a qualitative and quantitative manner. Results show that LogGrouper produces good quality groupings in terms of our two evaluation metrics (Silhouette Coefficient and Calinski-Harabasz Index) for clustering quality. The qualitative evaluation shows that experts perceive the groups as useful, and the groups are seen as an initial pointer for root cause analysis and failure assignment.
Full Text:
Bibtex:
@InProceedings{10.1007/978-3-031-28332-1_25,
author="Abbas, Muhammad
and Hamayouni, Ali
and Moghadam, Mahshid H.
and Saadatmand, Mehrdad
and Strandberg, Per E.",
editor="Latifi, Shahram",
title="Making Sense of Failure Logs in an Industrial DevOps Environment",
booktitle="ITNG 2023 20th International Conference on Information Technology-New Generations",
year="2023",
publisher="Springer International Publishing",
address="Cham",
pages="217--226",
isbn="978-3-031-28332-1"
}