1. Microservices Monitoring with Event Logs and Black Box Execution Tracing
- Author
-
Antonio Pecchia, Raffaele Della Corte, Marcello Cinque, Cinque, Marcello, Della Corte, Raffaele, Pecchia, Antonio, Cinque, M., Corte, R. D., and Pecchia, A.
- Subjects
Representational state transfer ,Information Systems and Management ,Monitoring ,Computer Networks and Communications ,computer.internet_protocol ,Computer science ,media_common.quotation_subject ,Context (language use) ,02 engineering and technology ,Troubleshooting ,Microservices ,Tracing ,01 natural sciences ,Modularity ,Microservice ,Log analysi ,Semantic heterogeneity ,0202 electrical engineering, electronic engineering, information engineering ,Software system ,Kubernete ,media_common ,Black box (phreaking) ,Flexibility (engineering) ,Docker ,business.industry ,Event (computing) ,REST ,010401 analytical chemistry ,020206 networking & telecommunications ,0104 chemical sciences ,Computer Science Applications ,Debugging ,Hardware and Architecture ,monitoring, microservices, REST, Docker, Clearwater, Kubernetes, log analysis ,Clearwater ,Software engineering ,business ,computer - Abstract
Monitoring is a core practice in any software system. Trends in microservices systems exacerbate the role of monitoring and pose novel challenges to data sources being used for monitoring, such as event logs. Current deployments create a distinct log per microservice; moreover, composing microservices by different vendors exacerbates format and semantic heterogeneity of logs. Understanding and traversing the logs from different microservices demands for substantial cognitive work by human experts. This paper proposes a novel approach to accompany microservices logs with black box tracing to help practitioners in making informed decisions for troubleshooting. Our approach is based on the passive tracing of request-response messages of the REpresentational State Transfer (REST) communication model. Differently from many existing tools for microservices, our tracing is application transparent and non-intrusive. We present an implementation called MetroFunnel and conduct an assessment in the context of two case studies: a Clearwater IP Multimedia Subsystem (IMS) setup consisting of Docker microservices and a Kubernetes orchestrator deployment hosting tens of microservices. MetroFunnel allows making useful attributions in traversing the logs; more important, it reduces the size of collected monitoring data at negligible performance overhead with respect to traditional logs.
- Published
- 2021
- Full Text
- View/download PDF