Cloudflare upgraded its logging pipeline from syslog-ng to OpenTelemetry Collector, enhancing data handling, integration, and performance reporting across its critical infrastructure.
The migration to OpenTelemetry Collector presented several benefits, such as language compatibility with Go, easier integration with internal libraries, and enhanced metrics collection.
By using OpenTelemetry, Cloudflare aims to reduce complexity by unifying different telemetry types, thus allowing engineers to focus on developing features instead of managing multiple systems.
The engineering team created custom components during migration, including a custom exporter for exclusive log formats and processors for integrating external JSON data, meeting specific operational needs.
Collection
[
|
...
]