What are Log Collectors (Aggregators)?
About
A log collector will collect log file, optionally transform them and deliver them to one or more destination such as:
List
| Name | Type | Log to Log | Log To Metrics | Description |
|---|---|---|---|---|
| Vector (Rust, DataDog) | observability pipeline tool | Yes | Yes | |
| Telegraph (Go, InfluxDb) | ||||
| Promtail (Graphana) | Log Collector | Yes | Yes 1) | Graphana tool to insert log Loki |
| Logstash (Java, Elastic) | Log Collector | Yes | Yes 2) | Elastic log collector |
| FluentBit | Log Collector | ? | ? | Successor to FluentD |
| Fluentd | Log Collector | ? | ? | Example: BigQuery |
| Flume | Log Collector | ? | ? |
| Google mtail | No | Yes | |
| Scribe (deprecated) |
Log to Metrics means extracting metrics from application logs to be exported into a metrics server