flume_exporter

Prometheus exporter for flume.

To run it:

make build

./flume_exporter [flags]

Help on flags:

./flume_exporter --help

Configuration: config.yml

agents:
- name: "flume-agents"
  enabled: true
# multiple urls can be separated by ,  
  urls: ["http://localhost:36001/metrics"]   

Using Docker

Default

docker run -d -p 9360:9360 zhijunwoo/flume_exporter:latest

Specified configuration

docker run -d \
    -p 9360:9360 \
    -v `pwd`/config.yml:/etc/flume_exporter/config.yml \
    -name flume_exporter \
    zhijunwoo/flume_exporter:latest

monitoring metrics

Sources

• AppendAcceptedCount
• AppendBatchAcceptedCount
• AppendBatchReceivedCount
• AppendReceivedCount
• ChannelWriteFail
• EventAcceptedCount
• EventReadFail
• EventReceivedCount
• GenericProcessingFail
• KafkaCommitTimer
• KafkaEmptyCount
• KafkaEventGetTimer
• OpenConnectionCount

Channels

• ChannelCapacity

• ChannelSize

• CheckpointBackupWriteErrorCount

• CheckpointWriteErrorCount

• EventPutAttemptCount

• EventPutErrorCount

• EventPutSuccessCount

• EventTakeAttemptCount

• EventTakeErrorCount

• EventTakeSuccessCount

• KafkaCommitTimer

• KafkaEventGetTimer

• KafkaEventSendTimer

• Open

• RollbackCounter

• Unhealthy

• RollbackCount

• ChannelFillPercentage

Sinks

• BatchCompleteCount
• BatchEmptyCount
• BatchUnderflowCount
• ChannelReadFail
• ConnectionClosedCount
• ConnectionCreatedCount
• ConnectionFailedCount
• EventDrainAttemptCount
• EventDrainSuccessCount
• EventWriteFail
• KafkaEventSendTimer
• RollbackCount

Grafana Dashboard

Grafana Dashboard ID: 10736
name: Flume Exporter Metrics Overview For Prometheus For details of the dashboard please see Flume Exporter Metrics