Metricbeat is a lightweight tool for collecting and shipping metrics.
Metricbeat collects a large set of valuable system metrics, including:
On top of the system-level statistics, Metricbeat comes with modules that offer
integrations to many well-known services like Docker
, MongoDB
, and MySQL
.
Check out the Modules page at the official Metricbeat documentation
for more details on these integrations and how they work.
Official documentation You can read all the official documentation on Metricbeats at the Metricbeat website.
To download Metricbeat, visit the Metricbeat OSS downloads page.
Installation documentation You can find installation documentation for Metricbeat at the Installation page of the official Metricbeat website.
Because Humio supports parts of the ElasticSearch insertion API, you can send data from Metricbeat to Humio by configuring Metricbeat to use the built-in ElasticSearch output.
Configuration documentation You can find configuration documentation for Metricbeat at the Metricbeat configuration page of the official Metricbeat website.
The following example shows a simple Metricbeat configuration collecting host metrics and sending them to Humio:
metricbeat.modules:
- module: system
enabled: true
period: 10s
metricsets:
- cpu
- load
- filesystem
- fsstat
- memory
- network
- socket # linux only
output.elasticsearch:
hosts: ["https://$BASEURL/api/v1/ingest/elastic-bulk"]
username: my-organization
password: $INGEST_TOKEN
Where:
$BASEURL
- is the base URL of your Humio server (e.g. https://cloud.humio.com:443
or http://localhost:8080
)$INGEST_TOKEN
- is the ingest token for your repository, (e.g. a string such as fS6Kdlb0clqe0UwPcc4slvNFP3Qn1COzG9DEVLw7v0Ii
).Metricbeat uses 9200 as the default port, if no port is specified. So if Humio is listening on the default ports 80 or 443, these ports should be explicitly put in the $BASEURL
The Metricbeat configuration file is located at /etc/metricbeat/metricbeat.yml
on Linux.
Run Metricbeat as a service on Linux with the following commands
sudo systemctl enable metricbeat
sudo systemctl restart metricbeat
You can add fields with static values using the fields
section. These fields
will be added to the each event.
Metricbeat automatically sends the host name of the system along with the data.
Humio adds the host name in the @host
field to each event. It uses this field
name to try not to collide with other fields in the event.
Once you have data from Metricbeat in Humio, you can run some interesting queries, such as the following examples:
Show CPU load for each host:
#type=beat | timechart(series=@host, function=max(system.load.1, as=load))
Show memory usage for each host:
#type=beat | timechart(series=@host, function=max(system.memory.actual.used.bytes))
Show disk free space (in gigabytes):
#type=beat @host=host1 system.filesystem.mount_point="/"
| timechart(function=min(system.filesystem.free, as=free))
| eval(free=free/(1024*1024*1024))
Disk IO - show bytes read for each disk:
#type=beat @host=host1
| system.diskio.read.bytes=*
| timechart(
series=system.diskio.name,
function=counterAsRate(system.diskio.read.bytes), span=1m
)
Network traffic - Show bytes sent on the eth0
interface:
#type=beat @host=host1 system.network.name=eth0
| timechart(function=count(system.network.out.bytes), span=1m)
Show the top 10 processes using the most CPU:
#type=beat | system.process.name=*
| groupBy(system.process.name, function=avg(system.process.cpu.total.pct, as=cpu))
| sort(cpu, limit=10)