Preparation for installing Humio

Enable Authentication

If you are just experimenting with Humio®, you can probably skip this page. For production deployments, you want to set up authentication.

If authentication is not configured, Humio runs in NO_AUTH mode, meaning that there are no access restrictions at all — anyone with access to the system can do anything.

Refer to Authentication Configuration for different login options.

Increase Open File Limit

For production usage, Humio needs to be able to keep a lot of files open for sockets and actual files from the file system. The default limits on UNIX systems are typically too low for any significant amount of data and concurrents users.

You can verify the actual limits for the process using

PID=`ps -ef | grep java | grep humio-assembly | head -n 1 | awk '{print $2}'`
cat /proc/$PID/limits | grep 'Max open files'

The minimum required settings depend on the number of open network connections and datasources. There is no harm in setting these limits high for the Humio process. A value of at least 8192 is recommended.

You can do that by running:

cat << EOF | tee /etc/security/limits.d/99-humio-limits.conf
# Raise limits for files.
humio soft nofile 250000
humio hard nofile 250000
EOF

cat << EOF | tee -a /etc/pam.d/common-session
# Apply limits:
session required pam_limits.so
EOF

These settings apply to the next Humio user login, not to any running processes.

If you run Humio using Docker, then you can raise the limit using the --ulimit="nofile=8192:8192" option on the docker run command.

Use a Separate Disk for Kafka Data

For production usage, you should ensure Kafka’s data volume is on a separate disk/volume from the other Humio services. This is because it’s quite easy for Kafka to fill the disk it’s using if Humio ingestion is slowed down for any reason. If it fills its disk, having it on a separate disk/volume than the other services will prevent them from crashing along with Kafka and will make recovery easier. If Kafka is running as separate servers or containers, you will likely be covered already, so this is primarily for situations where you’re running the all-in-one Docker image we supply.

We also highly recommend setting up your own disk usage monitoring to alert you when disks get greater than 80% full, so you can take corrective action before the disk fills completely.