Stable Releases

1.12.2

Bug fixes and improved search speeds for many-core systems

Release Date: 2020-07-03
Minimum previous Humio version: 1.10.0
Requires data migrations: false
Has changes to configuration: false

Bug fixes and improved search speeds for many-core systems

Changelog

  • Improved query scheduling on machines with many cores. This can improve search speeds significantly.
  • Support for a new storage format for segment files that will be introduced in a later release (to support rollback)
  • Bugfix: S3Archiving could write events twice in a special case (When a merge happens where all inputs have been archived, write in global that the merge-result was archived too).
  • Bugfix: Bucket storage in GCP could did not clean up all tmp files

1.12.1

Bug fixes - Safari freeze, SAML, bucket storage cleanup, regex and field-aliasing

Release Date: 2020-06-24
Minimum previous Humio version: 1.10.0
Requires data migrations: false
Has changes to configuration: false

Bug fixes - Safari freeze, SAML, bucket storage cleanup, regex and field-aliasing

Changelog

  • Fixed an issue with CSP that could cause the Humio UI to freeze on Safari browsers
  • Fixed an issue that prevented deletion of unused objects in bucket storage, if the bucket contained 100 millions of objects or more
  • Fixed an issue with SAML IDPs requiring query parameters to be passed via the configuration SAML_IDP_SIGN_ON_URL
  • Fixed an issue where queries using lookahead in regex would fail to parse - “invalid or unsupported Perl syntax”
  • Fixed an issue where events could be skipped even though they should not, for queries containing field-aliasing (e.g., a:=b) and using subsequent checks on the aliasing field.

1.12.0

Export to bucket, findTimestamp, selfjoin, Emergency user subsystem

Release Date: 2020-06-09
Minimum previous Humio version: 1.10.0
Requires data migrations: true
Has changes to configuration: true

This release promotes the 1.11 releases from preview to stable.

SelfJoin

selfJoin query function allows selecting log lines that share an identifier; for which there exists (separate) log lines that match a certain filtering criteria; such as “all log lines with a given userid for which there exists a successful and an unsuccessful login”.

findTimestamp

findTimestamp query function will try to find and parse timestamps in incoming data. The function should be used in parsers and support automatic detection of timestamps. It can be used instead of making regular expressions specifying where to find the timestamp and parsing it with parseTimestamp Checkout the documentation for details.

Export to bucket storage/S3

As an alternative to downloading streaming queries directly, Humio can now upload them to an S3 or GCS bucket from which the user can download the data. See docs

Emergency user subsystem

If there are issues with the identity provider that Humio is configured to use, it might not be possible to log in to Humio. To mitigate this, Humio now provides emergency users that can be created locally within the Humio cluster. See docs

Elastic Bulk API change - Fluent Bit users might need to change the Fluent Bit configuration

To ensure compatability with the newest Beats clients, the Elastic Bulk API has been changed to always return the full set of status information for all operations, as it is done in the official Elastic API

This can however cause problems when using Fluent Bit to ingest data into Humio.

Fluent Bit in default configuration uses a small buffer (4KB) for responses from the Elastic Bulk API, which causes problems when enough operations are bulked together. The response will then be larger than the response buffer as it contains the status for each individual operation. Make sure the response buffer is large enough, otherwise Fluent Bit will stop shipping data. See: https://github.com/fluent/fluent-bit/issues/2156 and https://docs.fluentbit.io/manual/pipeline/outputs/elasticsearch

To see more details go through the individual 1.11.x release notes (links in the changelog).

Changelog

1.10.7

Bug fixes and improved search speeds for many-core systems

Release Date: 2020-07-03
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Bug fixes and improved search speeds for many-core systems

Changelog

  • Improved query scheduling on machines with many cores. This can improve search speeds significantly.
  • Support for a new storage format for segment files that will be introduced in a later release (to support rollback)
  • Bugfix: S3Archiving could write events twice in a special case (When a merge happens where all inputs have been archived, write in global that the merge-result was archived too).
  • Bugfix: Bucket storage in GCP could did not clean up all tmp files

1.10.6

Bug fixes - Safari freeze, SAML and bucket storage cleanup

Release Date: 2020-06-24
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Bug fixes - Safari freeze, SAML and bucket storage cleanup

Changelog

  • Fixed an issue with CSP that could cause the Humio UI to freeze on Safari browsers
  • Fixed an issue that prevented deletion of unused objects in bucket storage, if the bucket contained 100 millions of objects or more
  • Fixed an issue with SAML IDPs requiring query parameters to be passed via the configuration SAML_IDP_SIGN_ON_URL

1.10.5

Bug fixes - humio-search-all and query timeouts

Release Date: 2020-06-09
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Bug fixes - humio-search-all and query timeouts

Changelog

  • Fixed a number of issues with export and alerts in the humio-search-all repository
  • Fixed an issue where long running queries started as part of an export, or by calls to the /query API would time out
  • Fixed an issue where a query could get a “Result is partial” warning when the query took more then 15 minutes to complete while a merge of segments addressed by the query happened in the background

1.10.4

Bug fixes for long-running queries

Release Date: 2020-05-29
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Bug fixes for long-running queries

Changelog

  • Fixed a number of bugs that would cause long-running queries using join, selfJoin or selfJoinFilter to timeout or fail

1.10.3

Bug fixes.

Release Date: 2020-05-20
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Bug fixes.

Changelog

  • Bugfix: An issue could result in malformed messages being put into the ingest queue. This version is able to read and skip such messages. The issue causing such malformed messages has been fixed.

1.10.2

Optimizations, improved Humio health insights and bug fixes.

Release Date: 2020-05-19
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Optimizations, improved Humio health insights and bug fixes.

Changelog

  • Bugfix: A couple of memory leaks have been found and fixed.
  • Bugfix: Autocreate users on login when synchronizing groups with external provider.
  • Bugfix: Humio search all repo interaction with alerts and notifiers.
  • Improvements made to speed of frontpage loading. Noticeable for customers with many repositories and groups.
  • Paging in UI. administration/Users & Permissions.
  • Better sorting when computing query prefixes in order to reuse queries.

1.10.1

Optimizations, improved Humio health insights and bug fixes.

Release Date: 2020-05-04
Minimum previous Humio version: 1.8.5
Requires data migrations: false
Has changes to configuration: false

Optimizations, improved Humio health insights and bug fixes.

Changelog

  • This release fixes a security issue. For more information see: Humio Security Disclosures.
  • New metric: “query-delta-cost”: 30s delta cost on queries per repo, for the entire cluster.
  • New internal jobs logging system stats: Search for #type=humio | NonSensitive | groupby(kind) to see them.
  • Thread pools have been reorganized to require fewer threads and threads have been given new names.
  • Memory requirements set using -XX:MaxDirectMemorySize is much lower now. Suggested value is ((#vCpu+3)/4) GB.
  • Improved protocol within cluster for submitting queries to allow faster start of queries on huge repositories.

1.10.0

UI for Role Based Access Control (RBAC), Health Check API, Kafka version update, Vega charts

Release Date: 2020-04-27
Minimum previous Humio version: 1.8.5
Requires data migrations: true
Has changes to configuration: true

RBAC, Health Check API, Kafka, Vega

This release promotes the 1.9 releases from preview to stable. The main new additions are:

Security fixes

Kafka version update

  • Updated Humio to use Kafka 2.4. Humio can still use versions of Kafka down through 1.1.
  • Be aware that updating Kafka also requires you to update Zookeeper to 3.5.6. There is a migration involved in updating Zookeeper. See Zookeeper’s migration FAQ here. Use the migration approach using an empty snapshot. The other proposed solution can loose data.
  • Updated Kafka and Zookeeper Docker images to use Kafka 2.4. Updating to Kafka 2.4 should be straightforward using Humio’s Kafka/Zookeeper Docker images. Zookeper image will handle migration. Stop all Kafka nodes. Stop all Zookeeper nodes. Start all Zookeeper nodes on the new version. Start all Kafka nodes on the new version. Before updating Kafka/Zookeeper, we recommend backing up the Zookeeper data directory. Then, add the Zookeeper properties described below. If you are deploying Kafka/Zookeeper using other tools, for example Ansible scripts, be aware there is a migration involved in updating Zookeeper.
  • When updating Kafka/Zookeeper we recommend setting these Zookeeper properties

    # Do not start the new admin server. Default port 8080 conflicts with Humio port.
    admin.enableServer=false
    # purge old snapshot files
    autopurge.purgeInterval=1
    # Allow 4 letter commands. Used by Humio to get info about the Zookeeper cluster
    4lw.commands.whitelist=*
    

New features

  • Several improvements to Query Functions
  • NetFlow support extended to also support IPFIX.
  • Added humio Health Check APIs
  • Chart styling support (Pie, Bar)
  • Time Chart series roll-up
  • Replaces chart library with Vega, can be disabled using the ENABLE_VEGA_CHARTS=false flag.
  • Linear interpolation now default. New interpolation type: Basis
  • Control widget stylying directly from dashboards
  • Support for controlling color and title in widgets
  • Add Role Based Access Control (RBAC) to the Humio UI
  • New line interpolation options
  • Dealing with missing data points in timecharts

To see more details go through the individual 1.9.x release notes (links in the changelog).

Note: This release is identical to 1.9.3 apart from the version string.

Changelog

1.8.9

Security fixes

Release Date: 2020-03-25
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

Security fixes.

Changelog

  • Security: [critical] Fixed a security vulnerability discovered through proactive penetration testing (more information will be forthcoming).

1.8.8

Security fixes

Release Date: 2020-03-23
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

Security fixes.

Changelog

  • Fix security problem. This is a critical update. On-prem system with access for non-trusted users should upgrade. We follow up with more details when this update has been rolled out.

1.8.7

Bug fixes

Release Date: 2020-03-12
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

Bug fixes.

Changelog

  • Bug fix: Alerts and exports now work on the special view “humio-search-all”.
  • Bug fix: When a merge of segment files fails, delete the tmp-file that was created.
  • Bug fix: The Kafka and Zookeeper images tagged with “1.8.6” were partially upgraded to Kafka 2.4.0.

1.8.6

Bug fixes

Release Date: 2020-03-09
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

Note! Do not install the Kafka, Zookeeper or “single” Docker images of this build. Install 1.8.7 or later.

Changelog

  • Note! Do not install the Kafka, Zookeeper or “single” Docker images of this build. Install 1.8.7 or later.
  • Bug fix: Assigning ingest tokens to parsers in sandbox repos.

1.8.5

Bug fixes

Release Date: 2020-02-28
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

Bug fixes.

Changelog

  • Bug fix: “Export” queries could hit an internal limit and fail for large datasets.
  • Lower ingest queue timeout threshold from 90 to 30 seconds.
  • Bug fix: TCP socket ingest listener would spend a lot of CPU when connected but not receiving any data.
  • Bug fix: Fixed a race in upload of segment files for systems set up using ephemeral disks.

1.8.4

UI Scroll bugfix for Chrome 80 (again)

Release Date: 2020-02-19
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

This release is purely a fix for the Humio UI. After upgrading to Chrome 80, people have been experiencing issues with scrolling in some of Humio’s widgets. We did not find all the problems in the previous release.

Changelog

  • Bug fix: Fix more scrolling issues in Chrome 80 and above.

1.8.3

UI Scroll bugfix for Chrome 80

Release Date: 2020-02-13
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: false

This release is purely a fix for the Humio UI. After upgrading to Chrome 80 people have been experiencing issues with scrolling on the Search page - specifically when the “Field” panel is visible.

Changelog

  • Bug fix: Fix scrolling issue in Chrome 80 on the Search Page.

1.8.2

Bug fixes

Release Date: 2020-02-10
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: true

This is a bug fix release.

Changelog

  • Bug fix: The new feature for ephemeral servers using Zookeeper to UUID did not properly reconnect when the network failed.
  • Bug fix: Bucket storage download could report “download completed” also in case of problems fetching the file.
  • Bug fix: When a node was missing for an extended period of time the remaining nodes would create smaller segment files than they should.

1.8.1

Bug fixes

Release Date: 2020-02-03
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: true

This is a bug fix release.

Changelog

  • New feature for ephemeral servers: Let Zookeeper assign the UUID that in turn assigns the node ID in the cluster. This is turned on by setting the config option ZOOKEEPER_URL_FOR_NODE_UUID to the set of Zookeepers to use for this. The option ZOOKEEPER_PREFIX_FOR_NODE_UUID (default “/humioautouuid”) sets the prefix to allow rack awareness. Note: Do not turn this on for an existing cluster. Do not turn on if running older 1.7.x or 1.8.x builds.
  • Bug fix: Fix edge case errors in the regex engine. Some case insensitive searches for some Unicode characters were not supported correctly.
  • Bug fix: Avoid calling fallocate on platforms that do not support this (for example, ZFS).

1.8.0

Joins, Bucket Storage Backend, Query Quotas, UI Improvements

Release Date: 2020-01-27
Minimum previous Humio version: 1.6.10
Requires data migrations: false
Has changes to configuration: true

This release promotes the 1.7 releases from preview to stable. The main new additions are

To see more details go through the individual 1.7.x release notes (links in the changelog).

Note: This release is identical to 1.7.4 apart from the version string.

Changelog

1.6.11

Bug fixes

Release Date: 2020-01-06
Minimum previous Humio version: 1.5.19
Requires data migrations: false
Has changes to configuration: false

Handle large global snapshot file

Changelog

  • Bug fix: Handle large global snapshot files (larger than 2 G).

1.6.10

Bug fixes

Release Date: 2019-12-12
Minimum previous Humio version: 1.5.19
Requires data migrations: false
Has changes to configuration: yes - see changes

Bug fixes and LDAP improvements.

Changelog

  • Username/email is treated case-insensitive in Humio. This is more expected behavior of usernames as emails addresses are often used. In some rare occasions duplicate accounts might have been created with difference in casing and this change can trigger the otherwise dormant account to be chosen when logging in the next time. If this happens, use the administrations page to delete the unwanted user account and let the user log in again.
  • LDAP: It is now possible to specify an attribute within the LDAP record to use for the username rather than the default (an email address). This is only the case when using ldap-search method by specifying the LDAP_USERNAME_ATTRIBUTE in the environment. Group names when using LDAP have historically been the distinguished name (DN) for that group, it is now possible to specify and attribute in the group record for the name by setting LDAP_GROUPNAME_ATTRIBUTE. These changes necessitated a breaking change in the ldap-search code path in cases where users of Humio authenticate with a username (e.g. user) rather than an email address (e.g. user@example.com). To elicit the same behavior as previous versions of Humio simply specify the LDAP_SEARCH_DOMAIN_NAME which in the past would default to the value of LDAP_DOMAIN_NAME but no longer does.
  • Add LDAP_USERNAME_ATTRIBUTE and LDAP_GROUPNAME_ATTRIBUTE configuration settings to enable more control over names carried from LDAP into Humio.
  • Require setting LDAP_SEARCH_DOMAIN_NAME explicitly when using ldap-search authentication method.
  • Bugfix: Query sessions were not properly cleaned up after becoming unused. This lead to a leak causing high amount of chatter between nodes.

1.6.9

Bug fixes

Release Date: 2019-11-25
Minimum previous Humio version: 1.5.19
Requires data migrations: false
Has changes to configuration: no - but see changes to backup in 1.6.6

Bug fixes and a new background job that reduces number of small files on disk.

Changelog

  • New background job: Find segments that are too small compared to the desired sizes (from current config) and merge them into larger files. For COMPRESSION_TYPE=high this will recompress the inputs while combining them. This job runs by default and may be turned off by MERGE_UNDERSIZED_SEGMENTS_ENABLED=false.
  • Detect when event ingested are more than MAX_HOURS_SEGMENT_OPEN (24h by default) old and add the tag humioBackfill to them in that case to keep “old” events from getting mixed with current “live” events.
  • Improved memory usage from having large global.