v0.5.1

A release that adds support for retaining the format of floating-point numbers from JSON logs, support for CLP’s UI to work with Presto, and some other improvements and bug fixes.

This release includes two tars:

• clp-json for compressing and searching JSON logs
• clp-text for compressing and searching unstructured text logs

Docs

The docs for this release are available here.

New features

• clp-json: Support for retaining the format of floating-point numbers. (#1176, #1321)
• webui: Support for CLP’s UI to work with Presto. (#1095, #1108, #1127, #1150, #1167, #1168, #1175, #1179, #1187, #1188, #1191, #1198, #1206, #1209, #1224, #1236, #1244, #1248, #1250, #1251, #1265, #1280, #1285, #1306, #1310)
  • NOTE: This adds the configuration key presto to etc/clp-config.yml.
• clp-json: Support for compressing Zstandard-compressed JSONL files as well as CLP KV-IR files. (#1312)

Bug fixes & improvements

• clp-json/clp-text: Add support for gracefully shutting down the compression scheduler and compression workers (resolves #1037). (#1169, #1323)
• core: Unescape variable strings before dictionary lookup in EncodedVariableInterpreter::encode_and_search_dictionary (fixes #590). (#1270)
• clp-s: Handle pure wildcards and unexpected literal types correctly in EvaluateTimestampIndex (fixes #1096). (#1277)
• kv-ir: Add support for getting the number of log events read from the deserializer. (#1282)
• kv-ir: Add support for duplicate columns in projections. (#1245)
• clp-json/clp-text: Consider all non-loopback IPv4s when selecting listen address to receive search results (fixes #1316). (#1317)
• clp-json/clp-text: Fail job and report failure to user for compression jobs that encounter at least one invalid input path (fixes #308). (#1125)
• clp-json: Warn the user if they do not use the --timestamp-key flag when compressing with the clp-s storage engine. (#1283)
• webui: Expose rate limit configuration (fixes #1019); Increase rate limit to 1000 req/min (fixes #1020). (#1234)
  • NOTE: This adds the configuration key webui.rate_limit to etc/clp-config.yml.

View the full changelog for more details.

Thanks to @anlowee, @AVMatthews, @Bill-hbrhbr, @davemarco, @gibber9809, @haiqi96, @hoophalab, @junhaoliao, @kirkrodrigues, @LinZhihao-723, and @quinntaylormitchell for their contributions.