hash_sample

Retains a percentage of message batches deterministically by hashing selected messages and checking the hash against a valid range, dropping all others.

hash_sample:
retain_min: 0
retain_max: 10

For example, setting retain_min to 0.0 and remain_max to 50.0 results in dropping half of the input stream, and setting retain_min to 50.0 and retain_max to 100.1 will drop the other half.

In order to sample individual messages of a batch use this processor with the for_each processor.

Fields

retain_min

number The lower percentage of the sample range.

retain_max

number The upper percentage of the sample range.

parts

array An array of message indexes within the batch to sample based on. If left empty all messages included. This field is only applicable when batching messages at the input level.