filtering.ini#

The filtering.ini config file, located at /etc/squirro/filtering.ini configures the filtering process, which is responsible for search tagging alerts and trend updates.

Batching#

The filtering process runs asynchronously, batching the actual execution of filtering steps.

The [batch] section in the filtering.ini configuration file, can be used to change the default of this batching.

Key

Usage

Default

size

How many items to collect for each batch.

It is recommended to increase this for high-throughput setups, which can profit from bigger batches.

20

flush_timeout_in_seconds

Number of seconds to wait before triggering a batch, even if the batch size has not been reached yet.

Can be decreased, especially when the item delivery is very bursty. So if the items of a batch usually come together, and then the pipeline will be quiet for a while, reducing this can reduce latency.

60

Applying Changes#

After editing this configuration file, the service sqfilteringd has to be restarted (see Services).