filters package

Functions

make_filter(config)

Filter factory

Classes

AggregateFilter(config)

Aggregates fields of docs

BlacklistFilter(config)

Removes documents based on a blacklist

CopyFilter(config)

Copies input fields into output fields

DocJoinFilter(config)

Joins many Documents together via id or a field.

DocSplitFilter(config)

Splits a single Document into many via iterable fields of the same length.

EmptyFilter(config)

Filters out empty fields

Filter(config)

The Filter step takes the stream of Document and filters out specific entries based on the criteria of the step.

JoinFilter(config)

Joins field into a list

MergeFilter(config)

Merges fields into a single field

ProximityFilter(config)

Filters documents by checking if terms exist within a specified proximity

RegexFilter(config)

Filter documents based on a supplied list of blacklist and whitelist regexes

SplitFilter(config)

Splits field into a list

SquirroEntityFilter(config)

Takes a set of fields and creates Squirro entities

ThresholdFilter(config)

Filters out weighted facets with values below threshold.

VoteFilter(config)

Given a list of values, assign a single value by majority voting.

WhitelistFilter(config)

Removes documents based on a whitelist