Loaders Package

Contents

Loaders Package#

Functions#

make_loader(config)

Loader factory

Classes#

CSVLoader(config)

The CSV Loader loads CSV files and transforms the data into Document items.

FileLoader(config)

The file Loader looks in a specified directory_field directory for files and loads these files either line by line or as a whole and transforms them into Document items.

JSONLoader(config)

The JSON Loader loads JSON files and transforms the data into Document items.

Loader(config)

The Loader step adds Document to the Pipeline stream.

SquirroGroundtruthLoader(config)

Loads items from a Squirro Ground Truth into Document items.

SquirroItemLoader(config)

Loads in a list of items (with the data structure of a Squirro Item) and transforms them to Document items.

SquirroQueryLoader(config)

Loads items from a Squirro instance using the SquirroClient and transforms the items into Document items.