SquirroGroundtruthLoader

class squirro.lib.nlp.steps.loaders.SquirroGroundtruthLoader(config)

Bases: squirro.lib.nlp.steps.loaders.Loader

Loads items from a Squirro Ground Truth into Document items.

Note - The fields client_id, client_secret, cluster, token and project_id do not need to be set if it is used inside the Squirro machinelearning service

Parameters
  • type (str) – squirro_groundtruth

  • groundtruth_id (str) – id of the Squirro Ground Truth

  • client_id (str, None) – Squirro client id

  • client_secret (str, None) – Squirro client secret

  • cluster (str) – Squirro cluster

  • token (str) – Squirro token

  • project_id (str) – id of Squirro project

  • temporal_version (str, None) – date which defines the temporal version of the Ground Truth

Example

{
    "step": "loader",
    "type": "squirro_groundtruth",
    "groundtruth_id": "GROUNDTRUTH_ID",
    "cluster": "CLUSTER",
    "token": "TOKEN",
    "project_id": "PROJECT_ID",
    "temporal_version": "2021-10-21T07:28:00.000000"
}

Methods Summary

process(dataset)

Load Ground Truth and yield documents.

Methods Documentation

process(dataset)

Load Ground Truth and yield documents.

Arguments

Yields

Document – A document from a query