StopwordsNormalizer

class squirro.lib.nlp.steps.normalizers.StopwordsNormalizer(config)

Bases: squirro.lib.nlp.steps.normalizers.Normalizer

Stopwords normalizer strips stopwords

Parameters
  • type (str) – stopwords

  • stopwords (list, []) – List of stopwords

  • stopwords_file (str, None) – File with list of stopwords

Methods Summary

load()

Load a step

process_doc(doc)

Process a document

save()

Save a step

Methods Documentation

load()

Load a step

process_doc(doc)

Process a document

Parameters

doc (Document) – Document

Returns

Processed document

Return type

Document

save()

Save a step