<!-- Source: https://docs.squirro.com/en/latest/technical/data-processing/pipeline-steps/enrich/language-detection.html -->
# Language Detection

The language detection pipeline step detects the language of a Squirro item. The language information is needed for the correct indexing of the document, so this step should not be disabled.

|  |  |
| --- | --- |
| Enrichment name | language-detection |
| Stage | processing |

## Overview

During the `language-detection` step, the body of the Squirro item and all of its sub-items is analyzed and the language extracted from it. Any other fields, including title and summary, are ignored.

If the language field is already defined on the item, it will not be overwritten.

[![image1](https://s3.amazonaws.com/download.squirro.net/docs/migrated-attachments/50331670/50331669.png)](https://s3.amazonaws.com/download.squirro.net/docs/migrated-attachments/50331670/50331669.png)

## Configuration

There are no configuration options for this enrichment, except for the `enabled` property to enable and disable it.

## The $item_language Field

The language detection step assigns a detected language to each item and stores it in the `$item_language` field. Squirro represents language values as two-letter [ISO 639-1](https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes) codes, such as `en` for English, `de` for German, or `fr` for French.

If the confidence score falls below 50%, the field is left empty.

If an item already has a language assigned before it enters the pipeline, the step does not overwrite it. You can provide a language value explicitly when ingesting items via the Squirro API or a data loader by setting the `language` field to a two-letter ISO 639-1 code, for example `language: "de"` for German. Squirro uses that value instead of running automatic detection.

To filter search results by language, use `$item_language` in a search query:

```text
$item_language:de
```

That query returns only German-language items. For more information about language filtering in search queries, see the [Query Syntax](../../../search/features/query-syntax.md#search-query-syntax) page.

## Languages covered

af - [Afrikaans](https://en.wikipedia.org/wiki/Afrikaans_language)

am - [Amharic](https://en.wikipedia.org/wiki/Amharic_language)

an - [Aragonese](https://en.wikipedia.org/wiki/Aragonese_language)

ar - [Arabic](https://en.wikipedia.org/wiki/Arabic_language)

as - [Assamese](https://en.wikipedia.org/wiki/Assamese_language)

av- [Avaric](https://en.wikipedia.org/wiki/Avar_language)

az - [Azerbaijani](https://en.wikipedia.org/wiki/Azerbaijani_language)

ba - [Bashkir](https://en.wikipedia.org/wiki/Bashkir_language)

be - [Belarusian](https://en.wikipedia.org/wiki/Belarusian_language)

**bg -** [Bulgarian](https://en.wikipedia.org/wiki/Bulgarian_language)

bh - ?

bn - [Bengali](https://en.wikipedia.org/wiki/Bengali_language)

bo - [Tibetan](https://en.wikipedia.org/wiki/Standard_Tibetan)

br - [Breton](https://en.wikipedia.org/wiki/Breton_language)

bs - [Bosnian](https://en.wikipedia.org/wiki/Bosnian_language)

ca - [Catalan](https://en.wikipedia.org/wiki/Catalan_language)

ce- [Chechen](https://en.wikipedia.org/wiki/Chechen_language)

co - [Corsican](https://en.wikipedia.org/wiki/Corsican_language)

**cs -** [Czech](https://en.wikipedia.org/wiki/Czech_language)

cv - [Chuvash](https://en.wikipedia.org/wiki/Chuvash_language)

cy - [Welsh](https://en.wikipedia.org/wiki/Welsh_language)

**da-** [Danish](https://en.wikipedia.org/wiki/Danish_language)

**de -** [German](https://en.wikipedia.org/wiki/German_language)

dv - [Divehi](https://en.wikipedia.org/wiki/Dhivehi_language)

**el -** [Greek](https://en.wikipedia.org/wiki/Greek_language)

**en -** [English](https://en.wikipedia.org/wiki/English_language)

eo - [Esperanto](https://en.wikipedia.org/wiki/Esperanto)

**es -** [Spanish](https://en.wikipedia.org/wiki/Spanish_language)

**et -** [Estonian](https://en.wikipedia.org/wiki/Estonian_language)

eu - [Basque](https://en.wikipedia.org/wiki/Basque_language)

fa - [Persian](https://en.wikipedia.org/wiki/Persian_language)

**fi -** [Finnish](https://en.wikipedia.org/wiki/Finnish_language)

**fr -** [French](https://en.wikipedia.org/wiki/French_language)

fy - [Western Frisian](https://en.wikipedia.org/wiki/West_Frisian_language)

**ga-** [Irish](https://en.wikipedia.org/wiki/Irish_language)

**gd -**[Gaelic](https://en.wikipedia.org/wiki/Scottish_Gaelic)

gl - [Galician](https://en.wikipedia.org/wiki/Galician_language)

gn - [Guarani](https://en.wikipedia.org/wiki/Guarani_language)

gu - [Gujarati](https://en.wikipedia.org/wiki/Gujarati_language)

gv - [Manx](https://en.wikipedia.org/wiki/Manx_language)

he- [Hebrew](https://en.wikipedia.org/wiki/Hebrew_language)

hi - [Hindi](https://en.wikipedia.org/wiki/Hindi)

**hr -** [Croatian](https://en.wikipedia.org/wiki/Croatian_language)

ht - [Haitian](https://en.wikipedia.org/wiki/Haitian_Creole_language)

**hu-** [Hungarian](https://en.wikipedia.org/wiki/Hungarian_language)

hy - [Armenian](https://en.wikipedia.org/wiki/Armenian_language)

id - [Indonesian](https://en.wikipedia.org/wiki/Indonesian_language)

ie - [Interlingue](https://en.wikipedia.org/wiki/Interlingue)

io - [Ido](https://en.wikipedia.org/wiki/Ido_(language))

is - [Icelandic](https://en.wikipedia.org/wiki/Icelandic_language)

**it -** [Italian](https://en.wikipedia.org/wiki/Italian_language)

ja - [Japanese](https://en.wikipedia.org/wiki/Japanese_language)

jv - [Javanese](https://en.wikipedia.org/wiki/Javanese_language)

ka - [Georgian](https://en.wikipedia.org/wiki/Georgian_language)

kk - [Kazakh](https://en.wikipedia.org/wiki/Kazakh_language)

km - [Central Khmer](https://en.wikipedia.org/wiki/Central_Khmer_language)

kn - [Kannada](https://en.wikipedia.org/wiki/Kannada_language)

ko - [Korean](https://en.wikipedia.org/wiki/Korean_language)

ku - [Kurdish](https://en.wikipedia.org/wiki/Kurdish_language)

kv - [Komi](https://en.wikipedia.org/wiki/Komi_language)

kw - [Cornish](https://en.wikipedia.org/wiki/Cornish_language)

ky - [Kirghiz](https://en.wikipedia.org/wiki/Kirghiz_language)

la - [Latin](https://en.wikipedia.org/wiki/Latin)

lb - [Luxembourgish](https://en.wikipedia.org/wiki/Luxembourgish_language)

li - [Limburgan](https://en.wikipedia.org/wiki/Limburgan_language)

lo - [Lao](https://en.wikipedia.org/wiki/Lao_language)

**lt -** [Lithuanian](https://en.wikipedia.org/wiki/Lithuanian_language)

**lv -** [Latvian](https://en.wikipedia.org/wiki/Latvian_language)

mg - [Malagasy](https://en.wikipedia.org/wiki/Malagasy_language)

mk - [Macedonian](https://en.wikipedia.org/wiki/Macedonian_language)

ml - [Malayalam](https://en.wikipedia.org/wiki/Malayalam_language)

mn - [Mongolian](https://en.wikipedia.org/wiki/Mongolian_language)

mr - [Marathi](https://en.wikipedia.org/wiki/Marathi_language)

ms - [Malay](https://en.wikipedia.org/wiki/Malay_language)

**mt -** [Maltese](https://en.wikipedia.org/wiki/Maltese_language)

my - [Burmese](https://en.wikipedia.org/wiki/Burmese_language)

ne - [Nepali](https://en.wikipedia.org/wiki/Nepali_language)

**nl -** [Dutch](https://en.wikipedia.org/wiki/Dutch_language)

nn - [Norwegian Nynorsk](https://en.wikipedia.org/wiki/Nynorsk)

no - [Norwegian](https://en.wikipedia.org/wiki/Norwegian_language)

oc - [Occitan](https://en.wikipedia.org/wiki/Occitan_language)

or - [Oriya](https://en.wikipedia.org/wiki/Oriya_language)

os - [Ossetian](https://en.wikipedia.org/wiki/Ossetian_language)

pa - [Punjabi](https://en.wikipedia.org/wiki/Punjabi_language)

**pl -** [Polish](https://en.wikipedia.org/wiki/Polish_language)

ps - [Pashto](https://en.wikipedia.org/wiki/Pashto_language)

**pt -** [Portuguese](https://en.wikipedia.org/wiki/Portuguese_language)

qu - [Quechua](https://en.wikipedia.org/wiki/Quechua_language)

rm - [Romansh](https://en.wikipedia.org/wiki/Romansh_language)

**ro -** [Romanian](https://en.wikipedia.org/wiki/Romanian_language)**,** [Moldavian](https://en.wikipedia.org/wiki/Moldovan_language)**,**

**ru -** [Russian](https://en.wikipedia.org/wiki/Russian_language)

sa - [Sanskrit](https://en.wikipedia.org/wiki/Sanskrit)

sc - [Sardinian](https://en.wikipedia.org/wiki/Sardinian_language)

sd - [Sindhi](https://en.wikipedia.org/wiki/Sindhi_language)

sh - ?

si - [Sinhala](https://en.wikipedia.org/wiki/Sinhala_language)

**sk -** [Slovak](https://en.wikipedia.org/wiki/Slovak_language)

**sl -** [Slovenian](https://en.wikipedia.org/wiki/Slovene_language)

so - [Somali](https://en.wikipedia.org/wiki/Somali_language)

sq - [Albanian](https://en.wikipedia.org/wiki/Albanian_language)

sr - [Serbian](https://en.wikipedia.org/wiki/Serbian_language)

su - [Sundanese](https://en.wikipedia.org/wiki/Sundanese_language)

**sv -** [Swedish](https://en.wikipedia.org/wiki/Swedish_language)

sw - [Swahili](https://en.wikipedia.org/wiki/Swahili_language)

ta - [Tamil](https://en.wikipedia.org/wiki/Tamil_language)

te - [Telugu](https://en.wikipedia.org/wiki/Telugu_language)

tg - [Tajik](https://en.wikipedia.org/wiki/Tajik_language)

th - [Thai](https://en.wikipedia.org/wiki/Thai_language)

tk - [Turkmen](https://en.wikipedia.org/wiki/Turkmen_language)

tl - [Tagalog](https://en.wikipedia.org/wiki/Tagalog_language)

**tr -** [Turkish](https://en.wikipedia.org/wiki/Turkish_language)

tt - [Tatar](https://en.wikipedia.org/wiki/Tatar_language)

ug - [Uighur](https://en.wikipedia.org/wiki/Uighur_language)

uk - [Ukrainian](https://en.wikipedia.org/wiki/Ukrainian_language)

ur - [Urdu](https://en.wikipedia.org/wiki/Urdu)

uz -  [Uzbek](https://en.wikipedia.org/wiki/Uzbek_language)

vi -  [Vietnamese](https://en.wikipedia.org/wiki/Vietnamese_language)

vo - [Volapük](https://en.wikipedia.org/wiki/Volap%C3%BCk)

wa - [Walloon](https://en.wikipedia.org/wiki/Walloon_language)

yi - [Yiddish](https://en.wikipedia.org/wiki/Yiddish_language)

yo - [Yoruba](https://en.wikipedia.org/wiki/Yoruba_language)

zh - [Chinese](https://en.wikipedia.org/wiki/Chinese_language)
