Ctrl+K
Squirro Documentation - Home

Overview

  • Getting Started
  • Squirro Products
    • Chat
    • Search
    • Insight Engine

Getting Squirro

  • Installation and Upgrade
    • Install and Manage Squirro with Ansible
      • Ansible Quickstart Examples
      • Role Variables
      • Automate the Backup of Elasticsearch
      • Secure Elasticsearch with SSL/TLS
      • Leveraging NVMe SSDs for Elasticsearch speed
    • Deploying Squirro using Containers
      • Squirro Minimal Container Image
      • Container Reference
    • Cluster Expansion
    • Elasticsearch Migration
    • Installing Squirro on Linux
    • System Requirements
    • Upgrading
    • Upgrading Configuration Conflicts
    • Upgrading Earlier Versions
  • Squirro Self-Service
    • How-To Guides
      • Squirro Chat Data Guide
      • Squirro Chat Web Guide
      • How to Connect Squirro Chat to a Third-Party LLM
      • How to Connect Squirro Chat to a Microsoft Azure LLM
      • Install an Application
      • Open a Demo
      • Launch a Test Drive
      • Register for a Squirro ID
    • Cluster Roles and Permissions
    • Email Domain-Based Permissions
    • Instances
    • Upgrading an Instance
  • Release Notes
    • 3.13.2 (latest)
      • 3.13.0 Release Notes
      • 3.13.1 Release Notes
    • 3.12.1 LTS
    • 3.11.6 LTS
      • Squirro 3.11.x Release Notes
        • 3.11.5 Release Notes
        • 3.11.4 Release Notes
        • 3.11.3 Release Notes
        • 3.11.2 Release Notes
        • 3.11.1 Release Notes
        • 3.11.0 Release Notes
    • 3.10.6 LTS
      • Squirro 3.10.x Release Notes
        • 3.10.0 - Release Notes
        • 3.10.1 - Release Notes
        • 3.10.2 - Release Notes
        • 3.10.3 - Release Notes
        • 3.10.4 - Release Notes
        • 3.10.5 - Release Notes
    • 3.9.7 LTS
      • 3.9.7 LTS Release Notes
      • SquirroGPT Release Highlights
      • Squirro 3.9.x Release Notes
        • 3.9.0 Release Notes
        • 3.9.1 Release Notes
        • 3.9.2 Release Notes
        • 3.9.3 Release Notes
        • 3.9.4 Release Notes
        • 3.9.5 Release Notes
    • 3.8.7 LTS
      • 3.8.7 LTS Release Notes
      • 3.8.6 LTS Release Notes
      • Squirro 3.8.x Release Notes
        • 3.8.0 - Release Notes
        • 3.8.1 - Release Notes
        • 3.8.2 - Release Notes
        • 3.8.3 - Release Notes
        • 3.8.4 - Release Notes
        • 3.8.5 - Release Notes
    • 3.7.6 LTS
      • 3.7.6 LTS - Release Notes
      • 3.7.5 LTS Release Notes
      • Squirro 3.7.x Release Notes
        • 3.7.1 - Release Notes
        • 3.7.2 - Release Notes
        • 3.7.3 - Release Notes
        • 3.7.4 - Release Notes
    • 3.6.8 LTS
      • 3.6.8 LTS Release Notes
      • Squirro 3.6.8 LTS - Cognitive Search Improvements
      • Squirro 3.6.x Release Notes
        • 3.6.0 - Release Notes
        • 3.6.1 - Release Notes
        • 3.6.2 - Release Notes
        • 3.6.3 - Release Notes
        • 3.6.4 - Release Notes
        • 3.6.5 - Release Notes
        • 3.6.6 - Release Notes
    • 3.5.8 LTS
      • 3.5.8 LTS Release Notes
      • 3.5.8 LTS - Cognitive Search Improvements
      • 3.5.9 LTS - Release Notes
      • 3.5.x Release Notes
        • 3.5.7 Release Notes
        • 3.5.6 Release Notes
        • 3.5.5 Release Notes
        • 3.5.4 Release Notes
        • 3.5.3 Release Notes
        • 3.5.2 Release Notes
        • 3.5.1 Release Notes
        • 3.5.0 Release Notes
    • 3.4.7 LTS
      • 3.4.7 LTS Release Notes
        • 3.4.X Release Notes
      • 3.4.X Release Notes
        • 3.4.0 Release Notes
        • 3.4.1 Release Notes
        • 3.4.2 Release Notes
        • 3.4.3 Release Notes
        • 3.4.4 Release Notes
        • 3.4.5 Release Notes
        • 3.4.6 Release Notes
    • Squirro Release Process

Technical Docs

  • Administration
    • Configuration
      • Configuration Files
        • cluster.ini
        • common.ini
        • configuration.ini
        • convert.ini
        • datasource.ini
        • digestmailer.ini
        • emailsender.ini
        • filtering.ini
        • fingerprint.ini
        • frontend.ini
        • genai.ini
        • ingester.ini
        • topic.ini
        • /etc/sysconfig
      • Configuration Service
      • Default Language
      • Email Templates
      • Enable Proxy Server for Outgoing Calls
      • High Performance Configuration
      • Interpolation
      • Securing Configuration Files
      • Secure Configuration Guide
      • Securing Redis Instance over SSL
      • SSL Certificates
    • External Authentication
      • Architecture for Authentication
      • Query Templates
      • User Management in the UI
      • SAML SSO for Squirro
      • - ADFS Setup
      • - Azure Setup
      • - Google Setup
      • - Okta Setup
    • Operations
      • Accessing Servers
      • Activity Tracking
      • Business Continuity Planning
      • Cluster Status
      • Database Backup and Restore
      • Reindexing Elasticsearch
      • Elasticsearch Management
      • Fixing MySQL/MariaDB Replication
      • How Squirro Scales
      • Monitoring
      • Services
      • How to Set Up Oracle Database as Squirro’s Metadata Storage
      • Deploying the Plumber service in a Docker container
    • Troubleshooting
      • Internet Explorer Compatibility
      • Investigating Performance Issues
      • MySQL Big Data Management
      • MySQL Too Many Connections
      • Flushing Caches
      • Python Performance Profiling Using PySpy
  • Agent Framework
  • AI Guardrails
  • AI Studio
    • How-To Guides
      • Bulk Labeling
      • Create Document-Level Models
      • Create Sentence-Level Models
      • Integrating a Custom ML Classifier
      • Interact with Squirro Using Jupyter Notebook
    • Step 1: Ground Truth
    • Step 2: Models
    • Step 3: Publish and Deploy
    • Share Labeling Permissions
    • Bulk Labeling
    • ML Enrichments for Pipeline Workflows
    • Squirro Client Reference
  • APIs and SDKs
    • SquirroClient (Python SDK)
      • APIs by Topic
        • CollectionsMixin
        • CommunitiesMixin
        • CommunitySubscriptionsMixin
        • CommunityTypesMixin
        • ConfigurationMixin
        • ContributingRecordsMixin
        • DashboardsMixin
        • EmailTemplatesMixin
        • EnrichmentsMixin
        • EntitiesMixin
        • FacetsMixin
        • FileUploadMixin
        • GlobalTempMixin
        • MLCandidateSetMixin
        • MLGroundTruthMixin
        • MLModelsMixin
        • MLPublishMixin
        • MLSentenceSplitterMixin
        • MLTemplatesMixin
        • MLUserFeedbackMixin
        • MachineLearningMixin
        • NotesMixin
        • ObjectsMixin
        • PipelineSectionsMixin
        • PipelineStatusMixin
        • PipelineWorkflowMixin
        • ProjectGuideFilesMixin
        • ProjectTranslationsMixin
        • ProjectsMixin
        • SavedSearchesMixin
        • SmartAnswersMixin
        • SmartfiltersMixin
        • SourcesMixin
        • SubscriptionsMixin
        • SuggestImageMixin
        • SynonymsMixin
        • TasksMixin
        • ThemesMixin
        • TopicApiBaseMixin
        • TrendDetectionMixin
        • WidgetsAndAssetsMixin
      • DocumentUploader Class
      • GenAI service API
        • GenAIApiMixin
      • Installation
      • ItemUploader Class
      • Setup Class
      • SquirroClient Tutorial
      • User Management
        • UserApiMixin
    • Squirro Toolbox
      • Bulk Exporter
      • Install In a Python Environment
      • squirro_asset CLI Reference
      • Toolbox Differences Between macOS / Linux / Windows
    • Authentication
    • Catalyst Data Model
    • Common Headers
    • Common Status Codes
    • Data Modeling
    • Item Format
    • JavaScript SDK
    • Plugin Repository
    • Custom Sections API
  • Architecture
    • Architecture Diagrams
    • General Concepts
  • Collections
  • Communities
    • Augmentation
    • Auto-Subscription
    • Communities Tutorial
    • CSV and Excel Formatting for Upload
    • Managing Communities
    • Setting Up Community Types
    • How To Set Up Using KEE
    • Visualizing Communities
  • Dashboards
    • Dashboard Editor
    • Dashboard Store
    • Dashboard Types
      • Community 360 Dashboard
      • Explore Dashboard
      • Global Search Dashboard
      • Layout Master Dashboard
    • Layers
    • Mobile Dashboard Editor
    • Permissions
    • Query Parameterization
    • Upgrading Dashboards Manually
    • Visibility Conditions
  • Data Loading
    • How-To Guides
      • CLI Tool Tutorial
      • Creating a Custom Connector
      • Creating a Custom Plugin
      • Labels Tutorial
      • UI Data Loading Guide
    • Command Line Tool
    • Connectors
      • Built-In Data Connectors
        • CSV Connector
        • Documents Connector
        • Excel Connector
        • Squirro Connector
        • Web Crawler Connector
      • Cloud Connectors
        • Dropbox Connector
        • Google Drive Connector
        • Microsoft One Drive Connector
      • Enterprise Connectors
        • Atlassian Confluence Connector
        • Atlassian Jira Connector
        • Google Gmail Connector
        • Microsoft Exchange Connector
        • Microsoft Sharepoint Connector
        • Salesforce Sales Cloud Connector
        • Salesforce Service Cloud Connector
        • Webz.io Connector
    • Data Types
    • Date Format
    • Data Loader Reference
    • Format Strings
    • Labels
    • Plugins
      • API for Caching and Custom State Management
      • Boilerplate
      • Configuration
      • DataSource Class Reference
      • Dependencies
      • Example Data Loader Plugin
      • Incremental Loading
      • Preview
      • Templates
    • Troubleshooting
    • UI Data Loader
  • Data Processing Pipeline
    • Built-In Steps
      • Load
      • Enrich Steps
        • Unshorten Link
        • Duplicate Detection
        • Content Augmentation
        • Content Extraction
        • PDF OCR
        • Noise Removal
        • Near Duplicate Detection
        • Thumbnail Extraction
        • Language Detection
        • PDF Conversion
      • Relate
      • Discover
      • Classify
      • Predict
      • Recommend
      • Automate
      • Index Steps
        • Content Standardization
        • Cache Cleaning
        • Indexing
        • Search Tagging and Alerting
      • Flow
    • Custom Steps
      • Pipelets (Custom Step)
      • Squirro Scripts
    • Indexing Common Formats
    • Content Streamers
    • Pipeline Editor
    • Pipeline Overview
    • Prioritization
    • Processing Errors
    • Reset Project
    • Reruns
    • Trend Detection
  • Data Virtualization
  • Integrations
    • Atlassian (Confluence & Jira)
    • Embedding Dashboards
    • Microsoft Dynamics, Sharepoint, and Office
    • Newsletters
    • OpenSearch API
    • PegaSystems - Pega
    • Outlook
    • Qlik Sense
    • Salesforce
    • ServiceNow Insights
    • Tableau
    • Installation Guides
      • Squirro for Salesforce Installation
      • Salesforce Federated Search Installation
      • Microsoft Outlook Installation
  • Known Entity Extraction
    • Command Line Tool
    • Command Line Tool Tutorial
    • Configuration
    • Studio Plugin
    • Studio Plugin Tutorial
    • Testing
    • Tokenizers and Filters
  • libNLP
    • Base Types
    • How to Create Custom Query-Processing Steps
    • Query Processing
      • CustomSpacyNormalizer
      • IntentDetector
      • LanguageDetection
      • LemmaExpander
      • POSBooster
      • QueryClassifier
      • QueryModifier
      • QuerySyntaxParser
      • QueryZeroShotClassifier
      • SemanticTermExpander
    • Step Types
      • Standard Types
      • Analyzers Package
        • make_analyzer
        • Analyzer
        • ProximityValidation
      • Classifiers Package
        • make_classifier
        • AutoMLClassifier
        • BERTSentiment
        • Classifier
        • CosineSimilarityClassifier
        • FastTextClassifier
        • KFoldValidation
        • SklearnClassifier
        • SmartfilterClassifier
        • VaderSentiment
      • Debuggers Package
        • make_debugger
        • Debugger
        • LogFieldsDebugger
      • Embedders Package
        • make_embedder
        • BowEmbedder
        • Embedder
        • SklearnTFIDFEmbedder
        • TermsExtractionEmbedder
        • TransformerEmbedder
      • External Package
        • make_step
        • EndpointStep
        • MlflowMaasEndpointStep
        • RemoteQuestionAnswering
        • RemoteSpacy
      • Filters Package
        • make_filter
        • AggregateFilter
        • BlacklistFilter
        • CoalesceFilter
        • CopyFilter
        • DocJoinFilter
        • DocSplitFilter
        • EmptyFilter
        • Filter
        • JoinFilter
        • MergeFilter
        • ProximityFilter
        • RegexFilter
        • SplitFilter
        • SquirroEntityFilter
        • ThresholdFilter
        • VoteFilter
        • WhitelistFilter
      • Flow Package
        • make_flow_step
        • ConditionStep
      • Loaders Package
        • make_loader
        • CSVLoader
        • FileLoader
        • JSONLoader
        • Loader
        • SquirroGroundtruthLoader
        • SquirroItemLoader
        • SquirroQueryLoader
      • Normalizers Package
        • make_normalizer
        • CharacterNormalizer
        • EmailParseNormalizer
        • HTMLNormalizer
        • LowercaseNormalizer
        • Normalizer
        • PunctuationNormalizer
        • SentimentTermNormalizer
        • SpacyNormalizer
        • StopwordsNormalizer
      • Projectors Package
        • make_projector
        • Projector
        • SklearnProjector
      • Runtimes Package
        • make_runtime_step
        • ONNXRuntime
        • Runtime
      • Savers Package
        • make_saver
        • CSVSaver
        • JSONSaver
        • Saver
        • SquirroEntityCleaner
        • SquirroItemSaver
      • Tokenizers Package
        • make_tokenizer
        • HtmlTokenizer
        • PdfSentencesTokenizer
        • SentencesNLTKTokenizer
        • SpacesTokenizer
        • Tokenizer
    • Troubleshooting & FAQ
    • Utils
      • Standard Types
      • Cache Package
        • get_model_cache_client
        • Cache
        • CacheWithExpiration
        • ExpiringCache
        • MemoryCache
        • ModelCacheClient
      • Model Management Package
        • InMemModel
        • ModelNotInMemoryException
      • Transformers Package
        • get_transformer
        • Huggingface_Transformers
        • SentenceTransformer
        • Tensorflow_Transformer
        • Transformer
  • Machine Learning
    • Example MLFlow Model
    • How To Publish ML Models Using the Squirro Client
    • Model-as-a-Service
    • Significant Terms Extraction
  • Pipelets
    • How-To Guides
      • Pipelets Tutorial
      • How to Access File Contents in Pipelets
      • How to Use Pipelets With the Squirro Data Loader
    • Additional Labeling Pipelet
    • Development Workflow
    • Pipelets and the Dataloader
    • Pipelets Reference
    • Rerunning a Pipelet
    • Scaling Pipelet Execution
    • Time Formats Pipelet
    • Troubleshooting and FAQ
    • Writing Pipelets
  • Privacy Layer
  • Project Templates
    • Configuration
    • Export and Import
    • Overview
  • Retrieval Augmented Generation
  • Search
    • Features
      • Concept Search
      • Other People Ask
      • Popular Query Suggestions
      • Question Answering
      • Query Syntax
      • Search Bar Chips
      • Semantic and Hybrid Search
      • Spellchecking
      • Typeahead Suggestions
      • Favorite Filters
    • How-To Guides
      • Best-Bets Labels
      • Cognitive Search Set Up
      • Configure Other People Ask
      • Configure Question Answering
      • Configure Scoring Profiles for Document Relevancy
      • Handle Query Terms
    • Language Support
    • Document Relevancy
      • Scoring Profiles and Roles
      • Scoring Plugins
        • Recommend
        • Rerank
        • Retrieve
        • View
    • Query Processing
    • Recommendations
    • Searchable File Types
    • Synonyms
  • Synaptica
  • User Interface
    • App and Nav Bar Styling
    • Connecting to Squirro
    • Note Taking
    • Overview
    • Project Browser
    • Reference Screen
    • Roles & Permissions
    • Spaces
    • Squirro Monitoring
    • Studio
      • ML Workflows
      • ML Jobs
    • Themes
  • Widgets
    • Built-In Widgets
      • Action Widget
      • Bar Chart Widget
      • Batch Q&A
      • Breadcrumbs Widget
      • Chat Widget
      • Communities Widget
      • Communities Banner Widget
      • Divider Widget
      • Engagement Map Widget
      • Entities Widget
      • Favorites Widget
      • Heat Map Widget
      • HTML Editor Widget
      • iFrame Widget
      • Item Detail Widget
      • Items Table Widget
      • Items Widget
      • Labels Widget
      • Line Chart Widget
      • Metrics Widget
      • Navigation Chips Widget
      • Pie Chart Widget
      • QA Widget
      • Region Map Widget
      • Reset Filters Widget
      • Rich Text Editor Widget
      • Search Bar Widget
      • Spelling Correction Widget
      • Table Widget
      • Tabs Widget
      • Time Selection Widget
      • Timeline Widget
      • Word Cloud Widget
      • World Map Widget
    • Custom Widgets
    • How to Create a Custom Widget
    • Managing Widgets in the UI
    • Squirro Widget SDK
      • Core Widgets
      • Properties
      • Factories
      • Utils
    • React Custom Widgets
      • How-Tos and Walkthroughs
        • How To Opt In To React Widgets
        • How To Style React Widgets
        • Items Widget Styling Walkthrough
        • Adding Tooltips to Tabs Widget Walkthrough
      • Available React Hooks
      • Available Libraries
      • Creating Custom Widgets
      • Customizing Widgets
      • Getting Started with React
      • Squirro Storybook
      • Styling React Components
    • Backbone Custom Widgets
      • Custom Widgets Life Cycle
      • Custom Widgets for Dashboards
      • Squirro Widget CLI Reference
      • Custom Widgets and the Dashboard Store
      • Example Card or Result List Custom Widget
      • Tutorials
        • Getting Started
        • Accessing Data
      • Common Knowledge
        • FAQ
        • Debugging
        • Models, Views, & Collections
        • JavaScript
  • Workspaces

Engage

  • Forum
  • Support
  • Redefining AI Podcast

Other

  • Security
    • Security Advisories
      • CVE-2021-27945 - Cross-Site Scripting
      • CVE-2021-44228 - log4j Security Vulnerability
  • Squirro Profiles
    • System Administrator/DevOps Engineer
    • Project Creator
    • Data Scientist
    • Model Creator
    • Search Engineer
    • Python Engineer
    • Frontend Developer
    • Cognitive Search User
  • Squirro A to Z
    • Squirro Glossary
    • Glossary of Industry Terms
    • Index
  • squirro.com
  • Squirro Academy
  • Terms & Conditions

Concept Search

Contents

  • Introduction
  • Contextual Concept Search
    • Limitations

Concept Search#

Profiles: Project Creator, Search User

This page explains Concept Search, a Squirro feature that provides a means of searching without inputting an exact keyword query.

Concept search comes preconfigured out of the box, though project creators will need to ensure that the Global Search dashboard is configured correctly.

For search users, the feature is available within any Squirro document.

Introduction#

Concept search is a technology where a search engine can return documents matching a defined concept (see Wikipedia’s article on Concept Search for further background).

In standard full-text search, some sort of boolean search is used to return relevant documents. You can enter a query such as technology company to find any document that matches both technology and company. In concept search, this would be defined as a concept, where the system is taught to understand what “technology company” means.

It will then take into account additional terms around this area and search for those as well - for example the technology company concept may potentially include terms such as IT or Silicon Valley.

As a result, the search engine can return more and better results for this concept.

Contextual Concept Search#

Contextual concept search is exposed to end users in the form of a search icon when making a selection.

When clicking on that search, a concept search is executed returning documents that match the key aspects of the selected text.

Whenever content is selected, this shows a search icon around the selected text.

image1

When clicking that button, the selection is used as search input to create a concept search.

Query results are returned that conceptually match the selected text, without all of the words having to appear in the returned documents.

To clearly show the difference, this is shown to the user as a separate text bubble in the search bar.

Tip: When hovering over the bubble, a tool-tip shows an extract of the text used for the concept search.

image2

Limitations#

The contextual concept search functionality depends on a Global Search dashboard existing and will display the results using that dashboard.

Reference: Learn more about Global Search Dashboard.

Contents
  • Introduction
  • Contextual Concept Search
    • Limitations

By Squirro AG

© Copyright 2025, Squirro AG.

Last updated on Jun 19, 2024.