Solr Architecture 5d3r4o

Lucene/Solr Architecture Request Handlers /

/select

Response Writers /spell

XML

Binary

Update Handlers

JSON

Search Components

XML Update Processors

Query

Highlighting

Spelling

Statistics

Faceting

Debug

More like this

Clustering

Signature

Schema

Logging Indexing

Config

Distributed Search

Query Parsing Analysis

Faceting

Filtering

Search

Caching

CSV

binary

Extracting Request Handler (PDF/WORD) Apache Tika Data Import Handler (SQL/RSS)

Highlighting Index Replication

Core Search IndexReader/Searcher

Apache Lucene Text Analysis

Indexing IndexWriter 1

Lucene/Solr plugins • RequestHandlers – handle a request at a URL like /select • SearchComponents – part of a SearchHandler, a componentized request handler – Includes, Query, Facet, Highlight, Debug, Stats – Distributed Search capable

• UpdateHandlers – handle an indexing request • Update Processor Chains – per-handler componentized chain that handle updates • Query Parser plugins – Mix and match query types in a single request – Function plugins for Function Query

• Text Analysis plugins: Analyzers, Tokenizers, TokenFilters • ResponseWriters serialize & stream response to client 2

Lucene/Solr Query Plugin Architecture Declarative Analysis per-field - Tokenizer to split text - TokenFilter to transform tokens - Analyzer for completely custom - Separate query / index analyzer QParser plugins - different query syntaxes - different query execution - Function Query s pluggable custom functions - Excellent for nesting/mixing different query types in the same request. Lucene QParser XML QParser DisMax QParser Function Range Q

Analyzer for “title”

Whitespace Tokenizer CustomFilter SynonymFilter Porter Stemmer

schema.xml // declaratively defines types // and analyzers for fields
Analyzer for “cust1” (potentially completely custom architecture not using tokenizer/filters)

MyCustom QParser Function QParser

sum pow sqrt

max log custom


solrconfig.xml < index configuration /> < caching configuration /> < request handler config /> < search component config /> < update processor config /> < misc – HTTP cache, JMX > <parser name=“mycustom” …
Lucene/Solr Request Plugins {“response”={ “docs”={

http://.../select?q=cheese&wt=json /select RequestHandler Query Component Facet Component Highlight Component

//luke

Request Handler (noncomponent based)

/mypath

Request Handler (custom)

Debug Component Distributed Search Query Response

Additional plug-n-play search components TermVector QueryElevation Spellcheck Clustering

MoreLikeThis

Statistics

XML response writer XSLT response writer Binary response writer JSON response writer Custom response writer

My Custom 4

Lucene/Solr Indexing <doc>

PDF HTTP POST

/update XML Update Handler

HTTP POST

/update/csv

/update/xml

/update/extract

CSV Update Handler

XML Update with custom processor chain

Extracting RequestHandler (PDF, Word, …)

Update Processor Chain (per handler) RSS feed

SQL DB

pull

pull

Data Import Handler

Remove Duplicates processor

Database pull RSS pull Simple transforms

Custom Transform processor Logging processor Index processor

Text Index Analyzers Lucene

Lucene Index 5