Package org.apache.lucene.analysis.core
Class LetterTokenizerFactory
java.lang.Object
org.apache.lucene.analysis.AbstractAnalysisFactory
org.apache.lucene.analysis.TokenizerFactory
org.apache.lucene.analysis.core.LetterTokenizerFactory
Factory for
LetterTokenizer
.
<fieldType name="text_letter" class="solr.TextField" positionIncrementGap="100"> <analyzer> <tokenizer class="solr.LetterTokenizerFactory" maxTokenLen="256"/> </analyzer> </fieldType>Options:
- maxTokenLen: max token length, must be greater than 0 and less than MAX_TOKEN_LENGTH_LIMIT
(1024*1024). It is rare to need to change this else
CharTokenizer
::DEFAULT_MAX_TOKEN_LEN
- Since:
- 3.1
-
Field Summary
FieldsFields inherited from class org.apache.lucene.analysis.AbstractAnalysisFactory
LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion
-
Constructor Summary
ConstructorsConstructorDescriptionDefault ctor for compatibility with SPILetterTokenizerFactory
(Map<String, String> args) Creates a new LetterTokenizerFactory -
Method Summary
Modifier and TypeMethodDescriptioncreate
(AttributeFactory factory) Creates a TokenStream of the specified input using the given AttributeFactoryMethods inherited from class org.apache.lucene.analysis.TokenizerFactory
availableTokenizers, create, findSPIName, forName, lookupClass, reloadTokenizers
Methods inherited from class org.apache.lucene.analysis.AbstractAnalysisFactory
defaultCtorException, get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames
-
Field Details
-
NAME
SPI name- See Also:
-
maxTokenLen
private final int maxTokenLen
-
-
Constructor Details
-
LetterTokenizerFactory
Creates a new LetterTokenizerFactory -
LetterTokenizerFactory
public LetterTokenizerFactory()Default ctor for compatibility with SPI
-
-
Method Details
-
create
Description copied from class:TokenizerFactory
Creates a TokenStream of the specified input using the given AttributeFactory- Specified by:
create
in classTokenizerFactory
-