public class NGramTokenizer
extends org.apache.lucene.analysis.Tokenizer
Modifier and Type | Field and Description |
---|---|
static int |
DEFAULT_MAX_NGRAM_SIZE |
static int |
DEFAULT_MIN_NGRAM_SIZE |
Constructor and Description |
---|
NGramTokenizer(org.apache.lucene.util.AttributeSource.AttributeFactory factory,
Reader input,
int minGram,
int maxGram)
Creates NGramTokenizer with given min and max n-grams.
|
NGramTokenizer(org.apache.lucene.util.AttributeSource source,
Reader input,
int minGram,
int maxGram)
Creates NGramTokenizer with given min and max n-grams.
|
NGramTokenizer(Reader input)
Creates NGramTokenizer with default min and max n-grams.
|
NGramTokenizer(Reader input,
int minGram,
int maxGram)
Creates NGramTokenizer with given min and max n-grams.
|
Modifier and Type | Method and Description |
---|---|
void |
end() |
boolean |
incrementToken()
Returns the next token in the stream, or null at EOS.
|
org.apache.lucene.analysis.Token |
next()
Deprecated.
Will be removed in Lucene 3.0. This method is final, as it should
not be overridden. Delegates to the backwards compatibility layer.
|
org.apache.lucene.analysis.Token |
next(org.apache.lucene.analysis.Token reusableToken)
Deprecated.
Will be removed in Lucene 3.0. This method is final, as it should
not be overridden. Delegates to the backwards compatibility layer.
|
void |
reset() |
void |
reset(Reader input) |
getOnlyUseNewAPI, setOnlyUseNewAPI
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
public static final int DEFAULT_MIN_NGRAM_SIZE
public static final int DEFAULT_MAX_NGRAM_SIZE
public NGramTokenizer(Reader input, int minGram, int maxGram)
input
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic NGramTokenizer(org.apache.lucene.util.AttributeSource source, Reader input, int minGram, int maxGram)
source
- AttributeSource
to useinput
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic NGramTokenizer(org.apache.lucene.util.AttributeSource.AttributeFactory factory, Reader input, int minGram, int maxGram)
factory
- AttributeSource.AttributeFactory
to useinput
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic final boolean incrementToken() throws IOException
incrementToken
in class org.apache.lucene.analysis.TokenStream
IOException
public final void end()
end
in class org.apache.lucene.analysis.TokenStream
public final org.apache.lucene.analysis.Token next(org.apache.lucene.analysis.Token reusableToken) throws IOException
next
in class org.apache.lucene.analysis.TokenStream
IOException
public final org.apache.lucene.analysis.Token next() throws IOException
next
in class org.apache.lucene.analysis.TokenStream
IOException
public void reset(Reader input) throws IOException
reset
in class org.apache.lucene.analysis.Tokenizer
IOException
public void reset() throws IOException
reset
in class org.apache.lucene.analysis.TokenStream
IOException
Copyright © 2000-2012 Apache Software Foundation. All Rights Reserved.