TextAnalyzerBase class Null safety
A ITextAnalyzer implementation that extracts tokens from text for use in full-text search queries and indexes:
- configuration is used by the TextAnalyzer to tokenize source text (default is English.configuration); and
- provide a custom tokenFilter if you want to manipulate tokens or restrict tokenization to tokens that meet specific criteria (default is TextAnalyzer.defaultTokenFilter, applies Porter2Stemmer); and
- the tokenize function tokenizes source text using the configuration and then manipulates the output by applying tokenFilter; and
- the tokenizeJson function extracts tokens from the zones in a JSON document.
- Implemented types
- Implementers
Constructors
- TextAnalyzerBase()
-
Instantiates a const TextAnalyzerBase instance.
const
Properties
- configuration → TextAnalyzerConfiguration
-
The TextAnalyzerConfiguration used by the ITextAnalyzer.
read-only, inherited
- hashCode → int
-
The hash code for this object.
read-only, inherited
- runtimeType → Type
-
A representation of the runtime type of the object.
read-only, inherited
- tokenFilter → TokenFilter?
-
A filter that returns a subset of tokens.
read-only, inherited
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a non-existent method or property is accessed.
inherited
-
tokenize(
SourceText text, [Zone? zone]) → Future< List< Token> > -
Extracts tokens from
sourcefor use in full-text search queries and indexes.override -
tokenizeJson(
Map< String, dynamic> document, [Iterable<Zone> ? zones]) → Future<List< Token> > -
Extracts tokens from the
zonesin a JSONdocumentfor use in full-text search queries and indexes.override -
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited