TextTokenizerBase class Null safety

A TextTokenizer implementation that mixes in TextTokenizerMixin, which implements TextTokenizer.tokenize and TextTokenizer.tokenizeJson.

Mixed in types

Constructors

TextTokenizerBase()
Instantiates a const TextTokenizerBase instance.
const

Properties

analyzer → TextAnalyzer
The TextAnalyzer used by the TextTokenizer.
read-only, inherited
hashCode → int
The hash code for this object.
read-only, inherited
runtimeType → Type
A representation of the runtime type of the object.
read-only, inherited
tokenFilter → TokenFilter?
A filter that returns a subset of tokens.
read-only, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a non-existent method or property is accessed.
inherited
tokenize(SourceText text, {NGramRange? nGramRange, Zone? zone, TokenizingStrategy strategy = TokenizingStrategy.terms}) → Future<List<Token>>
Extracts one or more tokens from source for use in full-text search queries and indexes.
inherited
tokenizeJson(Map<String, dynamic> document, {NGramRange? nGramRange, Iterable<Zone>? zones, TokenizingStrategy strategy = TokenizingStrategy.terms}) → Future<List<Token>>
Extracts tokens from the zones in a JSON document for use in full-text search queries and indexes.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited