TokenizingStrategy enum Null safety
The strategy to apply when splitting text to Tokens.
Constructors
- TokenizingStrategy()
-
const
Values
- all → const TokenizingStrategy
-
Tokenize into terms, n-grams and keyWords.
TokenizingStrategy() - ngrams → const TokenizingStrategy
-
Split the text at all white-space and punctuation and remove stop-words.
Build n-grams to match a NGramRange from any sequence of terms.
TokenizingStrategy() - terms → const TokenizingStrategy
-
Split the text at all white-space and punctuation and remove stop-words.
Build n-grams to match a NGramRange from any sequence of terms.
TokenizingStrategy() - keyWords → const TokenizingStrategy
-
Split the text at punctuation, line endings and stopwords, returning a token for each keyword.
TokenizingStrategy()
Properties
Methods
-
noSuchMethod(
Invocation invocation) → dynamic -
Invoked when a non-existent method or property is accessed.
inherited
-
toString(
) → String -
A string representation of this object.
inherited
Operators
-
operator ==(
Object other) → bool -
The equality operator.
inherited
Constants
-
values
→ const List<
TokenizingStrategy> -
A constant List of the values in this enum, in order of their declaration.
[all, ngrams, terms, keyWords]