langchain_mistralai.embeddings.DummyTokenizer¶

class langchain_mistralai.embeddings.DummyTokenizer[source]¶

Dummy tokenizer for when tokenizer cannot be accessed (e.g., via Huggingface)

Methods

__init__()

encode_batch(texts)

__init__()¶
encode_batch(texts: List[str]) → List[List[str]][source]¶
Parameters

texts (List[str]) –

Return type

List[List[str]]