langchain_nvidia_ai_endpoints.callbacks.get_token_cost_for_model

langchain_nvidia_ai_endpoints.callbacks.get_token_cost_for_model(model_name: str, num_tokens: int, price_map: dict, is_completion: bool = False) → float

Get the cost in USD for a given model and number of tokens.

Parameters

• model_name (str) – Name of the model

• num_tokens (int) – Number of tokens.

• price_map (dict) – Map of model names to cost per 1000 tokens. Defaults to AI Foundation Endpoint pricing per https://www.together.ai/pricing.

• is_completion (bool) – Whether the model is used for completion or not. Defaults to False.

Returns

Cost in USD.

Return type

float