Skip to main content

Suggest LLM Tokenizer

GET 
/api/v1/llm/tokenizer-hint

Recommend a tokenizer for a wire model id. Matching is exact, so an unrecognised id answers unknown rather than guessing from a family or substring. already_exact is a recommendation too — it says the fallback estimator is exact for this model, so filling the field would only cost pod memory.

Request​

Responses​

Successful Response