Python SDKAPI ReferenceComponents

ChatUsage - Python SDK

ChatUsage method reference

The Python SDK and docs are currently in beta. Report issues on GitHub.

Token usage statistics

Fields

FieldTypeRequiredDescriptionExample
completion_tokensint✔️Number of tokens in the completion
completion_tokens_detailsOptionalNullable[components.CompletionTokensDetails]➖Detailed completion token usage
costOptionalNullable[float]➖Cost of the completion
cost_detailsOptionalNullable[components.CostDetails]➖Breakdown of upstream inference costs{"upstream_inference_completions_cost": 0.0004,"upstream_inference_cost": null,"upstream_inference_prompt_cost": 0.0008}
is_byokOptional[bool]➖Whether a request was made using a Bring Your Own Key configuration
prompt_tokensint✔️Number of tokens in the prompt
prompt_tokens_detailsOptionalNullable[components.PromptTokensDetails]➖Detailed prompt token usage
total_tokensint✔️Total number of tokens