Usage
Constructors
Properties
Link copied to clipboard
Number of tokens in the generated completion.
Link copied to clipboard
Breakdown of tokens used in a completion.
Link copied to clipboard
Number of tokens in the prompt that hits the context cache.
Link copied to clipboard
Number of tokens in the prompt that misses the context cache.
Link copied to clipboard
Number of tokens in the prompt. It equals promptCacheHitTokens + promptCacheMissTokens.
Link copied to clipboard
Total number of tokens used in the request (prompt + completion).