Package-level declarations

Types

Link copied to clipboard

Sources: https://platform.openai.com/docs/pricing https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json

Link copied to clipboard
@Serializable
data class LlmRequestUsageAndCost(val modelName: String, val inputTokens: Long, val outputTokens: Long, val promptCost: Double, val completionCost: Double, val totalCost: Double = promptCost + completionCost)
Link copied to clipboard
@Serializable
data class LlmSessionUsageAndCost(val modelName: String, val averageDurationMillis: Double, val totalCostInUsDollars: Double, val totalRequestCount: Int, val totalInputTokens: Long, val totalOutputTokens: Long, val averageInputTokens: Double, val averageOutputTokens: Double)

This is just a summary/roll up of the LLM usage.

Link copied to clipboard