trailblaze-common/xyz.block.trailblaze.llm

Package-level declarations

Types

Sources: https://platform.openai.com/docs/pricing https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json

LlmRequestUsageAndCost

@Serializable

data class LlmRequestUsageAndCost(val modelName: String, val inputTokens: Long, val outputTokens: Long, val promptCost: Double, val completionCost: Double, val totalCost: Double = promptCost + completionCost)

LlmSessionUsageAndCost

@Serializable

data class LlmSessionUsageAndCost(val modelName: String, val averageDurationMillis: Double, val totalCostInUsDollars: Double, val totalRequestCount: Int, val totalInputTokens: Long, val totalOutputTokens: Long, val averageInputTokens: Double, val averageOutputTokens: Double)

This is just a summary/roll up of the LLM usage.

LlmUsageAndCostExt

object LlmUsageAndCostExt