List of all items

Structs

• LlmRequest
• LlmResponse
• cache::CacheEntry
• cache::CacheStats
• cache::CachedResponse
• cache::SemanticCache
• classifier::QueryClassifier
• classifier::QueryComplexity
• compress::CompressedPrompt
• compress::PromptCompressor
• config::Config
• config::ModelConfig
• config::RateLimitConfig
• config::ServerConfig
• guardrails::GuardrailResult
• guardrails::Guardrails
• guardrails::Violation
• models::ChatRequest
• models::ChatResponse
• models::Choice
• models::Message
• models::Model
• models::ModelPool
• models::Usage
• observability::Observability
• observability::ObservabilitySummary
• observability::RequestMetrics
• observability::SavingsReport
• router::Router
• router::RouterBuilder
• router::RouterConfig
• router::RoutingDecision

Enums

• LlmError
• compress::CompressionLevel
• config::ModelCapability
• config::RoutingStrategy
• guardrails::Severity
• guardrails::ViolationCategory
• router::RouterError

Traits

• LlmProvider

Functions

• config::default_models
• observability::calculate_cost