Skip to content

Provider Economics

The Economics Layer makes every provider decision financially transparent. It tracks real costs, simulates alternative scenarios, computes savings attribution, and protects budgets before they break.

FunctionPurposeFile
Cost TrackingRecords actual spend per provider, model, and workspaceeconomics/attribution/engine.ts
Savings AttributionComputes how much Layerr saved vs. baselineeconomics/attribution/engine.ts
Budget ProtectionEnforces budget caps and triggers alertsbudget/evaluator.ts
SimulationWhat-if analysis: “What would this cost on another provider?”economics/simulation/engine.ts
InsightsHigh-level economic insights and recommendationseconomics/insights/engine.ts

The attribution engine (economics/attribution/engine.ts) computes:

MetricDescription
Monthly SpendTotal cost this calendar month
Provider BreakdownCost per provider
Category BreakdownCost per model category (fast, balanced, reasoning)
Fallback CostAdditional cost incurred by fallback attempts
Premium AvoidanceAmount saved by routing to cheaper capable models
Category EfficiencyQuality per dollar by category
function computeSavings(
actualTrace: Trace,
baselineTrace: Trace
): SavingsReport {
return {
tokensSaved: baselineTrace.tokensOut - actualTrace.tokensOut,
costSavedUsd: baselineTrace.costUsd - actualTrace.costUsd,
latencySavedMs: baselineTrace.latencyMs - actualTrace.latencyMs,
efficiencyGain: actualTrace.qualityScore / actualTrace.costUsd
};
}

The budget evaluator (budget/evaluator.ts) enforces:

CheckAction
Pre-request budget checkBlock if workspace is over budget
Soft threshold alertNotify when 80% of budget consumed
Category tier limitingBlock premium models when budget is tight
Batch job quotaLimit batch job size based on remaining budget

The simulation engine (economics/simulation/engine.ts) answers “what if” questions:

SimulationDescription
simulateBaselineExecution()Cost if routed to default baseline model
simulateAllProfiles()Cost if each profile (cost/speed/quality/balanced) was used
buildSimulationInputFromReplayTrace()Simulate an alternative for an existing trace
computeBalancedBaseline()Baseline cost for balanced strategy

The insights engine (economics/insights/heuristics.ts) detects economic patterns:

HeuristicWhat It Detects
detectHighFallbackProviders()Providers that frequently trigger costly fallbacks
detectSlowProviders()Providers whose latency suggests poor value
detectFallbackCostEscalation()Situations where fallback costs spiral
detectHighFleetFallbackRate()Workspace-wide fallback rate trends
detectSimulationSavings()Potential savings from simulation results
detectPremiumAvoidance()Successful routing away from premium models
ComponentFilePurpose
ProviderEconomicsOverlaysrc/features/providers/economics/Provider-level cost dashboard
EconomicComparisonInspectorsrc/features/evaluation/Compare costs across providers
TraceEconomicPanelsrc/traces/TraceEconomicPanel.tsxCost analysis per trace
BudgetProtectionPanelBudget UI with alerts and controls
FileWhat It Does
economics/attribution/engine.tsCost tracking and savings computation
economics/attribution/queries.tsSQL queries for cost aggregation
economics/simulation/engine.tsWhat-if cost simulation
economics/insights/engine.tsEconomic insight generation
economics/insights/heuristics.tsPattern detection heuristics
budget/evaluator.tsBudget enforcement and impact evaluation
src/features/providers/economics/Frontend economics dashboards
  1. Execution Engine → provides token counts and actual costs
  2. Replay → provides traces for savings computation
  3. Simulation → simulates alternatives using provider pricing metadata
  4. Workspace Profiles → reads budget constraints
  5. Quality Evaluation → correlates cost with quality for efficiency metrics