Simulate exact monthly API expenses across state-of-the-art foundation models with input/output token split and prompt caching discounts.
1 token roughly equals 0.75 English words (or ~4 characters). A typical 1,000-word prompt translates into approximately 1,333 tokens. Input tokens and output tokens are priced separately by providers because generation requires autoregressive sampling which consumes considerably more GPU compute.
Providers like Anthropic, OpenAI, and Google support caching static parts of your prompt (e.g., long system instructions, documentation, tool definitions). When cached, input tokens are discounted by 50% to 90%, massively reducing costs for repetitive agent loops.
For complex business reasoning and multi-step tool calls, Claude 3.5 Sonnet and GPT-4o deliver state-of-the-art accuracy. For high-volume classification, extraction, and summary tasks, GPT-4o-mini and Gemini 1.5 Flash offer unmatched cost efficiency.