LLM cost estimation

Openlayer maintains a version of the OpenAI pricing page to estimate the cost from the prompt and completion tokens of your LLM calls.

The cost of Azure OpenAI calls depends on the underlying OpenAI model behind your model deployment.

If you follow the convention of using OpenAI model names as your model deployment name, removing all ., Openlayer will estimate the cost of your calls using the OpenAI pricing page. This means that if your model deployment name is gpt-35-turbo, Openlayer will use the cost for gpt-3.5-turbo from OpenAI.

Openlayer uses the information on OpenAI, Anthropic, Vertex AI, and Mistral AI to estimate the cost from the prompt and completion tokens of your LLM calls.

Openlayer maintains a version of the Anthropic API pricing page to estimate the cost from the prompt and completion tokens of your LLM calls.

Openlayer maintains a version of the Mistral AI pricing page to estimate the cost from the prompt and completion tokens of your LLM calls.

Openlayer maintains a version of the OpenAI pricing page to estimate the cost from the prompt and completion tokens of your LLM calls.

For the assistant API, this means that Openlayer estimates the generation cost but not tool use cost.