Openlayer

Guides

Reference

Integrations

Examples

Changelog

Get started

Community

Log in

Overview

Introduction

Start testing your AI/ML system in minutes

Terminology

Find your API key

Learn how you can use Development mode with Git, the Openlayer CLI, or the Openlayer REST API

Learn how to write the `openlayer.json` config for your project

openlayer.json

Learn how to write the `tests.json` config for your project

tests.json

Configuring output generation

Publishing data

Tracing

Annotating data

Evaluation and delay windows

Uploading a reference dataset

Updating data

LLM cost estimation

Explore the tests available on the platform

Understanding tests

Custom metrics

Learn more about our data security practices and compliance measures.

Security

Python

TypeScript

Java

CLI global options

batch

export

help

inspect

install

link

login

metrics

push

validate

whoami

List projects

Create project

Retrieve a presigned url to post storage artifacts.

List the commits (project versions) in a project.

List project commits

Create a new commit (project version) in a project.

Create project commit

List the test results for a project commit (project version).

List commit test results

Create an inference pipeline in a project.

Create inference pipeline

List the inference pipelines in a project.

List inference pipelines

Publish an inference data point to an inference pipeline.

Publish inference

Update an inference data point in an inference pipeline.

List the latest test results for an inference pipeline.

List pipeline test results

Templates

Monitoring

OpenAI & Azure OpenAI

Anthropic

LangChain

Mistral AI

Groq

Amazon SageMaker

Label Studio

Great Expectations

Amazon S3

Databricks

Slack

GitHub

Ragas

A collection of answers to frequently asked questions.

GitHub Actions with Openlayer

Push and poll using the Openlayer CLI

Push and poll using the Openlayer REST API

Product updates

Reference

SDKs

CLI

REST API

Overview

Python

TypeScript

Go

Java