Openlayer

Guides

Reference

Integrations

Examples

Changelog

Get started

Community

Log in

Publish an inference data point to an inference pipeline.

Publish inference

Name of the column with the context retrieved. Applies to RAG use cases. Providing the context enables RAG-specific metrics.

Name of the column with the cost associated with each row.

Name of the column with the ground truths.

Name of the column with the inference ids. This is useful if you want to update rows at a later point in time. If not provided, a unique id is generated by Openlayer.

Array of input variable names. Each input variable should be a dataset column.

Name of the column with the total number of tokens.

Name of the column with the model outputs.

Name of the column with the questions. Applies to RAG use cases. Providing the question enables RAG-specific metrics.

Name of the column with the timestamps. Timestamps must be in UNIX sec format. If not provided, the upload timestamp is used.

Array with the names of all categorical features in the dataset. E.g. ["Age", "Geography"].

List of class names indexed by label integer in the dataset. E.g. ["Retained", "Exited"] when 0, 1 are in your label column.

Name of the column with the labels. The data in this column must be **zero-indexed integers**, matching the list provided in `classNames`.

Name of the column with the model's predictions as **lists of class probabilities**.

Name of the column with the model's predictions as **zero-indexed integers**.

Tabular classification

Array with the names of all categorical features in the dataset. E.g. ["Gender", "Geography"].

Name of the column with the model's predictions.

Name of the column with the targets (ground truth values).

Tabular regression

Text classification

bearerAuth

Introduction

Start testing your AI/ML system in minutes

Terminology

Find your API key

Learn how you can use Development mode with Git, the Openlayer CLI, or the Openlayer REST API

Overview

Learn how to write the `openlayer.json` config for your project

openlayer.json

Learn how to write the `tests.json` config for your project

tests.json

Configuring output generation

Publishing data

Tracing

Annotating data

Evaluation and delay windows

Uploading a reference dataset

Updating data

LLM cost estimation

Explore the tests available on the platform

Understanding tests

Custom metrics

Learn more about our data security practices and compliance measures.

Security

Python

TypeScript

Java

CLI global options

batch

export

help

inspect

install

link

login

metrics

push

validate

whoami

List projects

Create project

Retrieve a presigned url to post storage artifacts.

List the commits (project versions) in a project.

List project commits

Create a new commit (project version) in a project.

Create project commit

List the test results for a project commit (project version).

List commit test results

Create an inference pipeline in a project.

Create inference pipeline

List the inference pipelines in a project.

List inference pipelines

Update an inference data point in an inference pipeline.

List the latest test results for an inference pipeline.

List pipeline test results

Templates

Monitoring

OpenAI & Azure OpenAI

Anthropic

LangChain

Mistral AI

Groq

Amazon SageMaker

Label Studio

Great Expectations

Amazon S3

Databricks

Slack

GitHub

Ragas

A collection of answers to frequently asked questions.

Reference

SDKs

CLI

REST API

Publish inference

Authorizations

Path Parameters

Body

Response