Label Studio

Label Studio is an open-source data labeling platform. It supports multiple data and annotation modalities and can be used to add human feedback to model responses, label data for LLM fine-tuning or model training, and more.

Openlayer integrates with Label Studio and allows you to export data from an Openlayer inference pipeline to a Label Studio project.

​

Export data from Openlayer

First, export your data from your Openlayer inference pipeline.

Export via the Openlayer CLI

Use the export command from the Openlayer CLI.

To use the openlayer export command, you must be logged in via the CLI.

You can check if you are already logged in with the whoami command. If you are not yet logged in, log in with the login command.

Run:

openlayer export [Openlayer inference pipeline id] [start] [end]

This will export the data from your inference pipeline. In the downloaded folder, you should see a dataset.json file with your data.

Export via the Openlayer UI

Navigate to the “Requests” page of your inference pipeline.

Click on the download icon in the upper right corner of the data table.

Select JSON as the format and click “Export.” This should export all your data to a zipped folder. After you unzip the folder, you should see a dataset.json file inside it.

In both cases, you end up with a dataset.json file with your inference pipeline data. The dataset.json is in a format accepted by Label Studio.

​

Import data into Label Studio

To import this data via the Label Studio UI, navigate to your Label Studio project. Click “Import” and then “Upload files”. Select the dataset.json file exported from Openlayer.

Now, the data is in Label Studio and you can configure how you want to annotate it.