Monitor your live system
Annotating data
Learn how to annotate data in Openlayer
You can annotate the live data published to the Openlayer platform. This is useful to:
Then, click on a request to inspect it. In the upper right corner, you have the
thumbs up/down buttons, which allow you to annotate the request.
On the requests data table, you will see the Feedback column added. Now, you can
filter the data by the Feedback column either to export these rows for further analysis
or to set up tests that only run on the data with certain feedback.
Then, click on a request to inspect it. In all steps of a trace, you will see the option
to add ground truths.
Additionally, if you scroll down to the “Other fields” section, you can add metadata by
clicking the “Add” button.
On the requests data table, you will see the ground truths and/or metadata columns added.
Now, you can filter the data using these columns for further analysis
or to set up tests that rely on them.
- add human feedback to requests. For example, marking a request with 👍 or 👎 depending on whether the model behavior was satisfactory for that request.
- add ground truths or metadata to requests or any intermediate step of a trace.
This page shows how to annotate data using the Openlayer platform UI. You can
also do so via the Label Studio integration or
with Openlayer’s SDKs.
Adding human feedback to a request
To add 👍/👎 human feedback to a request, navigate to the “Requests” page in the monitoring mode of your project.
Then, click on a request to inspect it. In the upper right corner, you have the
thumbs up/down buttons, which allow you to annotate the request.
On the requests data table, you will see the Feedback column added. Now, you can
filter the data by the Feedback column either to export these rows for further analysis
or to set up tests that only run on the data with certain feedback.
Adding ground truths or metadata
To add ground truths or metadata to a request or any intermediate step of a trace, navigate to the “Requests” page in the monitoring mode of your project.
Then, click on a request to inspect it. In all steps of a trace, you will see the option
to add ground truths.
Additionally, if you scroll down to the “Other fields” section, you can add metadata by
clicking the “Add” button.
On the requests data table, you will see the ground truths and/or metadata columns added.
Now, you can filter the data using these columns for further analysis
or to set up tests that rely on them.