Annotating data

You can annotate the live data published to the Openlayer platform. This is useful to:

• add human feedback to requests. For example, marking a request with 👍 or 👎 depending on whether the model behavior was satisfactory for that request.
• add ground truths or metadata to requests or any intermediate step of a trace.

​

Adding human feedback to a request

To add 👍/👎 human feedback to a request, navigate to the “Requests” page in the monitoring mode of your project.

Then, click on a request to inspect it. In the upper right corner, you have the thumbs up/down buttons, which allow you to annotate the request.

On the requests data table, you will see the Feedback column added. Now, you can filter the data by the Feedback column either to export these rows for further analysis or to set up tests that only run on the data with certain feedback.

​

Adding ground truths or metadata

To add ground truths or metadata to a request or any intermediate step of a trace, navigate to the “Requests” page in the monitoring mode of your project.

Then, click on a request to inspect it. In all steps of a trace, you will see the option to add ground truths.

Additionally, if you scroll down to the “Other fields” section, you can add metadata by clicking the “Add” button.

On the requests data table, you will see the ground truths and/or metadata columns added. Now, you can filter the data using these columns for further analysis or to set up tests that rely on them.