Sometimes the data you want to monitor isn’t available at inference time.
Openlayer lets you update existing traces after they were streamed to the platform.
Common use cases:
- Adding ground truths that only became available later.
- Logging human feedback (e.g., thumbs up/down, ratings).
- Attaching business signals such as conversions or revenue impact.
How updates work
Every trace streamed to Openlayer has an inference_id, which is a unique identifier.
- If you provide your own inference IDs, you can easily reference and update those traces later.
- If you don’t, Openlayer auto-generates them for you.
For maximum flexibility, set custom inference IDs when tracing. This makes
it simple to tie traces to feedback, business outcomes, or other systems.
Example: Add a ground truth
Let’s say you want to add a ground_truth column for a previously logged trace.
This updates the trace with inference_id="832y98d3" by attaching a ground truth.
Using custom inference IDs
When tracing with the @trace decorator, you can set your own inference IDs.
This makes it easy to correlate requests with later feedback or business signals.
Later, use that custom ID (chat_{conversation_id}_{user_id}) in your update calls.