Openlayer integrates with Azure Content Understanding, Microsoft’s service for extracting structured data and insights from documents, images, audio, and video using LLMs.
Monitoring Azure Content Understanding
To use monitoring mode, instrument your code to publish the analysis requests your AI system makes to the Openlayer platform. Each begin_analyze → poller.result() call is automatically traced and published with inputs, outputs, latency, token usage, and the underlying model used.
Setup
Instrument your client:
Once instrumented, every analysis call is automatically published to Openlayer.
In the “Data” page of your Openlayer data source, you can see the traces for each request.
After your AI system requests are continuously published and logged by Openlayer, you can
create tests that run at a regular cadence on top of them.
To store the source files alongside your traces in Openlayer, enable
attachment uploads in init() by setting attachment_upload_enabled=True
(for binary inputs) and url_upload_enabled=True (to also fetch and persist
URL-referenced files).