Learn how to publish data to the Openlayer platform
OpenAI
Azure OpenAI
LangChain
ChatOpenAI
. However, the Openlayer
Callback Handler works for all LangChain chat
models and
LLMs.Tracing multi-step LLM systems (e.g., RAG, LLM chains)
update_current_trace()
and update_current_step()
functions. This enables:update_current_trace(inferenceId="your_id")
for request correlation and future data updatesupdate_current_trace(user_id="123", session="abc")
for user trackingupdate_current_step(model="gpt-4", tokens=150)
for detailed observabilitygenerate_answer
function uses a wrapped version of the OpenAI client,
the chat completion calls will get added to the trace under the generate_answer
function step.Anthropic
Mistral AI
Groq
OpenAI Assistants API
stream
method, which hits the
/data-stream
endpoit of the Openlayer REST API.