Join us at the premier vendor-neutral open source conference, where developers and technologists come together to collaborate, share knowledge, and explore the latest innovations and advancements in open source technology. Learn more at https://events.linuxfoundation.org/
Keep AI on Track: Guardrails + OpenTelemetry Observability - Prabal Rakshit, Infosys Technologies
Robust guardrails are a foundational requirement for preparing AI agents for enterprise‑grade deployment. They ensure that agents consistently adhere to organizational standards, policies, and ethical expectations.
OpenTelemetry provides a vendor‑agnostic, standards‑based framework for observing and validating guardrail behavior at runtime. Its unified APIs and emerging generative AI semantic conventions enable organizations to safely instrument guardrail logic, eliminate silent failures, and capture valuable telemetry across decision points.
This session explores the role of guardrails across the entire AI stack, including data layers, infrastructure, orchestration components, and LLMs themselves. We demonstrate how open‑source frameworks such as NVIDIA NeMo Guardrails or OpenLIT can be used to implement production‑ready guardrail mechanisms. Finally, we show how key guardrail metrics such as pass/fail rates, top violation categories, and latency impact can be instrumented using OpenTelemetry and visualized through enterprise observability backends like Dynatrace or Grafana.