Production Llm Tracing And Monitoring

via “llm tracing and observability with opentelemetry integration”

Open-source ML lifecycle platform — experiment tracking, model registry, serving, LLM tracing.

Unique: Implements OpenTelemetry-based tracing specifically for LLM applications, with automatic instrumentation for LangChain and custom span support for arbitrary code. Traces are stored in MLflow's backend with built-in issue detection (latency anomalies, error patterns) and UI visualization, while supporting export to external observability platforms via standard OpenTelemetry exporters.

vs others: More integrated with MLflow's model lifecycle than standalone observability tools (Datadog, New Relic), and more LLM-specific than generic OpenTelemetry solutions, with automatic issue detection and native LangChain support.