opentelemetry trace ingestion via grpc otlp protocol
Accepts distributed traces from LLM applications through a dedicated gRPC server listening on port 4317, implementing the OpenTelemetry Protocol (OTLP) specification. Traces are parsed from protobuf messages, validated, and persisted to PostgreSQL or SQLite with automatic schema migrations. Supports multi-language instrumentation (Python, TypeScript, Go, etc.) without requiring application code changes when using auto-instrumentation libraries.
Unique: Implements native gRPC OTLP server (not HTTP/JSON) with automatic protobuf deserialization and direct database persistence, avoiding the overhead of HTTP protocol conversion that other observability platforms require. Uses OpenTelemetry's standard trace model directly rather than proprietary span formats.
vs alternatives: Faster ingestion than HTTP-based OTLP collectors (gRPC binary protocol) and fully compatible with OpenTelemetry ecosystem, unlike proprietary tracing solutions that require custom instrumentation adapters.
trace querying and filtering via graphql api
Exposes a Strawberry GraphQL API (on port 6006) that allows complex queries over ingested traces using a schema-driven approach. Queries support filtering by span attributes, trace duration, status codes, and custom dimensions; supports pagination, sorting, and aggregation operations. The GraphQL layer translates queries into optimized SQL against the trace database, enabling efficient retrieval of trace subsets for analysis and debugging without loading entire trace datasets into memory.
Unique: Uses Strawberry GraphQL framework with type-safe schema generation from Python dataclasses, enabling automatic schema validation and IDE autocomplete for query construction. Translates GraphQL queries directly to optimized SQL rather than loading full datasets into memory.
vs alternatives: More flexible than REST APIs for complex filtering scenarios and more efficient than full-dataset retrieval; GraphQL schema is self-documenting and supports introspection for dynamic client generation.
database abstraction with postgresql and sqlite support
Provides a database abstraction layer supporting both PostgreSQL (production) and SQLite (development/single-instance) backends, with automatic schema migrations managed by Alembic. The abstraction uses SQLAlchemy ORM for database operations, enabling schema changes without manual SQL. Supports connection pooling, transaction management, and query optimization for both backends. Database schema includes tables for spans, traces, evaluations, datasets, and annotations with appropriate indexes for common query patterns.
Unique: Uses SQLAlchemy ORM with Alembic migrations to support multiple database backends with identical schema and query logic, enabling seamless migration between SQLite and PostgreSQL without application code changes. Automatic migration management prevents manual schema drift.
vs alternatives: Dual database support enables development with SQLite (no setup) and production with PostgreSQL (scalability) without code changes; automatic migrations reduce operational burden compared to manual schema management.
cli for local server management and data export
Provides a command-line interface for starting the Phoenix server locally, managing database connections, and exporting trace data. CLI commands support starting the server with custom configuration (port, database URL, authentication), running database migrations, exporting traces to CSV/JSON, and importing datasets. The CLI uses Click framework for command definition and supports both interactive and scripted usage.
Unique: Provides a unified CLI for both server management and data operations, enabling users to start Phoenix, manage databases, and export data without writing Python code. Uses Click framework for composable command structure.
vs alternatives: Simpler than Docker/Kubernetes for local development and provides data export capabilities that would otherwise require custom scripts or database queries.
frontend visualization of trace execution flows
Provides a React-based web UI that visualizes trace execution flows as interactive diagrams showing span hierarchies, timing, and status. The UI displays spans as nodes with parent-child relationships, color-coded by status (success, error, pending), and includes timeline visualization showing span duration and overlap. Users can click spans to view detailed attributes, logs, and events; filter traces by attributes; and navigate between related traces. The frontend communicates with the backend via GraphQL API.
Unique: Implements interactive trace visualization as a React component tree with real-time filtering and detail inspection, using GraphQL subscriptions for live updates. Visualizes span hierarchies and timing relationships in a way that's intuitive for understanding LLM application execution.
vs alternatives: More intuitive than raw JSON trace data or text-based logs for understanding execution flow; interactive filtering enables rapid exploration of large trace datasets without writing queries.
authentication and authorization with role-based access control
Implements authentication and authorization mechanisms (details in DeepWiki) supporting role-based access control (RBAC) for multi-tenant deployments. Users can be assigned roles (admin, analyst, viewer) with corresponding permissions for reading/writing traces, evaluations, and datasets. Authentication supports API keys and optional OAuth2/OIDC integration. Authorization is enforced at the API layer (GraphQL and REST) and database layer to prevent unauthorized data access.
Unique: Implements RBAC at both API and database layers, ensuring authorization is enforced consistently across GraphQL, REST, and direct database access. Supports both API key and OAuth2/OIDC authentication mechanisms.
vs alternatives: Role-based access control enables multi-tenant deployments where different teams can access the same Phoenix instance with appropriate data isolation, unlike single-user deployments.
llm evaluation framework with pluggable evaluators
Provides a Python-based evaluation system (arize-phoenix-evals package) that runs structured evaluators against LLM outputs to measure quality, correctness, and safety. Evaluators are composable functions that accept input/output pairs and return structured scores or classifications. The framework supports both built-in evaluators (hallucination detection, relevance scoring, toxicity detection) and custom user-defined evaluators; results are stored as annotations on spans and can be aggregated across datasets for statistical analysis.
Unique: Implements evaluators as composable, reusable functions with a standardized interface (input/output → score) that can be chained and parallelized. Integrates evaluation results directly as span annotations, enabling correlation between execution traces and quality metrics without separate storage systems.
vs alternatives: Tightly integrated with trace data (evaluations are stored as span annotations) unlike standalone evaluation tools, enabling direct correlation between execution details and quality scores; supports both LLM-based and custom evaluators in a unified framework.
prompt versioning and management with experiment tracking
Provides a prompt management system that stores prompt templates with version history, enabling A/B testing and experimentation. Prompts are stored in the database with metadata (model, parameters, tags) and can be retrieved by version or tag. The system tracks which prompt version was used for each LLM call via span attributes, allowing correlation between prompt changes and output quality metrics. Experiments can be defined to compare multiple prompt versions against the same dataset of inputs.
Unique: Integrates prompt versioning directly with trace data, storing prompt version references in span attributes and enabling automatic correlation with evaluation results. Supports experiment definition as a first-class concept with built-in comparison logic across prompt versions.
vs alternatives: Unlike standalone prompt management tools, Phoenix correlates prompt versions with actual execution traces and quality metrics, enabling data-driven prompt optimization rather than manual comparison.
+6 more capabilities