Arize AX
by Arize AI, Inc.
AI observability and evaluation to make AI work reliably in the real world.
Arize AX is a managed AI engineering platform that traces, evaluates and improves LLM applications and agents. It captures every model call, retrieval and tool invocation as an OpenTelemetry trace, scores those traces with code, human or LLM-as-a-judge evaluators, and clusters recurring production failures into ranked issues so AI teams can prove a fix before shipping it.
Arize AX is a managed AI engineering platform for tracing, evaluating and improving LLM applications and agents across development and production. It captures OpenTelemetry-based distributed traces of every agent run — model calls, document retrievals, tool invocations, inputs, outputs, latency and token cost — using the OpenInference semantic conventions Arize authored, then attaches evaluators to score those traces at span, trace and session level: deterministic code checks, human annotations, LLM-as-a-judge and agent-as-a-judge. Signal automatically groups recurring production failures into ranked issues rather than leaving engineers to read traces by hand; Experiments run controlled comparisons so a prompt, model or retrieval change can be proven against a dataset before it ships; and Alyx is an embedded AI agent that answers questions about trace data in plain language, runs evaluations and drafts fixes, with agent-native workflows exposed for Cursor, Claude Code and OpenCode. AX sits alongside Phoenix, Arize's open-source, self-hostable tracing and evaluation library, which the company reports at over two million monthly downloads and which carries roughly 11,300 GitHub stars — a deliberate bottom-up motion in which developers adopt the free tool before enterprise procurement begins. The platform supports 40+ models and frameworks including OpenAI, Anthropic, Google, Amazon Bedrock, LangChain, LangGraph, LlamaIndex, CrewAI and DSPy, running on AWS, Google Cloud, Azure or self-hosted. Founded in January 2020 by Jason Lopatecki and Aparna Dhinakaran and based in Berkeley, California, Arize raised a $70M Series C in February 2025 led by Adams Street Partners, taking total funding to $131M. On 13 August 2026 Dynatrace agreed to acquire the company for approximately $915M in cash and stock.
The AI engineering or ML platform lead who already has agents in production and cannot yet answer, with evidence, whether last week's prompt change made quality better or worse.
A traced, scored record of every agent run, with recurring failures clustered into ranked issues and changes validated by experiment before they reach users.
At a Glance
- Category
- Governance & Security
- Pricing
- Freemium, Subscription, Usage-based, Contact for pricing
- Target Market
- CTOs, Data Scientists, Enterprise Developers, ML Engineers, AI Platform Teams
- Deployment
- Cloud-first, Self-hosted, Open-source, Hybrid, Multi-cloud
- Founded
- 2020
- Headquarters
- Berkeley, California, United States
- Team Size
- 201-500
- Customers
- Hundreds of enterprise and government customers, publicly named including Uber, Duolingo, Booking.com, Priceline, TripAdvisor, PepsiCo, Hyatt, Wayfair and Condé Nast
Key Features
- ✓OpenInference agent tracing
Captures every model call, retrieval and tool invocation of an agent run as one OpenTelemetry trace, so a multi-step failure can be replayed rather than guessed at from logs.
- ✓Multi-modal evaluation
Scores spans, traces and sessions using code evaluators, human annotations, LLM-as-a-judge and agent-as-a-judge, letting teams grade subjective output quality without hand-reviewing every run.
- ✓Signal issue clustering
Automatically groups recurring production failures into ranked issues, which turns a firehose of traces into a short prioritised list an engineer can actually work through.
- ✓Experiments
Runs controlled comparisons of prompt, model or retrieval changes against a fixed dataset, so a change is proven to improve quality before it reaches production users.
- ✓Alyx AI engineering agent
An embedded agent that answers questions about trace data in plain language, runs evaluations and drafts fixes, cutting the expertise needed to interpret observability output.
- ✓Phoenix open source
A self-hostable tracing and evaluation library built on OpenTelemetry with over two million monthly downloads, so teams can start locally with full data control and no vendor lock-in.
- ✓Broad framework coverage
Auto-instruments 40+ models and frameworks including OpenAI, Anthropic, Bedrock, LangGraph, LlamaIndex, CrewAI and DSPy, so instrumentation survives a change of model provider or agent framework.
Capabilities
Use Cases
- •Root-causing an agent that fails intermittently
Replay the full trajectory of a failed run to find whether the model, the retrieval step or a tool call broke the chain.
- •Catching hallucination and quality drift in production
Run continuous LLM-as-a-judge evaluators against live traffic and alert when groundedness or relevance scores degrade against baseline.
- •Validating a prompt or model migration
Compare the candidate configuration against the incumbent on a golden dataset and ship only if measured quality holds or improves.
- •Controlling LLM spend
Attribute token cost and latency down to individual spans to find the retrieval step or verbose prompt driving most of the bill.
- •Evidencing AI quality for governance and audit
Retain scored traces of production decisions so risk and compliance teams can review what the system did and why.
Ideal For
Best For
- ✓Debugging multi-step agent failures by replaying the full trajectory of model calls, retrievals and tool invocations as one trace
- ✓Regression-testing prompt, model or retrieval changes against a golden dataset before promoting them to production
- ✓Running continuous LLM-as-a-judge evaluation on live traffic to catch hallucination and quality drift as it happens
- ✓Teams standardising on OpenTelemetry who want vendor-neutral instrumentation rather than a proprietary trace schema
- ✓Organisations wanting to prototype on open-source Phoenix locally and later upgrade the same instrumentation to a managed platform
Not Ideal For
- ✗Teams that only need token and cost dashboards — Datadog, New Relic and Splunk already ship LLM monitoring, and a dedicated evaluation platform is more tooling than that job needs
- ✗Buyers who want pricing and roadmap certainty right now: the Dynatrace acquisition was announced 13 August 2026 and had not closed at time of writing, so packaging for standalone customers may change
- ✗Small projects with low trace volume, where PeerSpot reviewers report the setup and dashboard configuration effort outweighs the insight gained
- ✗Heavily regulated teams needing mature versioning and fine-grained access governance, which PeerSpot reviewers flag as an area still needing work
Integrations
Deployment
Market & Ratings
Hundreds of enterprise and government customers, publicly named including Uber, Duolingo, Booking.com, Priceline, TripAdvisor, PepsiCo, Hyatt, Wayfair and Condé Nast
Market Analysis
Pros
- ✓Deep, replayable agent tracing that PeerSpot reviewers single out — clean trace trees and dashboards that make complex multi-step runs interpretable at a glance
- ✓Evaluation depth beyond monitoring: span, trace and session scoring with code, human, LLM-as-a-judge and agent-as-a-judge evaluators, plus experiments to validate a change before it ships
- ✓Vendor-neutral instrumentation on OpenTelemetry and OpenInference, with a real open-source path via Phoenix (2M+ monthly downloads) that keeps data local and avoids proprietary trace formats
- ✓Pricing does not charge per seat — all tiers include unlimited users, evals and annotations, so an entire team can review traces without a licence conversation
- ✓Strong drift and model-degradation detection inherited from its original ML-monitoring product, which PeerSpot reviewers credit with catching decay early enough to retrain
Cons
- ✗Steep learning curve — PeerSpot reviewers consistently report that setup, configuration and dashboard building take real time, with one senior engineer noting it takes time to learn, configure and create dashboards
- ✗Costs climb with heavy tracing and large embeddings; reviewers describe pricing as 'on the higher side', and the Pro tier's 50k span/month ceiling is easy for a verbose agent to exhaust
- ✗Multiple PeerSpot reviewers judge the platform stronger for traditional ML monitoring than for generative AI, citing features available in LangSmith that Arize lacks
- ✗Governance gaps for regulated industries — reviewers flag versioning, access controls and security governance as needing enhancement
- ✗Acquisition overhang: Dynatrace agreed on 13 August 2026 to buy Arize for ~$915M and the deal had not closed, leaving standalone packaging, pricing and the Phoenix roadmap unresolved for new buyers
Pricing
AX Free
$0
- ✓25k spans/month
- ✓1GB ingestion/month
- ✓15-day retention
- ✓10 Signal issues/month
- ✓Unlimited users, evals, experiments and human annotations
AX Pro
From $50/mo
- ✓50k spans/month
- ✓10GB/month
- ✓30-day retention
- ✓25 Signal issues/month
- ✓Unlimited users, evals, experiments and human annotations
AX Enterprise
Contact for pricing
- ✓Unlimited span volume and custom storage
- ✓Custom retention
- ✓Self-hosted deployment
- ✓Multiple organisations with advanced RBAC
- ✓Enterprise SSO, audit logs, HIPAA
- ✓Custom managed agents and data fabric
- ✓Dedicated support with SLAs
Unusually for this category, seats are not the meter — all three tiers include unlimited users, evaluations, experiments and human annotations, and consumption is billed on span volume, storage, retention window and Signal issues. AX Free covers 25k spans and 1GB a month at 15-day retention; AX Pro is $50/mo for 50k spans, 10GB and 30-day retention. That span ceiling is the number to model against, because a verbose agent emits many spans per user request and PeerSpot reviewers report costs climbing with heavy tracing and large embeddings. Everything an enterprise buyer typically requires sits behind unquoted Enterprise pricing: unlimited spans, custom retention, self-hosted deployment, multi-org RBAC, SSO, audit logs, HIPAA and support SLAs. The open-source Phoenix library remains a genuinely free self-hosted path for teams willing to run and store it themselves.
Security & Compliance
Connect
Sources
This page was written from 8 sources, 5 on domains other than arize.com.
- 1.arize.com — arize.comvendor
- 2.arize.com — pricingvendor
- 3.arize.com — arize ai raises 70m series c to build the gold standard for vendor
- 4.peerspot.com — arize ai reviews
- 5.forbes.com — dynatrace pays 915 million to move ai evaluation upstream
- 6.dynatrace.com — dynatrace to acquire arize
- 7.constellationr.com — dynatrace acquires arize accelerates ai observability effort
- 8.github.com — phoenix
Stay Ahead of the Curve
Weekly enterprise AI insights for technology leaders. No spam, no vendor pitches—unsubscribe anytime.
SubscribeRelated Products
Apollo Research Watcher
Runtime monitoring and blocking for Claude Code and Codex: catch dangerous coding-agent actions before they run
Comp AI
Open-source, agentic compliance automation for SOC 2, ISO 27001, HIPAA and GDPR: an AGPL alternative to Vanta and Drata
Mate Security
Open agentic SOC platform powered by a security context graph built for each organisation
Cymphony
Workforce security graph that maps what employees and AI agents can reach, then remediates the exposure