A

Arize AX

by Arize AI, Inc.

Governance & SecurityData & AnalyticsDeveloper ToolsAI Agents & Orchestration

AI observability and evaluation to make AI work reliably in the real world.

Freemium · Subscription · Usage-based · Contact for pricing·Added Jun 21, 2026·Updated Aug 31, 2026
Share:
THE DAILY BRIEF
Arize AX

by Arize AI, Inc.

Governance & SecurityData & AnalyticsDeveloper ToolsAI Agents & Orchestration

AI observability and evaluation to make AI work reliably in the real world.

Freemium · Subscription · Usage-based · Contact for pricing

Arize AX is a managed AI engineering platform that traces, evaluates and improves LLM applications and agents. It captures every model call, retrieval and tool invocation as an OpenTelemetry trace, scores those traces with code, human or LLM-as-a-judge evaluators, and clusters recurring production failures into ranked issues so AI teams can prove a fix before shipping it.

At a Glance

Category
Governance & Security
Pricing
Freemium, Subscription, Usage-based, Contact for pricing
Target Market
CTOs, Data Scientists, Enterprise Developers, ML Engineers, AI Platform Teams
Deployment
Cloud-first, Self-hosted, Open-source, Hybrid, Multi-cloud
Founded
2020
Headquarters
Berkeley, California, United States
Team Size
201-500
Customers
Hundreds of enterprise and government customers, publicly named including Uber, Duolingo, Booking.com, Priceline, TripAdvisor, PepsiCo, Hyatt, Wayfair and Condé Nast

Key Features

  • OpenInference agent tracing
  • Multi-modal evaluation
  • Signal issue clustering
  • Experiments
  • Alyx AI engineering agent
  • Phoenix open source
  • Broad framework coverage

Capabilities

text generation
image generation
video generation
code generation
workflow automation
api access
audio generation
fine tuning
agent orchestration

Use Cases

  • Root-causing an agent that fails intermittently
  • Catching hallucination and quality drift in production
  • Validating a prompt or model migration
  • Controlling LLM spend
  • Evidencing AI quality for governance and audit

Ideal For

Best For

  • Debugging multi-step agent failures by replaying the full trajectory of model calls, retrievals and tool invocations as one trace
  • Regression-testing prompt, model or retrieval changes against a golden dataset before promoting them to production
  • Running continuous LLM-as-a-judge evaluation on live traffic to catch hallucination and quality drift as it happens
  • Teams standardising on OpenTelemetry who want vendor-neutral instrumentation rather than a proprietary trace schema
  • Organisations wanting to prototype on open-source Phoenix locally and later upgrade the same instrumentation to a managed platform

Not Ideal For

  • Teams that only need token and cost dashboards — Datadog, New Relic and Splunk already ship LLM monitoring, and a dedicated evaluation platform is more tooling than that job needs
  • Buyers who want pricing and roadmap certainty right now: the Dynatrace acquisition was announced 13 August 2026 and had not closed at time of writing, so packaging for standalone customers may change
  • Small projects with low trace volume, where PeerSpot reviewers report the setup and dashboard configuration effort outweighs the insight gained
  • Heavily regulated teams needing mature versioning and fine-grained access governance, which PeerSpot reviewers flag as an area still needing work

Market Analysis

Enterprise-gradeDeveloper-firstOpen-coreCategory leader
User Rating4.3/ 5

Pros

  • Deep, replayable agent tracing that PeerSpot reviewers single out — clean trace trees and dashboards that make complex multi-step runs interpretable at a glance
  • Evaluation depth beyond monitoring: span, trace and session scoring with code, human, LLM-as-a-judge and agent-as-a-judge evaluators, plus experiments to validate a change before it ships
  • Vendor-neutral instrumentation on OpenTelemetry and OpenInference, with a real open-source path via Phoenix (2M+ monthly downloads) that keeps data local and avoids proprietary trace formats
  • Pricing does not charge per seat — all tiers include unlimited users, evals and annotations, so an entire team can review traces without a licence conversation
  • Strong drift and model-degradation detection inherited from its original ML-monitoring product, which PeerSpot reviewers credit with catching decay early enough to retrain

Cons

  • Steep learning curve — PeerSpot reviewers consistently report that setup, configuration and dashboard building take real time, with one senior engineer noting it takes time to learn, configure and create dashboards
  • Costs climb with heavy tracing and large embeddings; reviewers describe pricing as 'on the higher side', and the Pro tier's 50k span/month ceiling is easy for a verbose agent to exhaust
  • Multiple PeerSpot reviewers judge the platform stronger for traditional ML monitoring than for generative AI, citing features available in LangSmith that Arize lacks
  • Governance gaps for regulated industries — reviewers flag versioning, access controls and security governance as needing enhancement
  • Acquisition overhang: Dynatrace agreed on 13 August 2026 to buy Arize for ~$915M and the deal had not closed, leaving standalone packaging, pricing and the Phoenix roadmap unresolved for new buyers

Pricing

AX Free

$0

  • 25k spans/month
  • 1GB ingestion/month
  • 15-day retention
  • 10 Signal issues/month
  • Unlimited users, evals, experiments and human annotations

AX Pro

From $50/mo

  • 50k spans/month
  • 10GB/month
  • 30-day retention
  • 25 Signal issues/month
  • Unlimited users, evals, experiments and human annotations

AX Enterprise

Contact for pricing

  • Unlimited span volume and custom storage
  • Custom retention
  • Self-hosted deployment
  • Multiple organisations with advanced RBAC
  • Enterprise SSO, audit logs, HIPAA
  • Custom managed agents and data fabric
  • Dedicated support with SLAs

Unusually for this category, seats are not the meter — all three tiers include unlimited users, evaluations, experiments and human annotations, and consumption is billed on span volume, storage, retention window and Signal issues. AX Free covers 25k spans and 1GB a month at 15-day retention; AX Pro is $50/mo for 50k spans, 10GB and 30-day retention. That span ceiling is the number to model against, because a verbose agent emits many spans per user request and PeerSpot reviewers report costs climbing with heavy tracing and large embeddings. Everything an enterprise buyer typically requires sits behind unquoted Enterprise pricing: unlimited spans, custom retention, self-hosted deployment, multi-org RBAC, SSO, audit logs, HIPAA and support SLAs. The open-source Phoenix library remains a genuinely free self-hosted path for teams willing to run and store it themselves.

Security & Compliance

soc2
gdpr
hipaa
iso27001
sso
data residency

THE DAILY BRIEF

Enterprise AI insights for technology and business leaders, twice weekly.

beri.net

Subscribe at beri.net/subscribe for twice-weekly AI insights delivered to your inbox.

LinkedIn: linkedin.com/in/rberi  |  X: x.com/rajeshberi

© 2026 Rajesh Beri. All rights reserved.

Arize AX is a managed AI engineering platform that traces, evaluates and improves LLM applications and agents. It captures every model call, retrieval and tool invocation as an OpenTelemetry trace, scores those traces with code, human or LLM-as-a-judge evaluators, and clusters recurring production failures into ranked issues so AI teams can prove a fix before shipping it.

Arize AX is a managed AI engineering platform for tracing, evaluating and improving LLM applications and agents across development and production. It captures OpenTelemetry-based distributed traces of every agent run — model calls, document retrievals, tool invocations, inputs, outputs, latency and token cost — using the OpenInference semantic conventions Arize authored, then attaches evaluators to score those traces at span, trace and session level: deterministic code checks, human annotations, LLM-as-a-judge and agent-as-a-judge. Signal automatically groups recurring production failures into ranked issues rather than leaving engineers to read traces by hand; Experiments run controlled comparisons so a prompt, model or retrieval change can be proven against a dataset before it ships; and Alyx is an embedded AI agent that answers questions about trace data in plain language, runs evaluations and drafts fixes, with agent-native workflows exposed for Cursor, Claude Code and OpenCode. AX sits alongside Phoenix, Arize's open-source, self-hostable tracing and evaluation library, which the company reports at over two million monthly downloads and which carries roughly 11,300 GitHub stars — a deliberate bottom-up motion in which developers adopt the free tool before enterprise procurement begins. The platform supports 40+ models and frameworks including OpenAI, Anthropic, Google, Amazon Bedrock, LangChain, LangGraph, LlamaIndex, CrewAI and DSPy, running on AWS, Google Cloud, Azure or self-hosted. Founded in January 2020 by Jason Lopatecki and Aparna Dhinakaran and based in Berkeley, California, Arize raised a $70M Series C in February 2025 led by Adams Street Partners, taking total funding to $131M. On 13 August 2026 Dynatrace agreed to acquire the company for approximately $915M in cash and stock.

Ideal Buyer

The AI engineering or ML platform lead who already has agents in production and cannot yet answer, with evidence, whether last week's prompt change made quality better or worse.

Key Benefit

A traced, scored record of every agent run, with recurring failures clustered into ranked issues and changes validated by experiment before they reach users.

At a Glance

Category
Governance & Security
Pricing
Freemium, Subscription, Usage-based, Contact for pricing
Target Market
CTOs, Data Scientists, Enterprise Developers, ML Engineers, AI Platform Teams
Deployment
Cloud-first, Self-hosted, Open-source, Hybrid, Multi-cloud
Founded
2020
Headquarters
Berkeley, California, United States
Team Size
201-500
Customers
Hundreds of enterprise and government customers, publicly named including Uber, Duolingo, Booking.com, Priceline, TripAdvisor, PepsiCo, Hyatt, Wayfair and Condé Nast

Key Features

  • OpenInference agent tracing

    Captures every model call, retrieval and tool invocation of an agent run as one OpenTelemetry trace, so a multi-step failure can be replayed rather than guessed at from logs.

  • Multi-modal evaluation

    Scores spans, traces and sessions using code evaluators, human annotations, LLM-as-a-judge and agent-as-a-judge, letting teams grade subjective output quality without hand-reviewing every run.

  • Signal issue clustering

    Automatically groups recurring production failures into ranked issues, which turns a firehose of traces into a short prioritised list an engineer can actually work through.

  • Experiments

    Runs controlled comparisons of prompt, model or retrieval changes against a fixed dataset, so a change is proven to improve quality before it reaches production users.

  • Alyx AI engineering agent

    An embedded agent that answers questions about trace data in plain language, runs evaluations and drafts fixes, cutting the expertise needed to interpret observability output.

  • Phoenix open source

    A self-hostable tracing and evaluation library built on OpenTelemetry with over two million monthly downloads, so teams can start locally with full data control and no vendor lock-in.

  • Broad framework coverage

    Auto-instruments 40+ models and frameworks including OpenAI, Anthropic, Bedrock, LangGraph, LlamaIndex, CrewAI and DSPy, so instrumentation survives a change of model provider or agent framework.

Capabilities

text generation
image generation
video generation
code generation
workflow automation
api access
audio generation
fine tuning
agent orchestration

Use Cases

  • Root-causing an agent that fails intermittently

    Replay the full trajectory of a failed run to find whether the model, the retrieval step or a tool call broke the chain.

  • Catching hallucination and quality drift in production

    Run continuous LLM-as-a-judge evaluators against live traffic and alert when groundedness or relevance scores degrade against baseline.

  • Validating a prompt or model migration

    Compare the candidate configuration against the incumbent on a golden dataset and ship only if measured quality holds or improves.

  • Controlling LLM spend

    Attribute token cost and latency down to individual spans to find the retrieval step or verbose prompt driving most of the bill.

  • Evidencing AI quality for governance and audit

    Retain scored traces of production decisions so risk and compliance teams can review what the system did and why.

Ideal For

Best For

  • Debugging multi-step agent failures by replaying the full trajectory of model calls, retrievals and tool invocations as one trace
  • Regression-testing prompt, model or retrieval changes against a golden dataset before promoting them to production
  • Running continuous LLM-as-a-judge evaluation on live traffic to catch hallucination and quality drift as it happens
  • Teams standardising on OpenTelemetry who want vendor-neutral instrumentation rather than a proprietary trace schema
  • Organisations wanting to prototype on open-source Phoenix locally and later upgrade the same instrumentation to a managed platform

Not Ideal For

  • Teams that only need token and cost dashboards — Datadog, New Relic and Splunk already ship LLM monitoring, and a dedicated evaluation platform is more tooling than that job needs
  • Buyers who want pricing and roadmap certainty right now: the Dynatrace acquisition was announced 13 August 2026 and had not closed at time of writing, so packaging for standalone customers may change
  • Small projects with low trace volume, where PeerSpot reviewers report the setup and dashboard configuration effort outweighs the insight gained
  • Heavily regulated teams needing mature versioning and fine-grained access governance, which PeerSpot reviewers flag as an area still needing work

Integrations

SDK Available
SDK:PythonTypeScript

Deployment

On-Premise

Market & Ratings

Estimated Customers

Hundreds of enterprise and government customers, publicly named including Uber, Duolingo, Booking.com, Priceline, TripAdvisor, PepsiCo, Hyatt, Wayfair and Condé Nast

Market Analysis

Enterprise-gradeDeveloper-firstOpen-coreCategory leader
User Rating4.3/ 5

Pros

  • Deep, replayable agent tracing that PeerSpot reviewers single out — clean trace trees and dashboards that make complex multi-step runs interpretable at a glance
  • Evaluation depth beyond monitoring: span, trace and session scoring with code, human, LLM-as-a-judge and agent-as-a-judge evaluators, plus experiments to validate a change before it ships
  • Vendor-neutral instrumentation on OpenTelemetry and OpenInference, with a real open-source path via Phoenix (2M+ monthly downloads) that keeps data local and avoids proprietary trace formats
  • Pricing does not charge per seat — all tiers include unlimited users, evals and annotations, so an entire team can review traces without a licence conversation
  • Strong drift and model-degradation detection inherited from its original ML-monitoring product, which PeerSpot reviewers credit with catching decay early enough to retrain

Cons

  • Steep learning curve — PeerSpot reviewers consistently report that setup, configuration and dashboard building take real time, with one senior engineer noting it takes time to learn, configure and create dashboards
  • Costs climb with heavy tracing and large embeddings; reviewers describe pricing as 'on the higher side', and the Pro tier's 50k span/month ceiling is easy for a verbose agent to exhaust
  • Multiple PeerSpot reviewers judge the platform stronger for traditional ML monitoring than for generative AI, citing features available in LangSmith that Arize lacks
  • Governance gaps for regulated industries — reviewers flag versioning, access controls and security governance as needing enhancement
  • Acquisition overhang: Dynatrace agreed on 13 August 2026 to buy Arize for ~$915M and the deal had not closed, leaving standalone packaging, pricing and the Phoenix roadmap unresolved for new buyers

Pricing

Free Trial Available

AX Free

$0

  • 25k spans/month
  • 1GB ingestion/month
  • 15-day retention
  • 10 Signal issues/month
  • Unlimited users, evals, experiments and human annotations

AX Pro

From $50/mo

  • 50k spans/month
  • 10GB/month
  • 30-day retention
  • 25 Signal issues/month
  • Unlimited users, evals, experiments and human annotations

AX Enterprise

Contact for pricing

  • Unlimited span volume and custom storage
  • Custom retention
  • Self-hosted deployment
  • Multiple organisations with advanced RBAC
  • Enterprise SSO, audit logs, HIPAA
  • Custom managed agents and data fabric
  • Dedicated support with SLAs

Unusually for this category, seats are not the meter — all three tiers include unlimited users, evaluations, experiments and human annotations, and consumption is billed on span volume, storage, retention window and Signal issues. AX Free covers 25k spans and 1GB a month at 15-day retention; AX Pro is $50/mo for 50k spans, 10GB and 30-day retention. That span ceiling is the number to model against, because a verbose agent emits many spans per user request and PeerSpot reviewers report costs climbing with heavy tracing and large embeddings. Everything an enterprise buyer typically requires sits behind unquoted Enterprise pricing: unlimited spans, custom retention, self-hosted deployment, multi-org RBAC, SSO, audit logs, HIPAA and support SLAs. The open-source Phoenix library remains a genuinely free self-hosted path for teams willing to run and store it themselves.

Security & Compliance

soc2
gdpr
hipaa
iso27001
sso
data residency

Connect

Sources

This page was written from 8 sources, 5 on domains other than arize.com.

  1. 1.arize.comarize.comvendor
  2. 2.arize.compricingvendor
  3. 3.arize.comarize ai raises 70m series c to build the gold standard for vendor
  4. 4.peerspot.comarize ai reviews
  5. 5.forbes.comdynatrace pays 915 million to move ai evaluation upstream
  6. 6.dynatrace.comdynatrace to acquire arize
  7. 7.constellationr.comdynatrace acquires arize accelerates ai observability effort
  8. 8.github.comphoenix
Newsletter

Stay Ahead of the Curve

Weekly enterprise AI insights for technology leaders. No spam, no vendor pitches—unsubscribe anytime.

Subscribe