Latitude
by Latitude
Open-source agent observability that finds the failure, dispatches a coding agent to fix it, and verifies the fix against real traces
Latitude is an MIT-licensed observability and quality platform built specifically for AI agents rather than adapted from LLM call logging. It groups failing production traces into tracked issues, hands them to a coding agent such as Claude Code or Cursor with full context, and replays the resulting fix against the original failing traces to prove it worked.
Latitude is an open-source observability and quality platform for AI agents, distributed under the MIT licence from the latitude-dev/latitude-llm repository, which carries roughly 4,700 GitHub stars, 392 forks and 91 open issues; the TypeScript project was created in June 2024 and was still receiving commits on 20 September 2026, with contributions from more than thirty developers. Its design premise is a deliberate break from the previous generation of LLM tooling: Langfuse, LangSmith, Braintrust and W&B Weave were built to monitor LLM calls and later extended to cover agents, treating an agent as a sequence of calls, whereas Latitude takes the agent session as its unit of analysis. The product is organised as a closed loop of Observe, Understand, Fix and Verify. A single line of telemetry captures complete execution traces including multi-turn sessions and tool calls. Failing traces are automatically grouped into tracked signals that carry state through active, resolved and regressed rather than sitting inert in a log. A coding agent such as Claude Code or Cursor is then dispatched with the full failure context through an MCP server and opens a pull request. The proposed fix is finally replayed against the real failing traces, so a regression is caught before merge rather than in production. Evaluations can be generated from annotated production failures instead of authored up front, which is the practical difference from eval-first tools that only catch failure modes somebody already anticipated. Deployment options span managed cloud, Docker Compose, a Kubernetes Helm chart and one-click Railway.
The engineering team running LLM agents in production that keeps rediscovering the same failure modes from customer complaints and wants them grouped, tracked and regression-tested like ordinary bugs.
Production agent failures become tracked issues with a verified pull request attached, instead of a trace dump somebody has to read and interpret by hand.
At a Glance
- Category
- Developer Tools
- Pricing
- Freemium, Subscription, Usage-based, Free
- Target Market
- Enterprise Developers, AI Engineers, MLOps Engineers, CTOs, Product Engineers
- Deployment
- Open-source, Self-hosted, Cloud-first, API-based
Key Features
- ✓Single-line trace instrumentation
Captures complete agent execution traces — multi-turn sessions, tool calls and intermediate state — from one line of telemetry rather than manual span annotation.
- ✓Signals: failures as tracked issues
Auto-groups failing traces into named signals with a lifecycle of active, resolved and regressed, so the same failure mode is counted once and its frequency is visible.
- ✓Coding-agent dispatch over MCP
Sends a failing signal with full context to Claude Code or Cursor through a Model Context Protocol server, and the agent opens a pull request with the proposed fix.
- ✓Verification against real traces
Replays a candidate fix against the actual traces that failed, so a change is proven to resolve the issue and not regress others before it is merged.
- ✓Evals generated from production failures
Builds evaluation cases out of annotated real failures instead of requiring teams to predict the failure surface in advance, which is where eval-first tools miss unknown modes.
- ✓Fully self-hostable under MIT
Ships as Docker Compose for a single host, a Helm chart for Kubernetes, or one-click Railway, with no feature-gated open-core split on the observability core.
Capabilities
Use Cases
- •Production agent debugging
Find which step of a multi-turn customer-support agent silently picked the wrong tool, across thousands of sessions, without reading raw traces.
- •Regression prevention on prompt changes
Replay every previously failing trace against an edited prompt or model swap before shipping, catching regressions that unit tests never model.
- •Closing the loop with a coding agent
Route a recurring failure signal straight to Claude Code or Cursor so the fix arrives as a reviewable pull request rather than a ticket.
- •Building an eval suite from real traffic
Annotate production failures as they occur and let those annotations become the regression suite, so coverage grows with observed reality.
- •Self-hosted observability for sensitive prompts
Run the whole stack inside a private network when prompts and traces contain customer data that cannot go to a managed vendor.
Ideal For
Best For
- ✓Debugging multi-turn agent sessions where the failure is in tool selection or state, not in a single model call
- ✓Teams that want evaluations derived from real annotated production failures rather than an eval suite written before anyone knew what would break
- ✓Shops already using Claude Code or Cursor, since the MCP integration hands the coding agent full failure context and lets it open the pull request
- ✓Regression-testing agent changes by replaying the exact traces that previously failed, before the change reaches users
- ✓Privacy-sensitive or cost-sensitive teams that want to self-host the whole platform under MIT on their own Docker or Kubernetes infrastructure
Not Ideal For
- ✗Organisations that want a mature, widely-benchmarked vendor — an independent observability index covers Latitude only in its feature matrix and gives it no decision-path recommendation, treating it as a niche evaluation tool next to LangSmith, Langfuse and Arize
- ✗LangChain and LangGraph-centric stacks, where LangSmith's native integration is a much shorter path
- ✗Teams whose primary need is eval-gated CI/CD on a defined surface, which Braintrust does better and with a far larger free allowance
- ✗Buyers who need a proven enterprise support relationship; the enterprise tier exists but the company is small and the independent track record is thin
Integrations
Deployment
Market Analysis
Pros
- ✓The fix-and-verify loop is genuinely differentiated — most competitors stop at showing you the failing trace
- ✓MIT licence with no open-core crippling of the observability core, and three documented self-host paths
- ✓Unlimited seats on every tier, including free, which removes the per-developer tax most observability vendors charge
- ✓Published pricing and a usable perpetual free tier in a category full of contact-sales quotes
- ✓Product Hunt reviewers report quick time-to-value, an intuitive setup and a clean UI, and it has ranked in the top five on several launches
Cons
- ✗Independent coverage is thin: a neutral observability index lists it in the matrix only and gives it no best-for recommendation, reading it as a narrower tool than LangSmith, Langfuse, Arize, Braintrust or Helicone
- ✗Product Hunt reviewers report occasional timeout and credit problems and ask for broader partner integrations
- ✗Only five Product Hunt reviews exist and no G2, Capterra or TrustRadius listing is retrievable, so the 5.0 rating rests on a very small sample
- ✗Hacker News has no stories about it at all, so there is no unfiltered practitioner discussion to check claims against
- ✗Braintrust's free tier is far more generous at a million spans a month, which undercuts Latitude's credit allowance for high-volume teams
Pricing
Open Source
$0
- ✓MIT licence
- ✓Self-host via Docker Compose, Helm or Railway
- ✓Full observability core
- ✓Community support
Starter
$0
- ✓20K credits per month
- ✓30-day data retention
- ✓Unlimited seats
- ✓General Slack support
Pro
From $99/mo
- ✓100K credits per month
- ✓90-day data retention
- ✓Unlimited seats
- ✓Priority support
- ✓SOC 2 and ISO 27001 reports
- ✓Extra credits at $20 per 10K
Enterprise
Contact for pricing
- ✓Custom credit volume and retention
- ✓On-premises or cloud deployment
- ✓Fine-grained RBAC
- ✓SAML SSO
- ✓Uptime and support SLA
- ✓Team training and dedicated support
Latitude publishes real list prices, which is unusual for this category. Metering is credit-based rather than per-seat, and seats are explicitly unlimited on every tier — the free Starter plan gives 20,000 credits a month with 30-day retention, and Pro is $99 a month for 100,000 credits with 90-day retention, with overage at $20 per 10,000 credits. Enterprise is quote-only and is where on-premises deployment, fine-grained RBAC, SAML SSO and an uptime SLA live; SOC 2 and ISO 27001 reports are available from Pro upward. The genuinely free path is self-hosting the MIT-licensed distribution, in which case the only cost is the infrastructure it runs on. Product Hunt reviewers mention hitting occasional credit and timeout issues, so model the credit burn of high-volume agent traffic before committing to a tier.
Security & Compliance
Connect
Sources
This page was written from 5 sources, 4 on domains other than latitude.so.
Stay Ahead of the Curve
Weekly enterprise AI insights for technology leaders. No spam, no vendor pitches—unsubscribe anytime.
SubscribeRelated Products
HackerRank Chakra
AI interviewer that runs hands-on technical interviews and scores how candidates work with AI
Autoheal
Self-improving AI agents for incident response, vulnerability fixes and release work after code is written
Unified.to
Real-time unified API and MCP server giving AI products and agents access to 1,000+ SaaS integrations
Momentic
Agentic QA platform that writes, runs and self-heals end-to-end tests for web and mobile apps