RAG evaluationRAG Eval Dataset: 200 Hand-Written Questions Beat Synthetic Ones
Hand-write about 200 RAG eval questions from real traffic, with gold answers owned by one domain expert. Score retrieval and generation separately, gate every PR, and use synthetic generators only for retriever coverage.
October 4, 2026 · 13 min readLLM evaluationBraintrust vs Langfuse vs Promptfoo: Don't Pay for the Gate
Promptfoo's CLI is the only one of the four that fails a build without you writing the enforcement code, and it costs nothing. The paid platforms sell what happens after the gate: stored traces, run-to-run diffs and a review queue.
August 26, 2026 · 17 min readAI observability pricingAI Observability Pricing: Same 10 GB, $49 or $930
Eleven AI observability options priced against one workload — 500,000 agent runs a month, 5 million spans, 10 GB of traces. The same telemetry costs $49 at SigNoz Cloud and about $930 at W&B Weave, and retention is a bigger multiplier than traffic.
August 19, 2026 · 17 min readAI agent observabilityBest AI Agent Monitoring: Langfuse, Then a Real Kill Switch
Seven agent monitoring tools priced against the same workload: 50,000 runs a month at 12 steps each. Self-hosted Langfuse wins on cost and audit depth — but only one of these tools sits in the request path where it can actually stop a runaway agent, and that is the part you have to build yourself.
August 11, 2026 · 16 min read