SambaNova
by SambaNova Systems
Full-stack AI inference on custom dataflow chips — in the cloud, on-prem, or sovereign.
SambaNova is a full-stack AI inference platform built on its own Reconfigurable Dataflow Unit (RDU) chips, offering cloud, managed and on-premises deployment of frontier open models. It targets enterprises, sovereign AI operators and service providers that need high-throughput, secure inference without depending on GPU supply.
At a Glance
- Category
- Infrastructure & Cloud
- Pricing
- Usage-based, Contact for pricing
- Target Market
- CTOs, CIOs, Heads of Infrastructure, Enterprise Developers, Government & Public Sector, Cloud/Neo-cloud Operators
- Founded
- 2017
- Headquarters
- San Jose, USA
- Customers
- Enterprises, neo-clouds, sovereign AI operators (Australia, Europe, UK) and service providers; JPMorganChase is a named inference partner
Key Features
- ✓RDU dataflow chips (SN50, SN40-16)
Custom Reconfigurable Dataflow Units with a three-tier memory design; the SN50 is tuned for agentic inference and the SN40-16 for low-power serving.
- ✓Multi-model on one node
The memory architecture lets a single node hold and switch between multiple frontier-scale models instead of dedicating clusters per model.
- ✓OpenAI-compatible APIs
SambaCloud exposes OpenAI-compatible endpoints so existing application code can point at SambaNova with minimal change.
- ✓SambaOrchestrator
Manages workloads across data centers with auto-scaling, load balancing and model management.
- ✓On-prem and sovereign deployment
SambaRack and SambaStack deliver the same inference stack inside a customer's own data center or a sovereign cloud.
- ✓Frontier open-model support
Serves DeepSeek-V3.1 (671B), Meta Llama 4, OpenAI gpt-oss-120b, MiniMax M2.7 and other open models.
Capabilities
Use Cases
- •Secure on-prem enterprise inference
JPMorganChase deploys SN40 and SN50 systems on-premises to run AI inference on sensitive financial data inside its own perimeter.
- •Sovereign AI
Governments and regional operators in Australia, Europe and the UK run national AI infrastructure on SambaNova's stack.
- •Agentic inference at scale
Serve high-token-volume agent workloads that need to switch between several frontier models with predictable throughput.
Ideal For
Best For
- ✓High-throughput inference for agentic workloads without depending on GPU supply
- ✓On-premises inference where data cannot leave the enterprise perimeter
- ✓Sovereign AI deployments for governments and regional cloud operators
- ✓Serving multiple frontier open models from a single node
Integrations
Deployment
Market & Ratings
Enterprises, neo-clouds, sovereign AI operators (Australia, Europe, UK) and service providers; JPMorganChase is a named inference partner
Market Analysis
Pros
- ✓Owns the full stack from silicon up, giving real differentiation on throughput and power
- ✓One of very few inference vendors offering credible on-prem and sovereign deployment
- ✓Deep capitalization ($1B first close at $11B) and a marquee financial-services customer
Cons
- ✗Custom silicon means a smaller ecosystem and tooling surface than the CUDA/GPU world
- ✗Throughput figures such as 435 tokens/second are vendor-reported benchmarks
- ✗Little transparent pricing for enterprise or on-prem deployments
Pricing
SambaCloud
Contact for pricing
- ✓Hosted inference
- ✓OpenAI-compatible APIs
- ✓Frontier open models
SambaRack / SambaStack (on-prem)
Contact for pricing
- ✓On-premises RDU systems
- ✓Full chips-to-model stack
- ✓SambaOrchestrator
SambaCloud publishes plan details at cloud.sambanova.ai/plans/pricing; enterprise and on-premises deployments are quoted directly.
Stay Ahead of the Curve
Weekly enterprise AI insights for technology leaders. No spam, no vendor pitches—unsubscribe anytime.
SubscribeRelated Products
Upscale AI
The pure-play AI networking company building the full-stack fabric for GPU and XPU clusters
Prime Intellect
The open superintelligence stack — own your intelligence with custom compute, RL training, and inference in one platform.
Union.ai
The commercial platform for Flyte — build durable, dynamic AI workflows and agents in pure Python
TrueFoundry
Enterprise AI gateway and agentic deployment platform — secure, scalable, governed