Together AI

Together AI is a full-stack AI acceleration cloud offering serverless and dedicated inference, fine-tuning, and on-demand/reserved NVIDIA GPU clusters for running open-source and custom generative AI models in production.

Together AI provides cloud infrastructure for the full AI development lifecycle, from experimentation to production. Its platform spans serverless inference for 200+ open-source models, batch inference, dedicated single-tenant inference endpoints, and dedicated container inference for generative media. On the compute side, it offers GPU clusters (NVIDIA H100, H200, and Blackwell B200) from instant instances to thousands of GPUs, plus managed storage with zero egress fees and code sandboxes. It also supports fine-tuning of open-source models and ships its own optimized Together Kernel Collection. The company differentiates through published research in kernels, inference optimization, and model architectures, claiming roughly 2x faster inference and 60% lower cost than alternatives. Customers include Salesforce, Zoom, SK Telecom, and The Washington Post.

Category

Infrastructure & Cloud

Pricing

usage-based, pay-per-token, per-GPU-hour, reserved/committed

Target Market

AI startups, Enterprises, ML researchers, Developers building on open-source models

Founded

2022

Headquarters

San Francisco, California, United States

• ✓
  Serverless inference

  On-demand, pay-per-token access to 200+ open-source chat, vision, image, video, and audio models with snappy, low-latency inference.

• ✓
  Dedicated inference endpoints

  Single-tenant GPU deployments (e.g., H100, B200) for predictable performance and dedicated container inference for generative media.

• ✓
  GPU clusters

  On-demand and reserved NVIDIA H100/H200/Blackwell B200 clusters scaling from single instances to thousands of GPUs, with managed storage and zero egress fees.

• ✓
  Fine-tuning

  Adapt open-source models to production tasks with per-token fine-tuning pricing and instant deployment.

• ✓
  Together Kernel Collection & research optimizations

  Proprietary optimized kernels and research-driven inference stack claiming ~2x faster inference, 60% lower cost, and 90% faster pre-training.

• •
  Production open-source model serving

  Deploy and scale inference for Llama, Mistral, DeepSeek, and other open-source models via serverless or dedicated endpoints.

• •
  Large-scale model training

  Reserve NVIDIA GPU clusters with managed storage and optimized kernels to pre-train or fine-tune large models cost-effectively.

• •
  Custom enterprise AI applications

  Fine-tune open models on proprietary data and serve them through dedicated infrastructure for enterprises like Salesforce and Zoom.

Pay-per-use with no traditional subscription tiers: tokens for LLMs/embeddings, per image/video for generative media, per GPU-hour for dedicated endpoints and clusters, and per minute for audio. 'Start for free, scale on demand,' though specific free-credit amounts are not detailed publicly.

This page was written from 8 sources, 5 on domains other than together.ai.

1. 1.together.ai — together.aivendor
2. 2.together.ai — pricingvendor
3. 3.together.ai — together ai announcing 305m series bvendor
4. 4.news.crunchbase.com — together ai valuation jump general catalyst nvda
5. 5.datacenterdynamics.com — ai cloud firm together ai raises 305m in series b funding ro
6. 6.crunchbase.com — together 1a7e
7. 7.g2.com — reviews
8. 8.trustpilot.com — together.ai