llama.cpp alternatives
16 other inference platforms listed here. llama.cpp is open source.
Ollama Featured
Run open models locally with one command
Amazon Bedrock
Managed access to many foundation models on AWS
Azure AI Foundry
Microsoft's platform for building with models and agents
Baseten
Production inference for open and custom models
Cerebras
Inference on wafer-scale chips
Cloudflare Workers AI
Run models on Cloudflare's network
DeepInfra
Pay-per-token API for open models
Fireworks AI
Fast inference for open and custom models
Google Vertex AI
Google Cloud's platform for models and ML
Groq
Inference on custom LPU chips
Hugging Face Inference Providers
One API across many inference partners
Modal
Serverless GPUs defined in Python
Replicate
Run models through an API without managing servers
SambaNova
Inference cloud on custom RDUs
Together AI
Serverless and dedicated inference for open models
vLLM
High-throughput open-source LLM serving engine