inference cloud

Deepinfra

Models, pricing and feature compatibility available through Deepinfra.

Deployments

67

Models

67

Labs

11

With pricing

67

Models on Deepinfra

Follow any model to compare this deployment with the same model through other providers.

ModelProvider model IDModeRegionInputOutputContextTools
Allenai Olmocr 7B 0725 FP8allenai/olmOCR-7B-0725-FP8Chatglobal$0.27 / 1M$1.50 / 1M16.4Kunknown
Claude Sonnet 3.7 Latestanthropic/claude-3-7-sonnet-latestChatglobal$3.30 / 1M$16.50 / 1M200Ksupported
Claude Opus 4anthropic/claude-4-opusChatglobal$16.50 / 1M$82.50 / 1M200Ksupported
Claude Sonnet 4anthropic/claude-4-sonnetChatglobal$3.30 / 1M$16.50 / 1M200Ksupported
DeepSeek-Ai Deepseek R1deepseek-ai/DeepSeek-R1Chatglobal$0.70 / 1M$2.40 / 1M163.8Ksupported
DeepSeek-Ai Deepseek R1 0528deepseek-ai/DeepSeek-R1-0528Chatglobal$0.50 / 1M$2.15 / 1M163.8Ksupported
DeepSeek-Ai Deepseek R1 0528 Turbodeepseek-ai/DeepSeek-R1-0528-TurboChatglobal$1.00 / 1M$3.00 / 1M32.8Ksupported
Deepseek Ai Deepseek R1 Distill Llama 70Bdeepseek-ai/DeepSeek-R1-Distill-Llama-70BChatglobal$0.20 / 1M$0.60 / 1M131.1Kunknown
DeepSeek-Ai Deepseek R1 Distill Qwen 32Bdeepseek-ai/DeepSeek-R1-Distill-Qwen-32BChatglobal$0.27 / 1M$0.27 / 1M131.1Ksupported
DeepSeek-Ai Deepseek R1 Turbodeepseek-ai/DeepSeek-R1-TurboChatglobal$1.00 / 1M$3.00 / 1M41Ksupported
DeepSeek-Ai Deepseekdeepseek-ai/DeepSeek-V3Chatglobal$0.38 / 1M$0.89 / 1M163.8Ksupported
DeepSeek-Ai Deepseek V3 0324deepseek-ai/DeepSeek-V3-0324Chatglobal$0.25 / 1M$0.88 / 1M163.8Ksupported
DeepSeek-Ai Deepseek V3 1deepseek-ai/DeepSeek-V3.1Chatglobal$0.27 / 1M$1.00 / 1M163.8Ksupported
DeepSeek-Ai Deepseek V3 1 Terminusdeepseek-ai/DeepSeek-V3.1-TerminusChatglobal$0.27 / 1M$1.00 / 1M163.8Ksupported
Gemini 2.0 Flash 001google/gemini-2.0-flash-001Chatglobal$0.10 / 1M$0.40 / 1M1Msupported
Gemini 2.5 Flashgoogle/gemini-2.5-flashChatglobal$0.30 / 1M$2.50 / 1M1Msupported
Gemini 2.5 Progoogle/gemini-2.5-proChatglobal$1.25 / 1M$10.00 / 1M1Msupported
Gemma 3 12B ITgoogle/gemma-3-12b-itChatglobal$0.05 / 1M$0.10 / 1M131.1Ksupported
Gemma 3 27B ITgoogle/gemma-3-27b-itChatglobal$0.09 / 1M$0.16 / 1M131.1Ksupported
Gemma 3 4B ITgoogle/gemma-3-4b-itChatglobal$0.04 / 1M$0.08 / 1M131.1Ksupported
Gryphe Mythomax L2 13BGryphe/MythoMax-L2-13bChatglobal$0.08 / 1M$0.09 / 1M4.1Ksupported
Meta Llama Llama 3 2 11B Vision Instructmeta-llama/Llama-3.2-11B-Vision-InstructChatglobal$0.05 / 1M$0.05 / 1M131.1Kunknown
Meta Llama Llama 3 2 3B Instructmeta-llama/Llama-3.2-3B-InstructChatglobal$0.02 / 1M$0.02 / 1M131.1Ksupported
Meta Llama Llama 3 3 70B Instructmeta-llama/Llama-3.3-70B-InstructChatglobal$0.23 / 1M$0.40 / 1M131.1Ksupported
Meta Llama Llama 3 3 70B Instruct Turbometa-llama/Llama-3.3-70B-Instruct-TurboChatglobal$0.13 / 1M$0.39 / 1M131.1Ksupported
Meta Llama Llama 4 Maverick 17B 128E Instruct FP8meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8Chatglobal$0.15 / 1M$0.60 / 1M1.05Msupported
Meta Llama Llama 4 Scout 17B 16E Instructmeta-llama/Llama-4-Scout-17B-16E-InstructChatglobal$0.08 / 1M$0.30 / 1M327.7Ksupported
Meta Llama Llama Guard 3 8Bmeta-llama/Llama-Guard-3-8BChatglobal$0.06 / 1M$0.06 / 1M131.1Kunknown
Meta Llama Llama Guard 4 12Bmeta-llama/Llama-Guard-4-12BChatglobal$0.18 / 1M$0.18 / 1M163.8Kunknown
Meta Llama Meta Llama 3 1 70B Instructmeta-llama/Meta-Llama-3.1-70B-InstructChatglobal$0.40 / 1M$0.40 / 1M131.1Ksupported
Meta Llama Meta Llama 3 1 70B Instruct Turbometa-llama/Meta-Llama-3.1-70B-Instruct-TurboChatglobal$0.10 / 1M$0.28 / 1M131.1Ksupported
Meta Llama Meta Llama 3 1 8B Instructmeta-llama/Meta-Llama-3.1-8B-InstructChatglobal$0.03 / 1M$0.05 / 1M131.1Ksupported
Meta Llama Meta Llama 3 1 8B Instruct Turbometa-llama/Meta-Llama-3.1-8B-Instruct-TurboChatglobal$0.02 / 1M$0.03 / 1M131.1Ksupported
Meta Llama Meta Llama 3 8B Instructmeta-llama/Meta-Llama-3-8B-InstructChatglobal$0.03 / 1M$0.06 / 1M8.2Ksupported
Microsoft Phi 4microsoft/phi-4Chatglobal$0.07 / 1M$0.14 / 1M16.4Ksupported
Microsoft Wizardlm 2 8x22Bmicrosoft/WizardLM-2-8x22BChatglobal$0.48 / 1M$0.48 / 1M65.5Kunknown
Mistralai Mistral Nemo Instruct 2407mistralai/Mistral-Nemo-Instruct-2407Chatglobal$0.02 / 1M$0.04 / 1M131.1Ksupported
Mistralai Mistral Small 24B Instruct 2501mistralai/Mistral-Small-24B-Instruct-2501Chatglobal$0.05 / 1M$0.08 / 1M32.8Ksupported
Mistralai Mistral Small 3 2 24B Instruct 2506mistralai/Mistral-Small-3.2-24B-Instruct-2506Chatglobal$0.07 / 1M$0.20 / 1M128Ksupported
Mistralai Mixtral 8x7B Instruct V0 1mistralai/Mixtral-8x7B-Instruct-v0.1Chatglobal$0.40 / 1M$0.40 / 1M32.8Ksupported
Moonshotai Kimi K2 Instructmoonshotai/Kimi-K2-InstructChatglobal$0.50 / 1M$2.00 / 1M131.1Ksupported
Moonshotai Kimi K2 Instruct 0905moonshotai/Kimi-K2-Instruct-0905Chatglobal$0.50 / 1M$2.00 / 1M262.1Ksupported
Nousresearch Hermes 3 Llama 3 1 405BNousResearch/Hermes-3-Llama-3.1-405BChatglobal$1.00 / 1M$1.00 / 1M131.1Ksupported
Nousresearch Hermes 3 Llama 3 1 70BNousResearch/Hermes-3-Llama-3.1-70BChatglobal$0.30 / 1M$0.30 / 1M131.1Kunknown
Nvidia Llama 3 1 Nemotron 70B Instructnvidia/Llama-3.1-Nemotron-70B-InstructChatglobal$0.60 / 1M$0.60 / 1M131.1Ksupported
Nvidia Llama 3 3 Nemotron Super 49B V1 5nvidia/Llama-3.3-Nemotron-Super-49B-v1.5Chatglobal$0.10 / 1M$0.40 / 1M131.1Ksupported
Nvidia Nemotron nano 9Bnvidia/NVIDIA-Nemotron-Nano-9B-v2Chatglobal$0.04 / 1M$0.16 / 1M131.1Ksupported
gpt-oss-120bopenai/gpt-oss-120bChatglobal$0.05 / 1M$0.45 / 1M131.1Ksupported
gpt-oss-20bopenai/gpt-oss-20bChatglobal$0.04 / 1M$0.15 / 1M131.1Ksupported
Qwen Qwen2 5 72B InstructQwen/Qwen2.5-72B-InstructChatglobal$0.12 / 1M$0.39 / 1M32.8Ksupported
Qwen Qwen2 5 7B InstructQwen/Qwen2.5-7B-InstructChatglobal$0.04 / 1M$0.10 / 1M32.8Kunknown
Qwen Qwen2 5 VL 32B InstructQwen/Qwen2.5-VL-32B-InstructChatglobal$0.20 / 1M$0.60 / 1M128Ksupported
Qwen Qwen3 14BQwen/Qwen3-14BChatglobal$0.06 / 1M$0.24 / 1M41Ksupported
Qwen Qwen3 235B A22BQwen/Qwen3-235B-A22BChatglobal$0.18 / 1M$0.54 / 1M41Ksupported
Qwen Qwen3 235B A22B Instruct 2507Qwen/Qwen3-235B-A22B-Instruct-2507Chatglobal$0.09 / 1M$0.60 / 1M262.1Ksupported
Qwen Qwen3 235B A22B Thinking 2507Qwen/Qwen3-235B-A22B-Thinking-2507Chatglobal$0.30 / 1M$2.90 / 1M262.1Ksupported
Qwen Qwen3 30B A3BQwen/Qwen3-30B-A3BChatglobal$0.08 / 1M$0.29 / 1M41Ksupported
Qwen Qwen3 32BQwen/Qwen3-32BChatglobal$0.10 / 1M$0.28 / 1M41Ksupported
Qwen Qwen3 Coder 480B A35B InstructQwen/Qwen3-Coder-480B-A35B-InstructChatglobal$0.40 / 1M$1.60 / 1M262.1Ksupported
Qwen Qwen3 Coder 480B A35B Instruct TurboQwen/Qwen3-Coder-480B-A35B-Instruct-TurboChatglobal$0.29 / 1M$1.20 / 1M262.1Ksupported
Qwen Qwen3 Next 80B A3B InstructQwen/Qwen3-Next-80B-A3B-InstructChatglobal$0.14 / 1M$1.40 / 1M262.1Ksupported
Qwen Qwen3 Next 80B A3B ThinkingQwen/Qwen3-Next-80B-A3B-ThinkingChatglobal$0.14 / 1M$1.40 / 1M262.1Ksupported
Qwen Qwq 32BQwen/QwQ-32BChatglobal$0.15 / 1M$0.40 / 1M131.1Ksupported
Sao10k L3 1 70B Euryale V2 2Sao10K/L3.1-70B-Euryale-v2.2Chatglobal$0.65 / 1M$0.75 / 1M131.1Kunknown
Sao10k L3 3 70B Euryale V2 3Sao10K/L3.3-70B-Euryale-v2.3Chatglobal$0.65 / 1M$0.75 / 1M131.1Kunknown
Sao10k L3 8B Lunaris V1 TurboSao10K/L3-8B-Lunaris-v1-TurboChatglobal$0.04 / 1M$0.05 / 1M8.2Kunknown
Zai Org Glm 4 5zai-org/GLM-4.5Chatglobal$0.40 / 1M$1.60 / 1M131.1Ksupported

Labs available through Deepinfra