inference cloud
Anyscale
Models, pricing and feature compatibility available through Anyscale.
Deployments
12
Models
12
Labs
4
With pricing
12
Models on Anyscale
Follow any model to compare this deployment with the same model through other providers.
| Model | Provider model ID | Mode | Region | Input | Output | Context | Tools |
|---|---|---|---|---|---|---|---|
| Codellama Codellama 34B Instruct Hf | codellama/CodeLlama-34b-Instruct-hf | Chat | global | $1.00 / 1M | $1.00 / 1M | 4.1K | unknown |
| Codellama Codellama 70B Instruct Hf | codellama/CodeLlama-70b-Instruct-hf | Chat | global | $1.00 / 1M | $1.00 / 1M | 4.1K | unknown |
| Gemma 7B IT | google/gemma-7b-it | Chat | global | $0.15 / 1M | $0.15 / 1M | 8.2K | unknown |
| Huggingfaceh4 Zephyr 7B Beta | HuggingFaceH4/zephyr-7b-beta | Chat | global | $0.15 / 1M | $0.15 / 1M | 16.4K | unknown |
| Meta Llama Llama 2 13B Chat Hf | meta-llama/Llama-2-13b-chat-hf | Chat | global | $0.25 / 1M | $0.25 / 1M | 4.1K | unknown |
| Meta Llama Llama 2 70B Chat Hf | meta-llama/Llama-2-70b-chat-hf | Chat | global | $1.00 / 1M | $1.00 / 1M | 4.1K | unknown |
| Meta Llama Llama 2 7B Chat Hf | meta-llama/Llama-2-7b-chat-hf | Chat | global | $0.15 / 1M | $0.15 / 1M | 4.1K | unknown |
| Meta Llama Meta Llama 3 70B Instruct | meta-llama/Meta-Llama-3-70B-Instruct | Chat | global | $1.00 / 1M | $1.00 / 1M | 8.2K | unknown |
| Meta Llama Meta Llama 3 8B Instruct | meta-llama/Meta-Llama-3-8B-Instruct | Chat | global | $0.15 / 1M | $0.15 / 1M | 8.2K | unknown |
| Mistralai Mistral 7B Instruct V0 1 | mistralai/Mistral-7B-Instruct-v0.1 | Chat | global | $0.15 / 1M | $0.15 / 1M | 16.4K | supported |
| Mistralai Mixtral 8x22B Instruct V0 1 | mistralai/Mixtral-8x22B-Instruct-v0.1 | Chat | global | $0.90 / 1M | $0.90 / 1M | 65.5K | supported |
| Mistralai Mixtral 8x7B Instruct V0 1 | mistralai/Mixtral-8x7B-Instruct-v0.1 | Chat | global | $0.15 / 1M | $0.15 / 1M | 16.4K | supported |