Providers
Registered providers, environment variables, and capability metadata generated from the library.
The registry contains native adapters for Anthropic, OpenAI, and Azure OpenAI, plus a data-driven
set of OpenAI-compatible providers. The table below is generated from
AnyLLM.getAllProviderMetadata() during development and checked for drift in CI.
| Provider | Environment variable | Chat | Stream | Embed | Responses | Vision | Reasoning |
|---|---|---|---|---|---|---|---|
anthropic | ANTHROPIC_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported |
atlascloud | ATLASCLOUD_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
azureopenai | AZURE_OPENAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported |
cascadia | CASCADIA_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
cerebras | CEREBRAS_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
dashscope | DASHSCOPE_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported |
databricks | DATABRICKS_TOKEN | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported |
deepinfra | DEEPINFRA_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported |
deepseek | DEEPSEEK_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
edenai | EDENAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported |
fireworks | FIREWORKS_API_KEY | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
gmi | GMI_API_KEY | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
groq | GROQ_API_KEY | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
inception | INCEPTION_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
kenari | KENARI_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
llama | LLAMA_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported |
llamacpp | Not required | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported |
llamafile | Not required | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
lmstudio | LM_STUDIO_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported |
minimax | MINIMAX_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
mistral | MISTRAL_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported |
moonshot | MOONSHOT_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
nebius | NEBIUS_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported |
neosantara | NEOSANTARA_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported |
ollama | Not required | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported |
openai | OPENAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported |
openrouter | OPENROUTER_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported |
perplexity | PERPLEXITY_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | —Not supported |
portkey | PORTKEY_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
qiniu | QINIU_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported |
requesty | REQUESTY_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported |
sambanova | SAMBANOVA_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported |
telnyx | TELNYX_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported |
together | TOGETHER_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported |
vllm | VLLM_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported |
xai | XAI_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
zai | ZAI_API_KEY | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported |
Read metadata at runtime
import { AnyLLM } from "any-llm-ts";
const names = AnyLLM.getSupportedProviders();
const openai = AnyLLM.getProviderMetadata("openai");
const everyProvider = AnyLLM.getAllProviderMetadata();Each ProviderMetadata object includes:
- the normalized provider
name - the default
apiBase, when one exists - the conventional
envApiKeyandenvApiBase - whether an API key is required
- the provider's documentation URL
- conservative operation and feature capabilities
Adapter categories
| Adapter | Providers |
|---|---|
| Native Anthropic translation | anthropic |
| Official OpenAI SDK | openai, azureopenai |
| OpenAI-compatible registry | All other rows in the table |
Provider registration indicates API compatibility. It is not a claim that every provider, model, region, account tier, and operation is continuously tested with live credentials.
Not yet included
Native adapters for non-OpenAI-compatible services such as Gemini, Bedrock, Cohere, and Voyage are not part of the current port. Reranking is also not implemented. Until those adapters exist, the docs do not present those features as available.