Providers
Registered providers, environment variables, and capability metadata generated from the library.
The registry contains the same provider names as the tracked Python source revision. Native
adapters handle services whose SDK or protocol needs translation, while a data-driven adapter
handles OpenAI-compatible endpoints. The table below is generated from
AnyLLM.getAllProviderMetadata() during development and checked for drift in CI.
| Provider | Tier | Environment variable | Chat | Stream | Messages | Embed | Responses | Batch | Files | Rerank | Vision | Reasoning | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
anthropic | verified | ANTHROPIC_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
atlascloud | community | ATLASCLOUD_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
azure | community | AZURE_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported |
azureanthropic | community | AZURE_ANTHROPIC_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
azureopenai | verified | AZURE_OPENAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported |
bedrock | verified | AWS_BEARER_TOKEN_BEDROCK | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
cascadia | community | CASCADIA_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
cerebras | verified | CEREBRAS_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
cohere | community | COHERE_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | —Not supported | ✓Supported |
dashscope | community | DASHSCOPE_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | —Not supported |
databricks | community | DATABRICKS_TOKEN | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
deepinfra | community | DEEPINFRA_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
deepseek | verified | DEEPSEEK_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
edenai | community | EDENAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | —Not supported |
fireworks | verified | FIREWORKS_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
gemini | verified | GEMINI_API_KEY or GOOGLE_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
github | community | GITHUB_TOKEN | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported |
gmi | community | GMI_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
groq | verified | GROQ_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
huggingface | community | HF_TOKEN | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported |
inception | verified | INCEPTION_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported |
kenari | community | KENARI_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
llama | community | LLAMA_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported |
llamacpp | verified | LLAMACPP_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
llamafile | verified | Not required | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
lmstudio | verified | LM_STUDIO_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
meta | community | MODEL_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | —Not supported |
minimax | verified | MINIMAX_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
mistral | verified | MISTRAL_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
moonshot | verified | MOONSHOT_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
mzai | community | ANY_LLM_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
nebius | verified | NEBIUS_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
neosantara | community | NEOSANTARA_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
ollama | verified | Not required | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
openai | verified | OPENAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported | —Not supported |
openrouter | verified | OPENROUTER_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
otari | verified | OTARI_AI_TOKEN or GATEWAY_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | ✓Supported | ✓Supported | ✓Supported |
ovhcloud | community | OVHCLOUD_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported |
perplexity | community | PERPLEXITY_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | —Not supported |
portkey | verified | PORTKEY_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
qiniu | community | QINIU_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
requesty | community | REQUESTY_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
sagemaker | community | AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | —Not supported |
sambanova | verified | SAMBANOVA_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
telnyx | community | TELNYX_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
together | verified | TOGETHER_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | ✓Supported | ✓Supported | —Not supported | ✓Supported |
vertexai | community | GOOGLE_CLOUD_PROJECT and GOOGLE_CLOUD_LOCATION | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | ✓Supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
vertexaianthropic | community | GOOGLE_CLOUD_PROJECT | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | ✓Supported | ✓Supported |
vllm | community | VLLM_API_KEY | ✓Supported | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | ✓Supported |
voyage | verified | VOYAGE_API_KEY | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | —Not supported | —Not supported |
watsonx | community | WATSONX_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported | —Not supported | —Not supported |
xai | verified | XAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
zai | verified | ZAI_API_KEY | ✓Supported | ✓Supported | ✓Supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | —Not supported | ✓Supported |
Read metadata at runtime
import { AnyLLM } from "any-llm-ts";
const names = AnyLLM.getSupportedProviders();
const openai = AnyLLM.getProviderMetadata("openai");
const everyProvider = AnyLLM.getAllProviderMetadata();Each ProviderMetadata object includes:
- the normalized provider
name - the default
apiBase, when one exists - the conventional
envApiKeyandenvApiBase - whether an API key is required
- the provider's documentation URL
- conservative operation and feature capabilities
- the
verifiedorcommunityintegration tier - whether
promptCacheKeyis supported, forwarded, or rejected
Adapter categories
| Adapter | Providers |
|---|---|
| OpenAI and OpenAI-compatible | openai, azureopenai, plus compatible registry rows |
| Anthropic | anthropic, azureanthropic, vertexaianthropic |
| Google Gen AI | gemini, vertexai |
| AWS | bedrock, sagemaker |
| Other native integrations | azure, cohere, github, huggingface, meta, mistral, otari, together, voyage, watsonx |
Provider registration indicates API compatibility. It is not a claim that every provider, model, region, account tier, and operation is continuously tested with live credentials.
The parity manifest records the Python source commit, provider names, operations, capability matrix, and verified set. CI compares that manifest with the runtime registry so future source updates produce an explicit, reviewable parity gap.