Model Providers
Each packaged model provider in Orion101 requires specific environment variables for configuration. These variables follow the format
ORION101_*_MODEL_PROVIDER_CONFIG_ITEM, where * corresponds to the name of the provider (e.g., ORION101_AZURE_OPENAI_MODEL_PROVIDER_API_KEY for Azure OpenAI).
Below is an overview of how to configure and manage the model providers in Orion101, along with an example of the API behavior for indicating provider status.
Configuration Status via API
The Orion101 API provides detailed feedback on the configuration status of each model provider. If required environment variables are missing, the API returns an object showing the unconfigured state, including the list of missing variables.
Example (Azure OpenAI provider, unconfigured):
{ "id": "azure-openai-model-provider",
"created": "2024-11-08T16:03:21-05:00",
"metadata": {
"envVars": "ORION101_AZURE_OPENAI_MODEL_PROVIDER_API_KEY,ORION101_AZURE_OPENAI_MODEL_PROVIDER_ENDPOINT,ORION101_AZURE_OPENAI_MODEL_PROVIDER_DEPLOYMENT_NAME"
},
"name": "Azure OpenAI Provider",
"toolType": "modelProvider",
"reference": "githu.com/orion101-ai/tools/azure-openai-model-provider",
"active": true,
"builtin": true,
"description": "Model provider for Azure OpenAI hosted models",
"modelProviderStatus": {
"missingEnvVars": [
"ORION101_AZURE_OPENAI_MODEL_PROVIDER_API_KEY",
"ORION101_AZURE_OPENAI_MODEL_PROVIDER_ENDPOINT",
"ORION101_AZURE_OPENAI_MODEL_PROVIDER_DEPLOYMENT_NAME"
],
"configured": false
}
}
Once all the required environment variables are set, the API confirms that the model provider is fully configured:
Example (Azure OpenAI provider, configured):
{
"id": "azure-openai-model-provider",
"created": "2024-11-08T16:03:21-05:00",
"metadata": {
"envVars": "ORION101_AZURE_OPENAI_MODEL_PROVIDER_API_KEY,ORION101_AZURE_OPENAI_MODEL_PROVIDER_ENDPOINT,ORION101_AZURE_OPENAI_MODEL_PROVIDER_DEPLOYMENT_NAME"
},
"name": "Azure OpenAI Provider",
"toolType": "modelProvider",
"reference": "github.com/orion101-ai/tools/azure-openai-model-provider",
"active": true,
"builtin": true,
"description": "Model provider for Azure OpenAI hosted models",
"modelProviderStatus": {
"configured": true
}
}
The Orion101 UI also reflects this information, making it easy to track the configuration status of each provider.
Available Model Providers
OpenAI
The OpenAI model provider is the default in Orion101 and requires the following environment variable:
OPENAI_API_KEY or ORION101_OPENAI_MODEL_PROVIDER_API_KEY
Azure OpenAI
The Azure OpenAI model provider requires the following variables for configuration:
ORION101_AZURE_OPENAI_MODEL_PROVIDER_API_KEY:Obtainable on the "Home" page of the Azure OpenAI Studio.ORION101_AZURE_OPENAI_MODEL_PROVIDER_ENDPOINT:Found by selecting the "Deployment" name on the "Deployments" page of Azure OpenAI Studio.
Note: When configuring models with Azure OpenAI in Orion101, ensure the "Target Model" is set to the appropriate Azure "Deployment."
Anthropic
The Anthropic model provider requires the following variable:
ORION101_ANTHROPIC_MODEL_PROVIDER_API_KEY:Obtainable from your Anthropic account management portal.
Voyage AI
Voyage AI, Anthropic’s recommended provider for text embeddings, requires:
ORION101_VOYAGE_MODEL_PROVIDER_API_KEY:Obtainable from your Voyage account.
Orion101 offers a flexible and robust framework for integrating with multiple model providers. By following the specific configuration steps for each provider, you can unlock the full potential of Orion101’s AI capabilities and tailor them to your use case. For more details on configuring model providers, refer to the Model Provider Configuration Guide.
Last updated