--- title: "Azure AI Foundry Agents" description: "import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem';" type: skill canonical_url: https://claudary.paisolsolutions.com/skills/azure-ai-agents source: "Claudary" difficulty: intermediate author: "Claude Code Knowledge Pack" date: 2026-07-10T11:08:09.213Z license: CC-BY-4.0 attribution: "Azure AI Foundry Agents — Claudary (https://claudary.paisolsolutions.com/skills/azure-ai-agents)" --- # Azure AI Foundry Agents import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem'; ## Overview import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem'; # Azure AI Foundry Agents Call Azure AI Foundry Agents in the OpenAI Request/Response format. | Property | Details | |----------|---------| | Description | Azure AI Foundry Agents provides hosted agent runtimes that can execute agentic workflows with foundation models, tools, and code interpreters. | | Provider Route on LiteLLM | `azure_ai/agents/{AGENT_ID}` | | Provider Doc | [Azure AI Foundry Agents ↗](https://learn.microsoft.com/en-us/azure/ai-foundry/agents/quickstart) | ## Authentication Azure AI Foundry Agents require **Azure AD authentication** (not API keys). You can authenticate using: ### Option 1: Service Principal (Recommended for Production) Set these environment variables: ```bash export AZURE_TENANT_ID="your-tenant-id" export AZURE_CLIENT_ID="your-client-id" export AZURE_CLIENT_SECRET="your-client-secret" ``` LiteLLM will automatically obtain an Azure AD token using these credentials. ### Option 2: Azure AD Token (Manual) Pass a token directly via `api_key`: ```bash # Get token via Azure CLI az account get-access-token --resource "https://ai.azure.com" --query accessToken -o tsv ``` ### Required Azure Role Your Service Principal or user must have the **Azure AI Developer** or **Azure AI User** role on your Azure AI Foundry project. To assign via Azure CLI: ```bash az role assignment create \\ --assignee-object-id "" \\ --assignee-principal-type "ServicePrincipal" \\ --role "Azure AI Developer" \\ --scope "/subscriptions//resourceGroups//providers/Microsoft.CognitiveServices/accounts/" ``` Or add via **Azure AI Foundry Portal** → Your Project → **Project users** → **+ New user**. ## Quick Start ### Model Format to LiteLLM To call an Azure AI Foundry Agent through LiteLLM, use the following model format. Here the `model=azure_ai/agents/` tells LiteLLM to call the Azure AI Foundry Agent Service API. ```shell showLineNumbers title="Model Format to LiteLLM" azure_ai/agents/{AGENT_ID} ``` **Example:** - `azure_ai/agents/asst_abc123` You can find the Agent ID in your Azure AI Foundry portal under Agents. ### LiteLLM Python SDK ```python showLineNumbers title="Basic Agent Completion" import litellm # Make a completion request to your Azure AI Foundry Agent # Uses AZURE_TENANT_ID, AZURE_CLIENT_ID, AZURE_CLIENT_SECRET env vars for auth response = litellm.completion( model="azure_ai/agents/asst_abc123", messages=[ { "role": "user", "content": "Explain machine learning in simple terms" } ], api_base="https://your-resource.services.ai.azure.com/api/projects/your-project", ) print(response.choices[0].message.content) print(f"Usage: {response.usage}") ``` ```python showLineNumbers title="Streaming Agent Responses" import litellm # Stream responses from your Azure AI Foundry Agent response = await litellm.acompletion( model="azure_ai/agents/asst_abc123", messages=[ { "role": "user", "content": "What are the key principles of software architecture?" } ], api_base="https://your-resource.services.ai.azure.com/api/projects/your-project", stream=True, ) async for chunk in response: if chunk.choices[0].delta.content: print(chunk.choices[0].delta.content, end="") ``` ### LiteLLM Proxy #### 1. Configure your model in config.yaml ```yaml showLineNumbers title="LiteLLM Proxy Configuration" model_list: - model_name: azure-agent-1 litellm_params: model: azure_ai/agents/asst_abc123 api_base: https://your-resource.services.ai.azure.com/api/projects/your-project # Service Principal auth (recommended) tenant_id: os.environ/AZURE_TENANT_ID client_id: os.environ/AZURE_CLIENT_ID client_secret: os.environ/AZURE_CLIENT_SECRET - model_name: azure-agent-math-tutor litellm_params: model: azure_ai/agents/asst_def456 api_base: https://your-resource.services.ai.azure.com/api/projects/your-project # Or pass Azure AD token directly api_key: os.environ/AZURE_AD_TOKEN ``` #### 2. Start the LiteLLM Proxy ```bash showLineNumbers title="Start LiteLLM Proxy" litellm --config config.yaml ``` #### 3. Make requests to your Azure AI Foundry Agents ```bash showLineNumbers title="Basic Agent Request" curl http://localhost:4000/v1/chat/completions \\ -H "Content-Type: application/json" \\ -H "Authorization: Bearer $LITELLM_API_KEY" \\ -d '{ "model": "azure-agent-1", "messages": [ { "role": "user", "content": "Summarize the main benefits of cloud computing" } ] }' ``` ```bash showLineNumbers title="Streaming Agent Request" curl http://localhost:4000/v1/chat/completions \\ -H "Content-Type: application/json" \\ -H "Authorization: Bearer $LITELLM_API_KEY" \\ -d '{ "model": "azure-agent-math-tutor", "messages": [ { "role": "user", "content": "What is 25 * 4?" } ], "stream": true }' ``` ```python showLineNumbers title="Using OpenAI SDK with LiteLLM Proxy" from openai import OpenAI # Initialize client with your LiteLLM proxy URL client = OpenAI( base_url="http://localhost:4000", api_key="your-litellm-api-key" ) # Make a completion request to your Azure AI Foundry Agent response = client.chat.completions.create( model="azure-agent-1", messages=[ { "role": "user", "content": "What are best practices for API design?" } ] ) print(response.choices[0].message.content) ``` ```python showLineNumbers title="Streaming with OpenAI SDK" from openai import OpenAI client = OpenAI( base_url="http://localhost:4000", api_key="your-litellm-api-key" ) # Stream Agent responses stream = client.chat.completions.create( model="azure-agent-math-tutor", messages=[ { "role": "user", "content": "Explain the Pythagorean theorem" } ], stream=True ) for chunk in stream: if chunk.choices[0].delta.content is not None: print(chunk.choices[0].delta.content, end="") ``` ## Environment Variables | Variable | Description | |----------|-------------| | `AZURE_TENANT_ID` | Azure AD tenant ID for Service Principal auth | | `AZURE_CLIENT_ID` | Application (client) ID of your Service Principal | | `AZURE_CLIENT_SECRET` | Client secret for your Service Principal | ```bash export AZURE_TENANT_ID="your-tenant-id" export AZURE_CLIENT_ID="your-client-id" export AZURE_CLIENT_SECRET="your-client-secret" ``` ## Conversation Continuity (Thread Management) Azure AI Foundry Agents use threads to maintain conversation context. LiteLLM automatically manages threads for you, but you can also pass an existing thread ID to continue a conversation. ```python showLineNumbers title="Continuing a Conversation" import litellm # First message creates a new thread response1 = await litellm.acompletion( model="azure_ai/agents/asst_abc123", messages=[{"role": "user", "content": "My name is Alice"}], api_base="https://your-resource.services.ai.azure.com/api/projects/your-project", ) # Get the thread_id from the response thread_id = response1._hidden_params.get("thread_id") # Continue the conversation using the same thread response2 = await litellm.acompletion( model="azure_ai/agents/asst_abc123", messages=[{"role": "user", "content": "What's my name?"}], api_base="https://your-resource.services.ai.azure.com/api/projects/your-project", thread_id=thread_id, # Pass the thread_id to continue conversation ) print(response2.choices[0].message.content) # Should mention "Alice" ``` ## Provider-specific Parameters Azure AI Foundry Agents support additional parameters that can be passed to customize the agent invocation. ```python showLineNumbers title="Using Agent-specific parameters" from litellm import completion response = litellm.completion( model="azure_ai/agents/asst_abc123", messages=[ { "role": "user", "content": "Analyze this data and provide insights", } ], api_base="https://your-resource.services.ai.azure.com/api/projects/your-project", thread_id="thread_abc123", # Optional: Continue existing conversation instructions="Be concise and focus on key insights", # Optional: Override agent instructions ) ``` ```yaml showLineNumbers title="LiteLLM Proxy Configuration with Parameters" model_list: - model_name: azure-agent-analyst litellm_params: model: azure_ai/agents/asst_abc123 api_base: https://your-resource.services.ai.azure.com/api/projects/your-project tenant_id: os.environ/AZURE_TENANT_ID client_id: os.environ/AZURE_CLIENT_ID client_secret: os.environ/AZURE_CLIENT_SECRET instructions: "Be concise and focus on key insights" ``` ### Available Parameters | Parameter | Type | Description | |-----------|------|-------------| | `thread_id` | string | Optional thread ID to continue an existing conversation | | `instructions` | string | Optional instructions to override the agent's default instructions for this run | ## LiteLLM A2A Gateway You can also connect to Azure AI Foundry Agents through LiteLLM's A2A (Agent-to-Agent) Gateway UI. This provides a visual way to register and test agents without writing code. ### 1. Navigate to Agents From the sidebar, click "Agents" to open the agent management page, then click "+ Add New Agent". ![Add New Agent](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/f8efe335-a08a-4f2b-9f7f-de28e4d58b05/ascreenshot.jpeg?tl_px=0,0&br_px=2201,1230&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=217,118) ### 2. Select Azure AI Foundry Agent Type Click "A2A Standard" to see available agent types, then select "Azure AI Foundry". ![Select A2A Standard](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/ede38044-3e18-43b9-afe3-b7513bf9963e/ascreenshot.jpeg?tl_px=0,0&br_px=2201,1230&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=409,143) ![Select Azure AI Foundry](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/33c396fc-a927-4b03-8ee2-ea04950b12c1/ascreenshot.jpeg?tl_px=0,86&br_px=2201,1317&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=433,277) ### 3. Configure the Agent Fill in the following fields: #### Agent Name Enter a friendly agent name - callers will see this name as the agent available. ![Enter Agent Name](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/18c02804-7612-40c4-9ba4-3f1a4c0725d5/ascreenshot.jpeg?tl_px=0,0&br_px=2617,1463&force_format=jpeg&q=100&width=1120.0) #### Agent ID Get the Agent ID from your Azure AI Foundry portal: 1. Go to [https://ai.azure.com/](https://ai.azure.com/) and click "Agents" ![Azure Agents](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/5e29fc48-c0f7-4b6d-8313-2063d1240d15/ascreenshot.jpeg?tl_px=0,0&br_px=2618,1463&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=39,187) 2. Copy the "ID" of the agent you want to add (e.g., `asst_hbnoK9BOCcHhC3lC4MDroVGG`) ![Copy Agent ID](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/bf17dfec-a627-41c6-9121-3935e86d3700/ascreenshot.jpeg?tl_px=0,0&br_px=2618,1463&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=504,241) 3. Paste the Agent ID in LiteLLM - this tells LiteLLM which agent to invoke on Azure Foundry ![Paste Agent ID](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/45230c28-54f6-441c-9a20-4ef8b74076e2/ascreenshot.jpeg?tl_px=0,97&br_px=2617,1560&force_format=jpeg&q=100&width=1120.0) #### Azure AI API Base Get your API base URL from Azure AI Foundry: 1. Go to [https://ai.azure.com/](https://ai.azure.com/) and click "Overview" 2. Under libraries, select Microsoft Foundry 3. Get your endpoint - it should look like `https://.services.ai.azure.com/api/projects/` ![Get API Base](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/60e2c735-4480-44b7-ab12-d69f4200b12c/ascreenshot.jpeg?tl_px=0,40&br_px=2618,1503&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=278,277) 4. Paste the URL in LiteLLM ![Paste API Base](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/e9c6f48e-7602-449a-9261-0df4a0a66876/ascreenshot.jpeg?tl_px=267,456&br_px=2468,1687&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=524,277) #### Authentication Add your Azure AD credentials for authentication: - **Azure Tenant ID** - **Azure Client ID** - **Azure Client Secret** ![Add Auth](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/e5e2b636-cf2e-4283-a1cc-8d497d349243/ascreenshot.jpeg?tl_px=0,653&br_px=2201,1883&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=339,405) Click "Create Agent" to save. ![Create Agent](https://ajeuwbhvhr.cloudimg.io/https://colony-recorder.s3.amazonaws.com/files/2025-12-14/799a720a-639e-4217-a6f5-51687fc07611/ascreenshot.jpeg?tl_px=416,653&br_px=2618,1883&force_format=jpeg&q=100&width=1120.0&wat=1&wat_opacity=0.7&wat_gravity=northwest&wat_url=https://colony-recorder.s3.us-west-1.amazonaws.com/images/watermarks/FB923C_standard.png&wat_pad=693,519) ### 4. Test in Playground Go to "Playground" in the sidebar to test your agent. ![Go to Playground](https://ajeuwbhvhr.cloudimg --- Source: [Claudary](https://claudary.paisolsolutions.com/skills/azure-ai-agents) · https://claudary.paisolsolutions.com