--- title: "Using PDF Input" description: "import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem';" type: skill canonical_url: https://claudary.paisolsolutions.com/skills/document-understanding source: "Claudary" difficulty: intermediate author: "Claude Code Knowledge Pack" date: 2026-07-10T11:19:57.519Z license: CC-BY-4.0 attribution: "Using PDF Input โ€” Claudary (https://claudary.paisolsolutions.com/skills/document-understanding)" --- # Using PDF Input import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem'; ## Overview import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem'; # Using PDF Input How to send / receive pdf's (other document types) to a `/chat/completions` endpoint Works for: - Vertex AI models (Gemini + Anthropic) - Bedrock Models - Anthropic API Models - OpenAI API Models - Mistral (Only using file ID of already uploaded file, similar to OpenAI file_id input) ## Quick Start ### url ```python from litellm.utils import supports_pdf_input, completion # set aws credentials os.environ["AWS_ACCESS_KEY_ID"] = "" os.environ["AWS_SECRET_ACCESS_KEY"] = "" os.environ["AWS_REGION_NAME"] = "" # pdf url file_url = "https://www.w3.org/WAI/ER/tests/xhtml/testfiles/resources/pdf/dummy.pdf" # model model = "bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0" file_content = [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_id": file_url, } }, ] if not supports_pdf_input(model, None): print("Model does not support image input") response = completion( model=model, messages=[{"role": "user", "content": file_content}], ) assert response is not None ``` 1. Setup config.yaml ```yaml model_list: - model_name: bedrock-model litellm_params: model: bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0 aws_access_key_id: os.environ/AWS_ACCESS_KEY_ID aws_secret_access_key: os.environ/AWS_SECRET_ACCESS_KEY aws_region_name: os.environ/AWS_REGION_NAME ``` 2. Start the proxy ```bash litellm --config /path/to/config.yaml ``` 3. Test it! ```bash curl -X POST 'http://0.0.0.0:4000/chat/completions' \\ -H 'Content-Type: application/json' \\ -H 'Authorization: Bearer sk-1234' \\ -d '{ "model": "bedrock-model", "messages": [ {"role": "user", "content": [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_id": "https://www.w3.org/WAI/ER/tests/xhtml/testfiles/resources/pdf/dummy.pdf", } } ]}, ] }' ``` ### base64 ```python from litellm.utils import supports_pdf_input, completion # set aws credentials os.environ["AWS_ACCESS_KEY_ID"] = "" os.environ["AWS_SECRET_ACCESS_KEY"] = "" os.environ["AWS_REGION_NAME"] = "" # pdf url image_url = "https://www.w3.org/WAI/ER/tests/xhtml/testfiles/resources/pdf/dummy.pdf" response = requests.get(url) file_data = response.content encoded_file = base64.b64encode(file_data).decode("utf-8") base64_url = f"data:application/pdf;base64,{encoded_file}" # model model = "bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0" file_content = [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_data": base64_url, } }, ] if not supports_pdf_input(model, None): print("Model does not support image input") response = completion( model=model, messages=[{"role": "user", "content": file_content}], ) assert response is not None ``` 1. Setup config.yaml ```yaml model_list: - model_name: bedrock-model litellm_params: model: bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0 aws_access_key_id: os.environ/AWS_ACCESS_KEY_ID aws_secret_access_key: os.environ/AWS_SECRET_ACCESS_KEY aws_region_name: os.environ/AWS_REGION_NAME ``` 2. Start the proxy ```bash litellm --config /path/to/config.yaml ``` 3. Test it! ```bash curl -X POST 'http://0.0.0.0:4000/chat/completions' \\ -H 'Content-Type: application/json' \\ -H 'Authorization: Bearer sk-1234' \\ -d '{ "model": "bedrock-model", "messages": [ {"role": "user", "content": [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_data": "data:application/pdf;base64...", } } ]}, ] }' ``` ## Specifying format To specify the format of the document, you can use the `format` parameter. ```python from litellm.utils import supports_pdf_input, completion # set aws credentials os.environ["AWS_ACCESS_KEY_ID"] = "" os.environ["AWS_SECRET_ACCESS_KEY"] = "" os.environ["AWS_REGION_NAME"] = "" # pdf url file_url = "https://www.w3.org/WAI/ER/tests/xhtml/testfiles/resources/pdf/dummy.pdf" # model model = "bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0" file_content = [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_id": file_url, "format": "application/pdf", } }, ] if not supports_pdf_input(model, None): print("Model does not support image input") response = completion( model=model, messages=[{"role": "user", "content": file_content}], ) assert response is not None ``` 1. Setup config.yaml ```yaml model_list: - model_name: bedrock-model litellm_params: model: bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0 aws_access_key_id: os.environ/AWS_ACCESS_KEY_ID aws_secret_access_key: os.environ/AWS_SECRET_ACCESS_KEY aws_region_name: os.environ/AWS_REGION_NAME ``` 2. Start the proxy ```bash litellm --config /path/to/config.yaml ``` 3. Test it! ```bash curl -X POST 'http://0.0.0.0:4000/chat/completions' \\ -H 'Content-Type: application/json' \\ -H 'Authorization: Bearer sk-1234' \\ -d '{ "model": "bedrock-model", "messages": [ {"role": "user", "content": [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_id": "https://www.w3.org/WAI/ER/tests/xhtml/testfiles/resources/pdf/dummy.pdf", "format": "application/pdf", } } ]}, ] }' ``` ## Mistral Example Here is a sample payload for using the Mistral model for document understanding: ```python from litellm.utils import completion # pdf file_id received from files endpoint file_id = "fa778e5e-46ec-4562-8418-36623fe25a71" # model model = "mistral/mistral-large-latest" file_content = [ {"type": "text", "text": "What's this file about?"}, { "type": "file", "file": { "file_id": file_id, } }, ] response = completion( model=model, messages=[{"role": "user", "content": file_content}], ) assert response is not None ``` ```bash curl -X POST 'http://0.0.0.0:4000/chat/completions' \\ -H 'Content-Type: application/json' \\ -H 'Authorization: Bearer sk-1234' \\ -d '{ "model": "mistral/mistral-large-latest", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "What is the content of the file?" }, { "type": "file", "file": { "file_id": "fa778e5e-46ec-4562-8418-36623fe25a71" } } ] } ] } ``` ## Checking if a model supports pdf input Use `litellm.supports_pdf_input(model="bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0")` -> returns `True` if model can accept pdf input ```python assert litellm.supports_pdf_input(model="bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0") == True ``` 1. Define bedrock models on config.yaml ```yaml model_list: - model_name: bedrock-model # model group name litellm_params: model: bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0 aws_access_key_id: os.environ/AWS_ACCESS_KEY_ID aws_secret_access_key: os.environ/AWS_SECRET_ACCESS_KEY aws_region_name: os.environ/AWS_REGION_NAME model_info: # OPTIONAL - set manually supports_pdf_input: True ``` 2. Run proxy server ```bash litellm --config config.yaml ``` 3. Call `/model_group/info` to check if a model supports `pdf` input ```shell curl -X 'GET' \\ 'http://localhost:4000/model_group/info' \\ -H 'accept: application/json' \\ -H 'x-api-key: sk-1234' ``` Expected Response ```json { "data": [ { "model_group": "bedrock-model", "providers": ["bedrock"], "max_input_tokens": 128000, "max_output_tokens": 16384, "mode": "chat", ..., "supports_pdf_input": true, # ๐Ÿ‘ˆ supports_pdf_input is true } ] } ``` --- Source: [Claudary](https://claudary.paisolsolutions.com/skills/document-understanding) ยท https://claudary.paisolsolutions.com