Skip to main content

Anthropic

An llm · client with dialect: anthropic sends requests to the Anthropic Messages API. Requests that arrived in the OpenAI API are translated to the Anthropic format and back.

Configuration

anthropic_llm_client:
  type: llm
  kind: client
  options:
    dialect: anthropic
    server: https://api.anthropic.com
    authorization:
      api_key:
        credentials: "{credentials}"
  telemetry:
    metrics:
      - llm.*
  exit: sys:http_client

Server URL

Zilla appends /messages to the server URL. When the URL has no path, or only /, the path defaults to /v1, so https://api.anthropic.com sends requests to https://api.anthropic.com/v1/messages.

Zilla sends the anthropic-version: 2023-06-01 header, and forwards the caller's anthropic-beta header when the request has one.

Credentials

The Messages API takes the API key in the x-api-key header, without a prefix, so set credentials: "{credentials}" instead of the default Bearer {credentials}. With an inline guard, the key is the one the caller sent, forwarded unchanged. See LLM Credentials.

Routing to Anthropic

north_llm_proxy:
  type: llm
  kind: proxy
  routes:
    - when:
        - model:
            - claude-*
      exit: anthropic_llm_client

Next Steps