LLM SDKs

LLM SDKs are libraries that call models from your code. MAG provides an OpenAI-compatible API, so SDKs that accept a custom OpenAI base URL can connect to MAG.

Set these environment variables:

export OPENAI_API_KEY="$AMSC_TOKEN"
export OPENAI_BASE_URL="https://mag.genesis.americansciencecloud.org/v1"

The variable AMSC_TOKEN contains your PAT. See Step 4.

For other applications, see Other Tools.

Examples:

• OpenAI Python SDK
• LiteLLM SDK