Models

LLM Models

One inventory for all the models you allow

The model inventory is the single source of truth for what your organization may call: curated starters, custom endpoints, per-model keys, OpenAI and Anthropic protocols, and per-model reliability policies.

Request a demoRead the docs

Highlights

  • Curated starter set, enabled one by one, fail-closed by default
  • Per-model API keys and backend URLs, held server-side
  • OpenAI and Anthropic protocol support per model, with facades
  • Per-model retries, failover, and load distribution
Model routing guide
Read the guide in the knowledge base
Reliability & caching guide
Read the guide in the knowledge base

See llm models in your environment

The AI-FW gateway deploys into your own environment in minutes. Talk to us for a guided demo or jump straight into the docs.

Quick startContact sales