Providers

What are providers?

Providers are the infrastructure companies that host and run the models you access through EUrouter. The live Providers page shows which providers and models are currently available.

EUrouter routes model inference to endpoints hosted in the European Union. Provider ownership, processing location, data collection, and retention are separate attributes; use routing preferences when your workload has stricter requirements.

One API, multiple providers

Each model available on EUrouter may be hosted by one or more providers. When you make a request, EUrouter automatically selects the best available provider based on:

Availability — Is the provider currently operational?
Performance — Which provider has the lowest latency?
Cost — Which provider offers the best price?
Capacity — Which provider has available capacity?

You don't need to think about providers when making requests. Just specify the model you want and EUrouter handles the rest.

Provider order

Use provider.order to try preferred providers first. Providers in the list are attempted in order before other eligible fallbacks.

Restricting providers

Use provider.only to restrict a request to an allowlist, or provider.ignore to exclude providers. You can also filter by EU ownership, processing region, collection policy, or retention period.

Automatic failover

When allow_fallbacks is enabled, EUrouter retries eligible providers for retryable failures such as timeouts, rate limits, and server errors. Disable fallbacks when strict provider pinning matters more than availability.

Rate limiting

Providers can apply their own capacity and rate limits. EUrouter accounts for provider health during routing and can fall back when a provider returns a retryable rate-limit response.

Setting up your preferred and fallback providers

Set reusable defaults with Routing Rules, or pass a provider object in an individual request.

Browse providers

See all available providers and their models on the Providers page.