Regional inference now available on AI Gateway
AI Gateway now supports regional inference . Set inferenceRegion on a request to pin it to the US or EU. Every model provider that supports the selected region handles it the same way. Inference runs…
Added 1
- Support regional inference on AI Gateway with inferenceRegion parameter to pin requests to US or EU regions