Configuration

Configure your AI Gateway with multiple options and customizations.

• Caching: Override caching settings on a per-request basis.
• Fallbacks: Specify model or provider fallback with your Universal endpoint to specify what to do if a request fails.
• Rate limiting: Rate limiting controls the traffic that reaches your application, which prevents expensive bills and suspicious activity.
• Manage gateways: You have several different options for managing an AI Gateway.