Skip to main content
Use the Hercules AI Gateway to built AI features in your app like chatbots, content generation, summarization, analysis, and more. Hercules AI Gateway is built into all apps and works out of the box. You can use all the most popular models from OpenAI, Anthropic, Google, and xAI without needing to set up API keys.
AI Gateway Customer Support Chatbot

​
How do I set it up?

Ask Hercules to build you an app that uses AI! Hercules will use Hercules AI Gateway by default e.g.
Setup Hercules AI Gateway
Build a customer support chatbot for my app. Have it expand from a widget in the bottom right

​
What can I build with AI Gateway?

  • Chatbots: Customer support chatbot, AI coach
  • Content generation: Write descriptions, emails, summaries
  • Analysis: Extract insights from text, categorize data
  • Summarization: Condense long documents or articles
  • Personalization: Generate custom recommendations

​
What models can I choose?

We support models (like GPT, Claude, Gemini) from the following providers: Anthropic, Google AI Studio, Groq, and OpenAI

​
What model does Hercules use by default?

By default, Hercules AI Gateway uses GPT 5 mini by OpenAI. It’s fast, cheap, and very accurate.

​
How do I choose another model?

If you’d like to use another model, just tell Hercules the model and/or provider you want to use:
  • Use Claude Haiku by Anthropic
  • Use Gemini 3 Flash by Google

​
What input/output is supported?

InputOutput
TodayText, images, PDFs,Text
PlannedText, images, PDFs, voice/audio, videosText, images, video, voice/audio

​
How is billing handled?

AI Gateway usage is billed separately through Hercules Cloud. It’s a separate line item from the Hercules AI agent (what you use to build your app). Usage counts against your Hercules Cloud credit allocation.

​
Do I need my own API keys?

No. This is all managed by Hercules out of the box through the HERCULES_API_KEY. If you want to manage billing yourself, you need to ask Hercules to remove the Hercules AI Gateway, then configure the API key and model yourself.

​
Additional FAQ

The Hercules AI agent builds your app. AI Gateway lets your users use AI features inside your published app.They are also currently billed separately. Hercules AI Agent bills against your monthly AI credits. Hercules AI Gateway bills against your Hercules Cloud credits.
Use the OpenAI SDK with Hercules configuration:
import OpenAI from "openai";

const openai = new OpenAI({
  baseURL: "http://ai-gateway.hercules.app/v1",
  apiKey: process.env.HERCULES_API_KEY,
});

const response = await openai.chat.completions.create({
  model: "openai/gpt-5-mini",
  messages: [{ role: "user", content: prompt }],
});
The HERCULES_API_KEY is automatically available in your app’s environment.
Yes. Hercules handles rate limiting automatically. If you need higher limits, please contact support.
Yes. Hercules can set up your chatbot to stream responses in real-time as they come through
View usage in your billing dashboard under Hercules Cloud.
Image and other modalities are planned. Currently, AI Gateway supports text generation. For image generation from Hercules AI Agent, see the Image Generation feature.