Groq free API: request and token limits

Groq has a Free Plan with model-specific request, token and audio limits. Check the limits for your organization.

Tier / trial

Read both quotas

RPM/RPD count requests; TPM/TPD count tokens. Audio tasks can have additional duration limits. Organization-level limits do not multiply when you create another key.

Setup checklist

  1. Pick an available model and create a key in the console.
  2. Check your organization Limits page and the correct plan tab.
  3. Start with a short prompt and low concurrency.
  4. Record remaining quota and reset headers; respect retry-after on 429.

Practical choice

Useful for small prototypes. Long contexts may hit token caps before request caps. Add queuing, timeouts and clear failure messages before relying on it for a public app.

Evidence

Documentation review only; no latency benchmark is claimed.