Groq

Groq logo Groq#

Ultra-fast inference with custom LPU hardware, offering low-latency model serving.

Provider Information#

FieldValue
Provider IDgroq
Total Models28
AuthenticationAPI Key Required
Environment VariableGROQ_API_KEY
Status Pagehttps://status.groq.com

🔗 API Endpoints#

Documentation: https://console.groq.com/docs/models

Models API: https://api.groq.com/openai/v1/models

Chat Completions: https://api.groq.com/openai/v1/chat/completions

Health API: https://groqstatus.com/api/v2/summary.json

🔒 Privacy & Data Handling#

Privacy Policy: https://groq.com/privacy-policy/

Terms of Service: https://groq.com/terms-of-use/

Retains User Data: No

Trains on User Data: No

⏱️ Data Retention Policy#

Policy Type: No Retention

Retention Duration: Immediate deletion

Details: Input prompts and context are not retained; data is processed for immediate response generation and then discarded

🛡️ Content Moderation#

Requires Moderation: No

Content Moderated: Yes

Moderated by: Groq

🏢 Headquarters#

Mountain View, CA, USA

Available Models#

GPT#

ModelContextInputOutputFeatures
openai/gpt-oss-120b131.1k$0.15$0.75📝 ⚡
openai/gpt-oss-20b131.1k$0.10$0.50📝 ⚡

Gemma#

ModelContextInputOutputFeatures
gemma2-9b-it8.2k$0.20$0.20📝 🔧 ⚡

Llama#

ModelContextInputOutputFeatures
Llama 3 70B8.2k$0.59$0.79
Llama 3 8B8.2k$0.05$0.08
Llama Guard 3 8B8.2k$0.20$0.20
deepseek-r1-distill-llama-70b131.1k$0.75$0.99📝 🔧 ⚡
llama-3.1-8b-instant131.1k$0.05$0.08📝 ⚡
llama-3.3-70b-versatile131.1k$0.59$0.79📝 ⚡
meta-llama/llama-4-maverick-17b-128e-instruct131.1k$0.20$0.60📝 ⚡
meta-llama/llama-4-scout-17b-16e-instruct131.1k$0.11$0.34📝 ⚡
meta-llama/llama-guard-4-12b131.1k$0.20$0.20📝 ⚡
meta-llama/llama-prompt-guard-2-22m512N/AN/A📝 ⚡
meta-llama/llama-prompt-guard-2-86m512N/AN/A📝 ⚡

Mistral#

ModelContextInputOutputFeatures
Mistral Saba 24B32.8k$0.79$0.79

Other#

ModelContextInputOutputFeatures
allam-2-7b4.1kN/AN/A📝 ⚡
compound-beta131.1kN/AN/A📝 ⚡
compound-beta-mini131.1kN/AN/A📝 ⚡
groq/compound131.1kN/AN/A📝 ⚡
groq/compound-mini131.1kN/AN/A📝 ⚡
moonshotai/kimi-k2-instruct131.1k$1.00$3.00📝 ⚡
moonshotai/kimi-k2-instruct-0905262.1k$1.00$3.00📝 ⚡
playai-tts8.2kN/AN/A📝 ⚡
playai-tts-arabic8.2kN/AN/A📝 ⚡

Qwen#

ModelContextInputOutputFeatures
Qwen QwQ 32B131.1k$0.29$0.39
qwen/qwen3-32b131.1k$0.29$0.59📝 ⚡

Whisper#

ModelContextInputOutputFeatures
whisper-large-v3448N/AN/A📝 ⚡
whisper-large-v3-turbo448$0.00$0.00📝 ⚡

Configuration#

Authentication#

This provider requires an API key. Set it as an environment variable:

1export GROQ_API_KEY="your-api-key-here"

Using with Model.Wiki#

1# List all models from this provider
2starmap list models --provider groq
3
4# Fetch latest models from provider API
5starmap fetch --provider groq
6
7# Sync provider data
8starmap sync --provider groq

See Also#


← Back to Providers | ← Back to Home | Generated by ModelWiki