Groq is Fast AI Inference
Use Groq, Fast.
Move seamlessly to Groq from other providers like OpenAI by changing three lines of code.
- With our OpenAI endpoint compatibility, simply set OPENAI_API_KEY to your Groq API Key.
- Set the base URL.
- Choose your model and run!
![](https://groq.com/wp-content/uploads/2024/08/UseGroqFast-Update.gif)
Groq Speed Is Instant
Don’t just take our word for it. Independent benchmarks from Artificial Analysis prove Groq Speed is instant for foundational openly-available models.
![AA-Speed-Llama3_1-8B (2)](https://groq.com/wp-content/uploads/2024/07/AA-Speed-Llama3_1-8B-2.png)
![AA-Speed-Llama3_1-70B](https://groq.com/wp-content/uploads/2024/07/AA-Speed-Llama3_1-70B.png)
![AA-Speed-Llama3-8B](https://groq.com/wp-content/uploads/2024/07/AA-Speed-Llama3-8B.png)
![AA-Speed-Mixtral8x7b (1)](https://groq.com/wp-content/uploads/2024/07/AA-Speed-Mixtral8x7b-1.png)
![2 Bloq-whisper](https://groq.com/wp-content/uploads/2025/01/2-Bloq-whisper-2.png)
![AA-Speed-Gemma2_9B (1)](https://groq.com/wp-content/uploads/2024/07/AA-Speed-Gemma2_9B-1.png)
Groq Powers Leading
Openly-available AI Models
“The Groq chip really goes for the jugular.”
![](https://groq.com/wp-content/uploads/2024/08/Yann.png)
Groq in the News
Never miss a Groq update! Sign up below for our latest news.