Easy Access to Fast AI Inference

Use Groq, Fast.

Move seamlessly to Groq from other providers like OpenAI by changing three lines of code.

 
  1. With our OpenAI endpoint compatibility, simply set OPENAI_API_KEY to your Groq API Key.
  2. Set the base URL.
  3. Choose your model and run!
START BUILDING NOW

Unleash the Full Potential of AI

Unlock a new set of use cases with AI applicatioans running at Groq speed. Powered by the Groq LPU and available as public, private, and co-cloud instances, GroqCloud redefines real-time. Get started for free by visiting our GroqCloud Developer Console and join the hundreds of thousands of developers already building on GroqCloud.

Agentic Ready

Seamlessly integrate tools, leverage real-time streaming, and connect to external sources to empower agents with enhanced intelligence. Transform natural language into actionable API calls and build dynamic, real-time workflows, driving efficiency and innovation.

Multiple Languages
Supported

Build applications with Groq API using the language of your choice with support for curl, JavaScript, Python, and JSON.

Industry Standard
Frameworks

Build cutting-edge applications leveraging industry-leading frameworks like LangChain, Llamaindex, and Vercel AI SDK. Create context-aware apps and enjoy real-time streamed UIs for dynamic, responsive applications that adapt to user needs.

Leading Openly-available Models

Take advantage of fast AI inference performance for leading openly-available Large Language Models and Automatic Speech Recognition models, including: Llama 3.1 8B Llama 3.1 70B, Llama 3 8B, Llama 3 70B, Mixtral 8x7B, Gemma 7B, Gemma 2 9B, Whisper Large V3.

No-code Developer Playground

Start exploring Groq API and featured models without writing a single line of code on the GroqCloud Developer Console.

On-demand Pricing for Tokens-as-a-Service

Tokens are the new oil, but you shouldn’t have to pay large upfront costs to start generating them. The Groq on-demand tokens-as-a-service model is simple. You pay as you go for the tokens consumed without any upfront costs. Explore our package and pricing options here. 

Enterprise API Solutions 
Do you need the fastest inference at data center scale? We have multiple tiered solutions to suit your commercial projects via our GroqCloud API. If you need any of the following, please fill out our short form and a Groqster will reach out shortly to discuss your project needs. We look forward to providing the right solution for your needs.
  • Custom rate limits
  • Fine-tuned models
  • Custom SLAs
  • Dedicated support
  • Administrative Controls
“Yes, with agentic workflows, super fast token generation (like Groq) becomes very important to overall system speed.”
Andrew Ng
Founder of DeepLearning.AI and Stanford University Adjunct Professor
REFERENCE | MARCH 21, 2024

Groq Use Cases

Learn how others are taking advantage of GroqCloud to accelerate business with fast AI inference today.

Launch Demo
Project Media QA: Summarize and ask questions about online media content
Launch Demo
Read Use Case

Vectorize: A powerful RAG experimentation and pipeline platform

Read Use Case
Read Use Case

Real-time Inference for the Real World: Athena Intelligence

Read Use Case

Never miss a Groq update! Sign up below for our latest news.

Sign up for Groq updates