Announcements

News

Event: Groq to Feature World’s Fastest GenAI Inference Performance for LLMs on Its LPU™ Systems at SC23 in Denver, CO

Read: Argonne Deploys New Groq System to ALCF AI Testbed, Providing AI Accelerator Access to Researchers Globally

Read: Groq Sets New Large Language Model Performance Record of 300 Tokens per Second per User on Meta AI Foundational LLM, Llama-2 70B

Read: Groq Selects Samsung Foundry to Bring Next-gen LPU™ to the AI Acceleration Market

Sign Up: Get our latest white paper, Key Enterprise Considerations for Inference Deployment of Large Language Models

Posts

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

26 Nov

@pmddomingos We love Nvidia, for training models. For inference, well, we have another offering from @GroqInc.

Reply on Twitter 1728676984409227615 Retweet on Twitter 1728676984409227615 2 Like on Twitter 1728676984409227615 9 Twitter 1728676984409227615

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

24 Nov

@rowancheung Hey @rowancheung, another competitive difference is responsiveness. LLMs run faster on Groq®’s LPU™ chips than any other hardware, so if you want better answers fast let @elonmusk know that you want @xai to run at #GroqSpeed. That, or you can wait, and wait, and wait for them to…

Reply on Twitter 1728110953194221625 Retweet on Twitter 1728110953194221625 8 Like on Twitter 1728110953194221625 17 Twitter 1728110953194221625

Insights

Hey Elon, It’s Time To Cease & De-grok

November 29, 2023

SC23 Daily Roundup: Day 4

November 17, 2023

SC Daily Roundup: Day 3

November 15, 2023

Announcements

News

Event: Groq to Feature World’s Fastest GenAI Inference Performance for LLMs on Its LPU™ Systems at SC23 in Denver, CO

Read: Argonne Deploys New Groq System to ALCF AI Testbed, Providing AI Accelerator Access to Researchers Globally

Read: Groq Sets New Large Language Model Performance Record of 300 Tokens per Second per User on Meta AI Foundational LLM, Llama-2 70B

Read: Groq Selects Samsung Foundry to Bring Next-gen LPU™ to the AI Acceleration Market

Sign Up: Get our latest white paper, Key Enterprise Considerations for Inference Deployment of Large Language Models

Posts

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

26 Nov

@pmddomingos We love Nvidia, for training models. For inference, well, we have another offering from @GroqInc.

Reply on Twitter 1728676984409227615 Retweet on Twitter 1728676984409227615 2 Like on Twitter 1728676984409227615 9 Twitter 1728676984409227615

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

24 Nov

@rowancheung Hey @rowancheung, another competitive difference is responsiveness. LLMs run faster on Groq®’s LPU™ chips than any other hardware, so if you want better answers fast let @elonmusk know that you want @xai to run at #GroqSpeed. That, or you can wait, and wait, and wait for them to…

Reply on Twitter 1728110953194221625 Retweet on Twitter 1728110953194221625 8 Like on Twitter 1728110953194221625 17 Twitter 1728110953194221625

Insights

Hey Elon, It’s Time To Cease & De-grok

November 29, 2023

SC23 Daily Roundup: Day 4

November 17, 2023

SC Daily Roundup: Day 3

November 15, 2023

Resources

Learn About Groq Technology

Tech Docs & Case Studies

Groq RealScale™

Low Latency

Developer Velocity

Determinism

Groq TruePoint™ Technology

Spec Sheets

Product Spec Sheet – GroqChip™ Processor

Product Spec Sheet – GroqCard™ Accelerator

Product Spec Sheet – GroqNode™ Server

Product Spec Sheet – GroqRack™ Compute Cluster

Product Spec Sheet – GroqWare™ Suite

Groq Solutions Suite

Papers

Inference Deployment of Large Language Models

LLMs: Taking the World By Storm

US Army Report: Groq and Entanglement Cybersecurity Anomaly and Outlier Detection Validation

Answer Fast: Accelerating BERT on the Tensor Streaming Processor

Groq at ISCA 2022

ISCA 2020 Conference

Groq TSP Leads in Inference Performance

Blogs

Year of the Compiler – Download

Responsibility at the Core

From the Cave to the Customer – Lessons from My First 100 Days at Groq – Download

Talent, Locations, and Being Different. Groq’s Growth Success

Brave Thinking

Groq Accelerates COVID Drug Discovery 333x Versus Legacy Solutions

Groq Attracts Industry Best from Fortune 500 Companies and Beyond

Groq Fuels Talent Growth Beyond Expectations

Hold my FPGA: GroqChip takes the Cake for LSTM