Announcements

News

Event: Groq to Feature World’s Fastest GenAI Inference Performance for LLMs on Its LPU™ Systems at SC23 in Denver, CO

Read: Argonne Deploys New Groq System to ALCF AI Testbed, Providing AI Accelerator Access to Researchers Globally

Read: Groq Sets New Large Language Model Performance Record of 300 Tokens per Second per User on Meta AI Foundational LLM, Llama-2 70B

Read: Groq Selects Samsung Foundry to Bring Next-gen LPU™ to the AI Acceleration Market

Sign Up: Get our latest white paper, Key Enterprise Considerations for Inference Deployment of Large Language Models

Posts

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

26 Nov

@pmddomingos We love Nvidia, for training models. For inference, well, we have another offering from @GroqInc.

Reply on Twitter 1728676984409227615 Retweet on Twitter 1728676984409227615 2 Like on Twitter 1728676984409227615 9 Twitter 1728676984409227615

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

24 Nov

@rowancheung Hey @rowancheung, another competitive difference is responsiveness. LLMs run faster on Groq®’s LPU™ chips than any other hardware, so if you want better answers fast let @elonmusk know that you want @xai to run at #GroqSpeed. That, or you can wait, and wait, and wait for them to…

Reply on Twitter 1728110953194221625 Retweet on Twitter 1728110953194221625 8 Like on Twitter 1728110953194221625 17 Twitter 1728110953194221625

Insights

Hey Elon, It’s Time To Cease & De-grok

November 29, 2023

SC23 Daily Roundup: Day 4

November 17, 2023

SC Daily Roundup: Day 3

November 15, 2023

Announcements

News

Event: Groq to Feature World’s Fastest GenAI Inference Performance for LLMs on Its LPU™ Systems at SC23 in Denver, CO

Read: Argonne Deploys New Groq System to ALCF AI Testbed, Providing AI Accelerator Access to Researchers Globally

Read: Groq Sets New Large Language Model Performance Record of 300 Tokens per Second per User on Meta AI Foundational LLM, Llama-2 70B

Read: Groq Selects Samsung Foundry to Bring Next-gen LPU™ to the AI Acceleration Market

Sign Up: Get our latest white paper, Key Enterprise Considerations for Inference Deployment of Large Language Models

Posts

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

26 Nov

@pmddomingos We love Nvidia, for training models. For inference, well, we have another offering from @GroqInc.

Reply on Twitter 1728676984409227615 Retweet on Twitter 1728676984409227615 2 Like on Twitter 1728676984409227615 9 Twitter 1728676984409227615

Retweet on Twitter Groq Inc Retweeted

Jonathan Ross @jonathanross321 ·

24 Nov

@rowancheung Hey @rowancheung, another competitive difference is responsiveness. LLMs run faster on Groq®’s LPU™ chips than any other hardware, so if you want better answers fast let @elonmusk know that you want @xai to run at #GroqSpeed. That, or you can wait, and wait, and wait for them to…

Reply on Twitter 1728110953194221625 Retweet on Twitter 1728110953194221625 8 Like on Twitter 1728110953194221625 17 Twitter 1728110953194221625

Insights

Hey Elon, It’s Time To Cease & De-grok

November 29, 2023

SC23 Daily Roundup: Day 4

November 17, 2023

SC Daily Roundup: Day 3

November 15, 2023

Resources

See us in action

maxresdefault

Software Defined Hardware for Dataflow Compute / Crossroads 3D-FPGA Invited Lecture by Andrew Bitar

maxresdefault 1

The Future of AI Accelerators

maxresdefault 2

Computational Fluid Dynamics (CFD) Demo - Traditional vs Converged HPC

maxresdefault 3

GroqJams Demo - AI Music-generative Application

maxresdefault 4

Overlapping Tool Demo

maxresdefault 5

Bifrost Demo: Fast and Accurate Speech Transcriptions

maxresdefault 6

Value at Risk (VaR) Demo

maxresdefault 7

The Future of AI with Groq - Sizzle Reel

maxresdefault 8

Accelerating AI - Jeremy Fowers

maxresdefault 9

Answer Fast: Accelerating BERT on the Tensor Streaming Processor by Ibrahim Ahmed

hqdefault

Groq ISCA 2022: A Software-defined Tensor Streaming Multiprocessor for Large-Scale Machine Learning

hqdefault 1

Groq HotChips 2022: Groq Software-Defined Scale-out Tensor Streaming Multi-Processor

maxresdefault 10

Intro to GroqFlow™ - GroqDay October 2022

maxresdefault 12

GroqWare™ Suite Unpacked - GroqDay October 2022

maxresdefault 13

GroqView™ and Groq API - GroqDay October 2022

maxresdefault 14

Intro to Groq Software - GroqDay October 2022

maxresdefault 15

Developing for the Creative Age - GroqDay October 2022

maxresdefault 16

Groq Customer Spotlight, ORNL - GroqDay October 2022

maxresdefault 17

Groq Customer Spotlight, Entanglement AI - GroqDay October 2022

hqdefault 2

Customer Success Story: Entanglement AI™

maxresdefault 18

Groq Day - Episode 166 - The Six Five

maxresdefault 19

Sizzle Reel :: GroqDay March 2022

maxresdefault 20

YOLO Demo :: GroqDay March 2022

maxresdefault 21

Natural Language Processing (NLP) :: GroqDay March 2022

maxresdefault 22

Vision Transformers on GroqChip™ :: GroqDay March 2022

maxresdefault 23

Dr. Cara LaPointe - Assured Autonomy :: GroqDay March 2022

maxresdefault 24

Sara Hooker - The Hardware Lottery :: GroqDay March 2022

maxresdefault 25

Groq & Argonne National Laboratory Partnership Accomplishes 333x Throughput for COVID Drug Discovery

maxresdefault 26

Accelerating Neural Networks with Groq Tensor Streaming Processor :: AI Summit 2021 NYC

maxresdefault 27

Accelerating Financial Risk (VaR) :: GroqDay December 2021

maxresdefault 28

Reinventing Compilers for AI :: GroqDay December 2021

maxresdefault 29

Linear Algebra :: GroqDay December 2021

maxresdefault 30

Accelerated Drug Discovery :: GroqDay December 2021

maxresdefault 31

Why LSTMs? :: GroqDay December 2021

maxresdefault 39

Fellows Panel :: GroqDay December 2021

maxresdefault 38

GroqView™ Profiler :: GroqDay December 2021

maxresdefault 37

Natural Language Processing :: GroqDay December 2021

maxresdefault 36

Algorithms and Game Theory presented by June Cai and Gautam Rayaprolu

maxresdefault 35

Backstage Pass: Reinventing Chips for AI / Madhura Nataraju, Head of Products – Groq

hqdefault 7

Groq Fireside Chat - Andy Rappaport and Jonathan Ross

hqdefault 6

Groq Keynote - 2020 AI Hardware Summit

maxresdefault 34

Groq Architecture

hqdefault 5

GroqSpotlight: Groq Language Processor™ LLaMA-2 70B Sneak Peek

maxresdefault 33

Groq Spotlight: Groq™ Compiler Overview

maxresdefault 32

Groq Spotlight: Quenching AI Thirst with Inference

hqdefault 4

GroqSpotlight: Large Language Models at Scale

hqdefault 3

GroqSpotlight: A CEO Conversation with Jonathan Ross