Wow, that's a lot of tweets tonight! FAQs responses. We're faster because we designed our chip & systems. It's an LPU, Language Processing Unit (not a GPU). We use open-source models, but we don't train them.
The first public demo using Groq: a lightning-fast AI Answers Engine. It writes factual, cited answers with hundreds of words in less than a second. More than 3/4 of the time is spent searching, not generating! The LLM runs in a fraction of a second.
Collection
[
|
...
]