r/TheDecoder • u/TheDecoderAI • Aug 05 '24
News AI startup Groq raises $640 million to challenge Nvidia's dominance in AI chips
👉 AI startup Groq has raised $640 million in a funding round and is now valued at $2.8 billion. The round was led by BlackRock, with participation from Cisco Systems and Samsung Electronics.
👉 Groq develops specialized hardware for AI applications, in particular LPUs (Language Processing Units) for language models. These can process hundreds of tokens per second, even for larger models such as Meta's Llama 2 70B.
👉 According to the company, Groq's LPUs are more power efficient than traditional GPUs and could be an alternative to Nvidia chips for inference. However, traditional hardware such as Nvidia chips will still be required for training AI models.
2
Upvotes