Nvidia Licenses Groq Technology and Hires Key Executives

Nvidia has entered into a licensing agreement for chip technology with the startup Groq and is set to hire its CEO, Jonathan Ross, who previously played a significant role at Alphabet’s Google. This announcement, made by Groq in a blog post on Wednesday, marks a strategic move for Nvidia as it seeks to bolster its capabilities in the artificial intelligence (AI) market, particularly in inference technology.

Groq specializes in inference, a process where AI models, already trained, respond to user requests. While Nvidia has established dominance in training AI models, it faces increasing competition in the inference space from traditional rivals like Advanced Micro Devices (AMD) and emerging companies such as Groq and Cerebras Systems. Groq has stated that Nvidia will receive a “non-exclusive” license to its technology, allowing both companies to explore collaboration while maintaining their independence.

In addition to Ross, Groq’s President Sunny Madra and several engineering team members will join Nvidia. A source close to Nvidia confirmed the licensing agreement, although financial details of the deal remain undisclosed. There have been reports suggesting that Nvidia may acquire Groq for approximately US$20 billion in cash, but neither company has officially commented on this speculation.

Despite the changes, Groq plans to continue operating independently, with Simon Edwards remaining as CEO. The company’s cloud business is also expected to continue its operations without interruption. Following a funding round in September that raised US$750 million, Groq’s valuation surged to US$6.9 billion, significantly up from US$2.8 billion in August of the previous year.

Groq distinguishes itself by employing a unique approach that does not rely on external high-bandwidth memory chips. Instead, it utilizes on-chip memory known as SRAM, which alleviates some of the memory constraints currently affecting the global chip industry. This method enhances performance in interactions with AI models, although it does restrict the size of models that can be deployed. Groq’s main competitor in this niche is Cerebras Systems, which has also garnered attention for its plans to go public in the near future.

Both Groq and Cerebras have secured substantial contracts in the Middle East, indicating a growing demand for their innovative approaches in AI technology. During a recent keynote address, Nvidia’s CEO Jensen Huang emphasized the company’s commitment to maintaining its leadership position as the AI market evolves from training to inference.

As the landscape for AI technology continues to shift, Nvidia’s strategic moves, including the licensing of Groq’s technology and the acquisition of key talent, position it to remain at the forefront of this rapidly developing industry.