Content
summary Summary

Google Deepmind is developing an AI system called Gemini that will combine the capabilities of AlphaGo with large language models such as GPT-4, the technology behind OpenAI's ChatGPT.

Ad

Deepmind CEO Demis Hassabis tells Wired that the company's expertise in reinforcement learning could give Gemini distinctive features. Using AlphaGo's techniques such as reinforcement learning and tree search, Gemini aims to provide new capabilities such as problem-solving and planning.

"At a high level you can think of Gemini as combining some of the strengths of AlphaGo-type systems with the amazing language capabilities of the large models. We also have some new innovations that are going to be pretty interesting."

Demis Hassabis

Gemini was officially unveiled in May and, according to Hassabis, will be in development and training for several more months. Gemini is said to have multimodal capabilities not seen in previous models, be highly efficient at integrating tools and APIs.

The system could cost tens or hundreds of millions of dollars to develop and could play a critical role in Google's response to ChatGPT and other generative AI technologies, Wired reports.

Ad
Ad

Gemini will be available in multiple sizes and designed to support future innovations such as memory and planning. Rumors in March said that the model will have a trillion parameters like GPT-4 reportedly does. The project is said to use tens of thousands of Google's TPU AI chips for training.

Meanwhile, according to OpenAI CEO Sam Altman, GPT-5 is still a long way from launch and won't begin training for at least six months. A launch in 2024 seems likely. Google Deepmind hasn't said when Gemini will be released.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Google Deepmind is developing an AI system called Gemini, which combines the capabilities of AlphaGo and large language models such as GPT-4.
  • The project aims to create a multimodal AI system with advanced planning and problem-solving capabilities.
  • Gemini is still in development and could cost tens or hundreds of millions of dollars, but it could have a significant impact on Google's competitiveness in the AI landscape. It's still months away.
Sources
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.