Content
summary Summary

If you have been building sophisticated prompts and AI workflows for GPT-4 over the past few months, you will be happy to hear this news: Prompts between GPT-4 and Google's Gemini Ultra are compatible.

Ad

This is according to Ethan Mollick, a professor at the Wharton School who has had access to Gemini Ultra for over a month. Mollick was involved in a multi-month study of productivity gains from GPT-4 in the consulting industry.

The compatibility between the two models is "remarkable," he says. Complex prompts he tested that worked on GPT-4 were also handled well by Gemini Ultra.

"Advanced LLMs may show some basic similarities in prompts and responses that make it easy for people to switch to the most advanced AI from an older model at any time," Mollick writes.

Ad
Ad

Anyone who has built a prompt library with underlying workflows will be happy to hear this. Our tests with AI content show that the reverse does not work: A complex GPT-4 prompt in Llama 2, for example, gives significantly worse results. It is good to know that the opposite is possible and that proven AI workflows can be upgraded to better models without having to change all the prompts.

Gemini Ultra is "clearly a GPT-4 class model"

However, Ultra can sometimes be too helpful, so educational prompts that require students to interact with the AI to understand a concept need adjustment. A paper on this will follow, Mollick writes.

Otherwise, Mollick confirms that Gemini Ultra is definitely on par with GPT-4, with different strengths and weaknesses.

Gemini is more open to a "darker" writing style, gives better explanations, integrates images and Search better, Mollick writes. GPT-4 is better at coding, passes challenging language tasks such as the "Apple test" (see screenshot), and writes better sestinas.

Gemini Ultra fails the "apple test." | Image: Ethan Mollick

Gemini shows that companies other than OpenAI can build GPT-4-class models, Mollick says. However, both models are also inconsistent and weird and hallucinate "more than you would like."

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Recommendation
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • GPT-4 and Google's Gemini Ultra prompts are said to be compatible, according to an early study, meaning that the complex prompts and AI workflows you build for GPT-4 can also be run by Gemini Ultra.
  • Ethan Mollick, a professor at the Wharton School, reports on the "remarkable" compatibility between the two models.
  • Mollick also confirms that Gemini Ultra is on par with GPT-4, albeit with different strengths and weaknesses.
Sources
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.