Content
summary Summary

GPT-4 aces another test, this time the Torrance Tests of Creative Thinking (TTCT).

Ad

According to a new study from the University of Montana, ChatGPT using GPT-4 scored in the top 1% of original creative thinkers.

The chatbot's creativity was assessed using the Torrance Tests of Creative Thinking (TTCT), which has been used to assess human creativity for decades.

ChatGPT generated eight answers and human students generated 24. The results were submitted to the Scholastic Testing Service, which was unaware that AI was involved.

Ad
Ad

GPT-4 vs. 2,700 students

GPT-4 was in the top percentile for fluency - the ability to generate numerous ideas - and originality - the ability to generate new ideas. GPT-4 fell slightly in flexibility - the ability to generate different types and categories of ideas - and only outperformed 97% of all participants.

Compared to the 2,700 students who participated in the TTCT in 2016, GPT-4 outperformed the vast majority.

According to author Dr. Erik Guzik, the older GPT-3 performed way worse. The economist had expected ChatGPT, as a generative AI, to generate a lot of ideas. But he was surprised at how well the system generated original ideas.

Is GPT-4 creative?

So is GPT-4 creative? "We were very careful at the conference to not interpret the data very much," Guzik said. "We just presented the results." But the work provided strong evidence that GPT-4 had developed some creative abilities that equaled or exceeded those of humans, says Guzik.

But the results also showed that we don't really understand human creativity, he said.

Recommendation

He sees great potential for "creative" AI in entrepreneurship and regional and national innovation processes. Systems like GPT-4 could be a real game changer.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • GPT-4 outperforms most human participants in the Torrance Tests of Creative Thinking (TTCT), scoring in the top 1% of original creative thinkers.
  • Compared to GPT-3, GPT-4 shows a significant improvement in the generation of original ideas.
  • Dr. Erik Guzik sees potential for creative AI in entrepreneurship and innovation processes, and GPT-4 could be a "game changer".
Sources
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.