Is GPT-4 getting worse? Peter Welinder, VP Product at OpenAI, comments on the rumors: "No, we haven't made GPT-4 dumber. Quite the opposite: we make each new version smarter than the previous one," says Welinder. His hypothesis: "When you use it more heavily, you start noticing issues you didn't see before."

Ad

Still, he asked on Twitter for examples of where users felt GPT-4's performance had regressed. OpenAI will look into this, Welinder promises. One example from the comments, where GPT-4 only gives the correct answer after a second attempt, he claims is a bug.

Field reports of GPT-4 performance degradation have been around for a few weeks now, often pointing to a performance difference between access via API and via ChatGPT, where the OpenAI language model integration is regularly adjusted. The opacity of this process may also contribute to uncertainty among users.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.