Content
summary Summary

At GTC 2024, OpenAI COO Brad Lightcap spoke about generative AI - and what's to come.

Ad

In an interview with Manuvir Das, Vice President of Enterprise Computing at Nvidia, Lightcap explained how his company is helping enterprise customers implement generative AI.

Toward the end, however, the discussion turned to what's missing for useful AI agents and OpenAI's plans for the coming years.

"Two things have to happen: One, the reasoning ability of the model needs to improve, and two, you need to give it some ability to have actuators that basically take action in the world. And I think those are kind of the next two waves that we're going to see merge," Lightcap says of AI agents.

Ad
Ad

According to him, OpenAI is expected to "really accelerate" reasoning capabilities - which would then enable models capable of solving multi-step problems.

"Plenty of scope for future scaling"

When asked where he sees his company this year and three years from now, Lightcap was cautious. What he could say, however, was: "We don't think we're anywhere near the ceiling for improving the core capabilities of these models. We think there's a lot of room for future scale ops, and we're very excited about that."

The team is trying to understand how "we can move the models along axes that are not just raw IQ," he said, without going into more detail. "I think we feel really good about where that work is going."

Scaling, then, still seems to be an important component for OpenAI - whether in the realm of data, model size, or computation. And the focus on reasoning - the ability to draw logical conclusions - is in line with the rumors surrounding Q*.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • OpenAI COO Brad Lightcap discusses the future of generative AI, emphasizing the need for improved reasoning abilities and actuators for AI agents to take action in the world.
  • Lightcap believes there is still plenty of room for scale ops and improving the core capabilities of AI models, focusing on aspects beyond just "raw IQ".
  • OpenAI plans to accelerate the development of reasoning capabilities, aiming to create models capable of solving multi-step problems.
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.