AI research | The Decoder

Jonathan Kemper

Aug 2, 2024

AI research

Nvidia uses Apple Vision Pro to record humans controlling robots for more realistic training data

The scaling of training data has already led to great success with language models. The same tactics should also lead to great progress in robotics.

Jonathan Kemper

Jul 31, 2024

AI research

Google DeepMind's new Gemma 2 model outperforms larger LLMs with fewer parameters

Jonathan Kemper

Jul 30, 2024

AI research

AI data isn't destroying AI models after all, researchers say

A recent study published in Nature appears to demonstrate model collapse in several AI architectures, but other researchers say the study makes unrealistic assumptions that are inconsistent with common practice, such as discarding all previous data after each iteration. The critical researchers disagree with the theory that training AI models on synthetic data inevitably leads to "model collapse," where performance gradually declines until the model becomes inefficient. This effect is not a real threat under realistic conditions, they say. With LLaMA 3.1, Meta shows that synthetic data generation processes that iteratively correct errors can improve performance without causing model collapse.

Jonathan Kemper

Jul 28, 2024

AI research

Study reveals major weaknesses in AI's ability to understand diagrams and abstract visuals

Colorful AI illustration of a clock that is impossible to read.

Jonathan Kemper

Jul 25, 2024

AI research

Stable Video 4D creates moving 3D models from video

Illustration from the Stable Video 4D paper showing dynamic 3D objects.

Matthias Bastian

Jul 25, 2024

AI research

Google DeepMind's latest AI models might bring us one step closer to LLMs that can reason

Maximilian Schreiner

Jul 25, 2024

AI research

Rule-Based Rewards: OpenAI provides insight into the GPT-4 safety stack

hand-drawn illustration of a digital newspaper

Maximilian Schreiner

Jul 24, 2024

AI research

AI-powered medical diagnosis gets a transparency boost with new 'Chain of Diagnosis' method

Maximilian Schreiner

Jul 23, 2024

AI research

CLAY creates detailed 3D objects from text and images

Jonathan Kemper

Jul 22, 2024

AI research

Graph RAG: Access to external data becomes much more accurate with Microsoft's approach

Abstract AI illustration of a colorful network graph.