Content
summary Summary

Chip maker Qualcomm is rolling out new software to coordinate AI models and apps directly on devices. The "AI Orchestrator" aims to bridge personal data, apps, and AI models.

Ad

Qualcomm says the software will act as a go-between for personal information, apps, and on-device AI models. It's designed to combine data like favorite foods, workout routines, and frequent contacts with generative AI assistants to provide tailored responses and actions.

The software supports multiple types of input, including text, images, and voice, and can supposedly leverage the features of installed apps. Qualcomm says that on-device processing offers advantages in terms of response times and privacy.

Flussdiagramm: Qualcomm AI Orchestrator-Architektur mit Eingabe, Verarbeitung und Ausgabe verschiedener KI-Funktionen.
The AI Orchestrator processes user input through AI components like RAG and agent-based AI to generate personalized responses across different use cases. | Image: Qualcomm

Qualcomm gives an example of planning dinner, where the AI assistant could coordinate schedules, make reservations automatically, block calendar time, and adapt to changes.

Ad
Ad

The Qualcomm AI Orchestrator will be integrated into the Qualcomm AI Stack, mediating between apps and AI frameworks and runtimes. Qualcomm plans to expand the orchestrator's capabilities, especially for seamless device-to-device and device-to-car setups.

More details on the AI Orchestrator will be revealed at Qualcomm's annual Snapdragon Summit starting October 21.

Reliable agent AI does not yet exist

Qualcomm is tapping into the "agent" AI trend, seen by some AI companies like OpenAI as the next frontier. The concept involves different AI systems interacting, sometimes within a model, to tackle more complex tasks.

But advanced AI agents like the ones Qualcomm outlines don't exist yet. Microsoft AI chief Mustafa Suleyman recently said that AI models reliable enough for agents are about two generations away. OpenAI reportedly has market-ready AI agent systems planned for next year. Google DeepMind chief Demis Hassabis expects a one- to two-year timeline.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Qualcomm introduces the "AI Orchestrator", a software that mediates between personal data, apps, and AI models on devices.
  • The software uses a personal knowledge graph to better understand the user's context and provide personalized answers.
  • The AI orchestrator supports various forms of input such as text, images, and voice and can even understand and use the capabilities of installed apps.
Sources
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.