AI in practice | The Decoder

Matthias Bastian

Jul 30, 2024

OpenAI begins alpha testing new AI voice feature for ChatGPT Plus

OpenAI has started testing the "Advanced Voice Mode" for a small group of ChatGPT Plus users. This mode enables more natural real-time conversations where the user can interrupt at any time and the system responds to emotions. To improve the security and quality of voice conversations, OpenAI tested the capabilities of GPT-4o, the model behind the "Advanced Voice Mode", with over 100 external Red Teams in 45 languages. In addition, safeguards were implemented to block output that deviates from the four predefined voices or contains violent or copyrighted content.

Matthias Bastian

Jul 30, 2024

Meta's new open-source model SAM 2 could be the "GPT-4 moment" for computer vision

Matthias Bastian

Jul 29, 2024

Agents might be the next frontier of AI and OpenDevin wants to open source them

OpenDevin enables the development of AI agents that interact with other applications via software interfaces. The platform offers a flexible architecture, a sandbox mode and tools for evaluation. Researchers from several institutions have presented OpenDevin, an open source platform for the development of AI agents. The platform enables agents to interact with their environment via software interfaces, similar to human developers. The name is presumably based on the commercial AI programming tool "Devin". OpenDevin consists of three main components: an agent abstraction, an event stream for tracking actions and observations, and a runtime environment for executing agent actions. The platform provides a secure sandbox environment in which agents can execute code and access a bash shell, a Jupyter notebook server and a web browser. This enables agents to handle complex software development tasks and web-based tasks. Image: OpenDevin initiative OpenDevin already contains several implemented agents, including a generalist CodeAct agent and a specialized web browsing agent. In initial benchmarks, the OpenDevin agents demonstrate competitive performance in various task areas. Image: OpenDevin initiative Users can also easily create their own "micro agents" for specific tasks. The platform also supports collaboration between multiple agents. For example, a generalist agent can delegate tasks to specialized agents. Interaction with users takes place via a chat-based user interface that visualizes the agent's current actions and allows real-time feedback. A special feature of OpenDevin is the AgentSkills library. It contains frequently used functions such as file editing or reading images using vision language models. The library can be expanded to include new skills. The developers emphasize that OpenDevin is designed as a community project. The source code is published under the MIT license on Ghitub, which also allows commercial use. For the future, the team is planning improvements such as extended support for multimodality, more powerful agents and a more stable runtime environment. Agents as a new development horizon for AI systems In the long term, OpenDevin should drive the development of safe and useful AI agents. Commercial companies such as OpenAI also believe that AI agents - AI programs that act and interact with each other - will be the next but one step in AI development. Before that come AI models with logic capabilities. In general, the existing agent approaches still have a lot of room for improvement, as the OpenDevin benchmarks also show. Microsoft's AI CEO recently predicted that it will take two more generations of AI models before reliable AI agents are possible.

Matthias Bastian

Jul 29, 2024

Managers bet on AI to boost productivity, but workers feel overwhelmed and ill-equipped

A survey of 2,500 employees in the US, UK, Australia and Canada by the Upwork Research Institute shows that many employees feel overwhelmed by the AI tools that their managers are demanding. 96 percent of managers expect AI tools to increase productivity. However, 47% of employees do not know how to meet these expectations. According to 77%, the tools have even reduced productivity and increased workload. The results indicate that generative AI has not yet delivered on its promise of productivity. There are many reasons for this. Companies should identify specific use cases, optimize AI for them and introduce it step by step instead of simply providing chatbots.

Matthias Bastian

Jul 28, 2024

China's AI models soar with help from US open-source technology

Chinese technology companies are developing AI models that can keep pace with Western systems. They are also benefiting from open source developments from the USA.

Matthias Bastian

Jul 28, 2024

Elon Musk shares AI-faked video of Kamala Harris on X without disclaimer

Elon Musk shares a video on X (formerly Twitter) with an AI-cloned voice of Democratic US presidential candidate Kamala Harris. Musk does not indicate that it is a fake.

Matthias Bastian

Jul 27, 2024

15% of companies ban code AI, but 99% of developers use it anyway

Matthias Bastian

Jul 27, 2024

OpenAI and Anthropic lose billions on AI development and operations

A chatbot burning money, illustration

Matthias Bastian

Jul 27, 2024

Update

X collects user data without consent for Grok AI training - how to opt out

Matthias Bastian

Jul 26, 2024

OpenAI slashes fine-tuning costs for GPT-4o mini with special limited-time offer