Even a chatbot has to take a breather from time to time
Google's PaLM 2 gets better at math when you let the language model take a breather.
In a paper, researchers have investigated whether language models such as GPT-4 or PaLM 2 are suitable as optimizers that automatically find solutions to predefined problems, such as recommending movies or solving grade school math problems.
The language models tried to find the best prompts for each task on their own. The prompt that PaLM 2-L used particularly well to solve math problems was curious: "Take a deep breath and work on this problem step-by-step." Without taking a deep breath, accuracy dropped by almost ten points.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe nowRead on for the full picture.
Subscribe for hype-free coverage.
- Full access to every article on THE DECODER
- No ads
- Join the comments and community discussions
- A weekly AI news recap via mail
- 6x/year: "AI Radar" — deep dives on the AI topics that matter most
- Daily AI news, always up to date
- Our full ten-year archive
- Covered by a team with 10+ years in AI