Ad
Skip to content
Subscribe Now
AI in practice
Copy the url to clipboard Share this article Go to comment section

OpenAI releases Evals API for systematic prompt testing

Matthias Bastian
Matthias Bastian View the LinkedIn Profile of Matthias Bastian
Apr 9, 2025

OpenAI has introduced an Evals API that enables programmatic test creation and automation. The system lets developers integrate evaluations directly into their workflows while maintaining the same configuration options available in OpenAI's dashboard interface. Through API calls, teams can define test parameters, manage evaluation data, and rapidly refine prompts. While the API works with models from other companies, those models must support OpenAI's "Chat Completions API" format. Technical documentation is available in both the OpenAI Cookbook and API documentation.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Read on for the full picture.
Subscribe for hype-free coverage.

  • Access to all THE DECODER articles.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder