Ad
Skip to content
Subscribe Now
AI in practice
Copy the url to clipboard Share this article Go to comment section

OpenAI introduces Batch API with up to 50% discount for asynchronous tasks

Matthias Bastian
Matthias Bastian View the LinkedIn Profile of Matthias Bastian
Apr 15, 2024

OpenAI introduces a new Batch API that offers up to 50 percent discount for asynchronous API tasks such as summarization, translation, and image classification. With the Batch API, you can get results for large numbers of API requests within 24 hours. This requires uploading a JSONL file containing the requests in batch format. Currently, only the /v1/chat/completions endpoint is supported. In addition to the request file and endpoint, you must also specify a 24-hour window for processing. Optionally, custom metadata can be added to the batch. The new batch API reduces costs and provides higher limits for asynchronous tasks. OpenAI expects this to enable more efficient use of its APIs for applications that require a large number of requests.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Read on for the full picture.
Subscribe for hype-free coverage.

  • Access to all THE DECODER articles.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder