AI in practice

OpenAI just opened ChatGPT-API - and its ten times cheaper than GPT-3.5

Maximilian Schreiner
ChatGPT inspires many people, but also causes irritation, for example through politically controversial statements. OpenAI explains how the dialog AI should respond better and be more responsive to users in the future.

OpenAI

Update
  • Added test environment

Original article from March 3, 2023:

OpenAI has released a test environment for the ChatGPT API. Here you can test specifying input and user messages and compare the output of both 3.5-turbo and 3.5-turbo-0301.

Original article from March 1, 2023:

OpenAI opens the ChatGPT and Whisper API to developers. This allows the AI services to be integrated into applications and products.

Until now, ChatGPT was only available through the AI company's web interface, even in the Pro version for $20 per month.

Now OpenAI is opening the API to developers, providing direct access to the ChatGPT model in addition to the GPT-3, GPT-3.5, and Codex models.

ChatGPT costs have plummeted according to OpenAI

A series of system-wide optimizations have reduced the cost of ChatGPT by 90 percent since its initial release in December, and these savings are now being passed on to API users.

The model now available is called gpt-3.5-turbo, and costs $0.002 per 1,000 tokens - ten times cheaper than existing GPT-3.5 models, according to OpenAI. At the same time, gpt-3.5-turbo is said to be the best model even outside of chat applications; early testers migrated from text-davinci-003 to gpt-3.5-turbo with only minor changes to their prompts, according to the blog post. Early companies like Snap and Shopify are already using the model.

Unlike older GPT models, ChatGPT models like gpt-3.5-turbo process "a sequence of messages with metadata" instead of unstructured text. In examples, OpenAI shows that input can include role assignments or content categories, for example, in addition to a request to translate a sentence. For more information, see the instructions for sending requests to the ChatGPT model.

New ChatGPT model and Whisper API available today, ChatGPT becomes more privacy friendly

OpenAI offers other ChatGPT models besides the stable gpt-3.5-turbo, today gpt-3.5-turbo-0301 is released, and a new stable release should follow in April. All requests are handled by Microsoft's Azure cloud, developers can also book dedicated instances, as already leaked. According to OpenAI, this starts making economic sense past 450 million tokens per day.

In addition to the ChatGPT model, OpenAI is also opening API access to the Whipser speech-to-text model for transcriptions. The large-v2 model costs $0.006 per minute and accepts m4a, mp3, mp4, mpeg, mpga, wav and webm formats.

With the updated models comes another innovation that will be of particular interest to users or organizations with privacy concerns: "Data submitted through the API is no longer used for service improvements (including model training) unless the organization opts in."

More information is available in the OpenAI blog post.