Content
summary Summary
Update
  • Added test environment

Original article from March 3, 2023:

OpenAI has released a test environment for the ChatGPT API. Here you can test specifying input and user messages and compare the output of both 3.5-turbo and 3.5-turbo-0301.

Original article from March 1, 2023:

OpenAI opens the ChatGPT and Whisper API to developers. This allows the AI services to be integrated into applications and products.

Ad
Ad

Until now, ChatGPT was only available through the AI company's web interface, even in the Pro version for $20 per month.

Now OpenAI is opening the API to developers, providing direct access to the ChatGPT model in addition to the GPT-3, GPT-3.5, and Codex models.

ChatGPT costs have plummeted according to OpenAI

A series of system-wide optimizations have reduced the cost of ChatGPT by 90 percent since its initial release in December, and these savings are now being passed on to API users.

The model now available is called gpt-3.5-turbo, and costs $0.002 per 1,000 tokens - ten times cheaper than existing GPT-3.5 models, according to OpenAI. At the same time, gpt-3.5-turbo is said to be the best model even outside of chat applications; early testers migrated from text-davinci-003 to gpt-3.5-turbo with only minor changes to their prompts, according to the blog post. Early companies like Snap and Shopify are already using the model.

Unlike older GPT models, ChatGPT models like gpt-3.5-turbo process "a sequence of messages with metadata" instead of unstructured text. In examples, OpenAI shows that input can include role assignments or content categories, for example, in addition to a request to translate a sentence. For more information, see the instructions for sending requests to the ChatGPT model.

Recommendation

New ChatGPT model and Whisper API available today, ChatGPT becomes more privacy friendly

OpenAI offers other ChatGPT models besides the stable gpt-3.5-turbo, today gpt-3.5-turbo-0301 is released, and a new stable release should follow in April. All requests are handled by Microsoft's Azure cloud, developers can also book dedicated instances, as already leaked. According to OpenAI, this starts making economic sense past 450 million tokens per day.

In addition to the ChatGPT model, OpenAI is also opening API access to the Whipser speech-to-text model for transcriptions. The large-v2 model costs $0.006 per minute and accepts m4a, mp3, mp4, mpeg, mpga, wav and webm formats.

With the updated models comes another innovation that will be of particular interest to users or organizations with privacy concerns: "Data submitted through the API is no longer used for service improvements (including model training) unless the organization opts in."

More information is available in the OpenAI blog post.

Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • OpenAI provides APIs for ChatGPT and Whisper. ChatGPT costs $0.002 per 1000 tokens.
  • The model is called gpt-3.5-turbo and runs on Azure, a new version is already in development. Developers can also book dedicated instances.
  • By default, submitted data is no longer used for AI training.
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.