Update May 13, 2024:
OpenAI CEO Sam Altman confirms on Reddit that OpenAI wants to unlock "NSFW stuff" like text erotica and gore for personal use "in most cases." AI apps like deepfakes will still be blocked.
Original article dated May 9, 2024:
OpenAI is considering generating NSFW content in the future.
The company wants to give developers and users the flexibility to use the services as they see fit, as long as they follow the usage guidelines. OpenAI is currently investigating whether it is possible to responsibly generate NSFW content in age-appropriate contexts via the API and ChatGPT.
This includes potentially erotic content, extreme violence, profanity, and unwanted obscenity. The company wants to better understand user and societal expectations for model behavior in this area.
To date, the chatbot has not generated any content that would be inappropriate in a professional environment - meaning mainly erotic content. In the past, OpenAI has banned services that used the OpenAI API for NSFW content.