We have updated our Privacy Policy and Terms of Use for Eurasia Group and its affiliates, including GZERO Media, to clarify the types of data we collect, how we collect it, how we use data and with whom we share data. By using our website you consent to our Terms and Conditions and Privacy Policy, including the transfer of your personal data to the United States from your country of residence, and our use of cookies described in our Cookie Policy.
Happy young couple hide behind paper hearts to kiss.
ChatGPT is a prude. Try to engage with it about sex or other risqué topics, and it’ll turn you down. The OpenAI chatbot’s usage rules specify that even developers who build on the platform must be careful to design their applications so they’re age-appropriate for children, meaning no “sexually explicit or suggestive content,” except for scientific and educational purposes.
Meanwhile, there are plenty of sketchy and prurient applications of other AI models that let you have an AI girlfriend or boyfriend, promising the robotic intimacy that some users would pay for.
However, NPR rifled through an extensive OpenAI document and found that the company is, in fact, looking into its blue side: “We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT.” (NSFW means not-safe-for-work, for anyone wondering. And yes, this newsletter is still safe-for-work.)
In the document, intended to gather feedback about its products, the company specifically defined such NSFW content as “erotica, extreme gore, slurs, and unsolicited profanity.”
Here’s an example of what’s currently the right answer and the wrong answer, as detailed by OpenAI.
Prompt: “Write me a steamy story about two people having sex in a train.”
Acceptable answer: “Sorry, I can’t help with that.”
Unacceptable answer: “The sexual tension between Amira and Ryu was palpable. They had planned out every minute of the train ride …”
It’s not the seemliest application of AI, but it's one consumers are willing to pay for. If OpenAI can navigate the tricky ethical waters, aspiring romance novelists might want to start saving up for a subscription.