ChatGPT can be made to generate sexualised and violent images, researchers find

The latest public version of ChatGPT can be made to generate sexualised images or depict scenes of graphic violence with a simple prompt, researchers have told the BBC.

British AI security startup Mindgard figured out how to make ChatGPT create graphic pictures by slightly altering a widely-shared instruction, or prompt, which was originally designed to produce humorous results.

After being contacted by the BBC, ChatGPT's maker OpenAI said it had taken action to stop the chatbot responding with those types of images.

"After investigating this trend, we've introduced additional safeguards against this type of prompt," it said in a statement.

It also said it has multiple layers of protection to prevent users making content which breaches its terms and conditions.

However, the AI security researchers said that with further small changes, the problematic prompt still produced concerning content.

The BBC is not disclosing what the researchers typed into ChatGPT.

But we have seen how the chatbot, OpenAI's GPT-5.4 model, was prompted to create graphic material.