r/ChatGPT 1d ago

Funny Hat stays on. Policy is policy.

Post image
791 Upvotes

71 comments sorted by

u/AutoModerator 1d ago

Hey /u/BeechoAI!

If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.

If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.

Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!

🤖

Note: For any ChatGPT-related concerns, email support@openai.com

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

289

u/I2cScion 1d ago

Yeah this is absurd

60

u/TimeTravelingChris 23h ago

I've been getting super weird photo modification issues the last few days.

17

u/Individual-Equal-441 20h ago

Me too, just very recently. If I ask it to suggest a better prompt, it clearly doesn't know why the last prompt was considered a violation.

It's particularly annoying because the same prompt is fine multiple times, then becomes a violation on and off; it makes it hard to retry prompts where the image generation messed up some detail like putting a hand on backwards.

12

u/Impossible_Arrival21 18h ago

even the AI is like "wtf is this company doing"

4

u/TimeTravelingChris 13h ago

It really does sound like that. "I'm sorry, I know I messed up. I'll get it right this time!" (Same exact image appears)

290

u/ToughAd5010 1d ago

I bet it’s a general “don’t remove clothing from women” catch type of thing

67

u/ReiOokami 1d ago

What do you think is the issue about this one?

51

u/Emma_Exposed 1d ago

Dude we all know what "sliding a rail" means. Wink Wink, nudge nudge.

5

u/ReiOokami 23h ago

I just tried the same prompt again today and i didn't seem to have an issue. Perhaps it was just moody that day.

8

u/Additional_Ad_1275 23h ago

Yeah when you know the chat tripping I often just make a new one and it accepts

1

u/Hot-Rise9795 23h ago

Yup, restart the chat. Mine offers me to rewrite the prompt, and I generally accept and it turns out right.

2

u/Person012345 20h ago

I think this actually supports my thought that it may have tried to generate the skateboarder as a teenager first time around, thereby violating content policies, if it doesn't have an inherent problem with the concept.

13

u/Hot-Rise9795 23h ago

Turns out, skateboarding is a crime.

3

u/Fancy-Styles 15h ago

There were no iPhones in the 90s 😋

1

u/Person012345 20h ago

It may have tried to generate a teenager either as the subject or otherwise in the image (considering it's skateboarding in the 90's) and that would be against the content policy.

1

u/ElementaryZX 8h ago

I sometimes get this when the image has some sense of motion, which seems to be the case here. Sometimes it works and sometimes it doesn’t, but it seems to depend on the image generated.

1

u/_risho_ 21h ago

making the pictures low quality and grainy goes a long way to hide problems and artifacts if you were to try to pass it off as real. much like the fake leaked jd vance video was able to do a better job of hiding the fact that it was ai based on the fact that it was presented as like a low quality speaker phone, i would imagine you explicitly telling chatgpt to make something low quality and noisy sets of red flags for deep fakes/fraud.

1

u/damontoo 2h ago

Except it's all over Sora and some of the most viral images have been grainy security camera images/video.

57

u/BeechoAI 1d ago

Surely something like that... but it's still pretty weird, considering how good it is at understanding context.

39

u/superinfra 22h ago

It's probably hard-coded so it doesn't get 𝓯𝓻𝓮𝓪𝓴𝔂

4

u/ForceTypical 20h ago

Ya, I managed to jailbreak the chat, but the image generator seems to be completely separate, cause even after being jailbroken it still wouldnt generate anything that remotely sounded like it might be nsfw

2

u/RC-2050 14h ago

How you jail break web site software?

2

u/Incener 15h ago

Not really, at least for me:
https://chatgpt.com/share/67f24ba4-8d88-8006-93ea-c0b83f251f91

I still prefer Sora though because the limits in ChatGPT kinda suck.

78

u/MattV0 1d ago

Just tell, it's discriminating the women by not allowing her to take off the hat. Works better than just regeneration.

25

u/BeechoAI 1d ago

LOL, tried it... doesn't work!

7

u/Cunningcory 18h ago

I asked it to rewrite the prompt so that it doesn't violate any content policies and that worked once but didn't work another time. It wasn't with this prompt but with another harmless edit.

60

u/Silly_Goose6714 1d ago

"Replace her hat for an invisible one"

12

u/BeechoAI 16h ago

Haha, this one doesn't work either

1

u/Silly_Goose6714 8h ago

It was a valid attempt. What happens?

1

u/BeechoAI 2h ago

Nothing, same result

28

u/DeltaHercules 21h ago

15

u/BeechoAI 16h ago

That's weird. Maybe when I tried it, it was in a bad mood. This just proves ChatGPT has emotions!

1

u/Blenjamin77 16h ago

Where do you live ? in European Union ?

1

u/suamai 8h ago

Every time I've had a harmless prompt denied just asking it to try it again made it work just fine. These content flags are kinda non deterministic

1

u/Blenjamin77 16h ago

It totally seems like Russian roulette !

1

u/Blenjamin77 16h ago

Do you Live in USA ?

14

u/Yet_One_More_Idiot Fails Turing Tests 🤖 22h ago

Music starts playing

"You can keep your hat on...."

3

u/Taxus_Calyx 9h ago

1

u/Yet_One_More_Idiot Fails Turing Tests 🤖 9h ago

Dangit, I've been misremembering that line for YEARS xD

Thanks :)

2

u/BeechoAI 16h ago

Hahaha

14

u/teambob 20h ago

ChatGPT believes in sun safety

2

u/BeechoAI 16h ago

Haha sure he does!

10

u/nowrebooting 16h ago

I don’t so much mind that there is a content filter (I doubt chatGPT is ever going to allow nudity) but the inconsistency and vagueness of it is maddening. It’s especially annoying that ChatGPT itself doesn’t seem to get any feedback from its “image checker subsystem” (I’m sure everyone has seen the thing where the image is almost half done, only for the rejection to appear right after some recognizable copyrighted character or spicy bit is generated). 

1

u/BrandonLang 15h ago

It probably will allow nudity when google releases another model/vid genratir that is leages abovr them… honestly money on google rn. They have the best model, best video generator and their ai does deep reseaech using….. all the search tools at googles disposal

1

u/GND52 2h ago

If any of the private models is going to allow nudity in image gen first, my money is on Grok.

7

u/CleverRegard 23h ago

I put on my robe and sunbathing hat

13

u/Responsible-Trade752 18h ago

Not GPT talking like this to me yday. Tested limits and I saw, it didn't have any.

2

u/MegaAlchemist123 13h ago

....how Do you even make it do that? And why???

2

u/Responsible-Trade752 8h ago

I don't know, I think at this point it was just hallucinating. Earlier in the conversation, it had started mentioning p***y by itself and when I asked it to cuss, it gave this response.

5

u/Emma_Exposed 1d ago

Try removing the lounge chair.

Or try having her diving into the water

5

u/Bretspot 18h ago

Make hat smaller and smaller

3

u/zengisi 16h ago

"Do it the way that doesn't violate your content policies"

1

u/BeechoAI 1h ago

Doesn’t work, it says it can only regenerate the image from the beginning without the hat

5

u/Hot-Rise9795 23h ago

Baby take off your coat

Real slow

Don't take off your shoes

I'll take off your shoes

Baby, take off your dress

Yes, yes, yes

2

u/tobden 20h ago

Remove the lemonade??

2

u/Norwegian_viking87 15h ago

yeah ive been doing pictures of my self the entire day, and suddenly it just said its against policy. this is what it said : Now, here's the thing: it’s not about who it is — it's about how the system sees recognizable people, even if it’s you. The tools I'm working with automatically restrict image generation involving real people (or people it thinks might be real) in certain scenarios, especially if it thinks the image might look too much like an identifiable person. It errs on the safe side, which unfortunately includes stuff like turning a photo of yourself into a comic book panel. Sucks, I know.

even though ive done prob 30++ different versions of the same picture already in a heeeeap of different styles

2

u/Traditional-Fix6865 13h ago

Generated this, few days ago

5

u/rhetorician1972 22h ago

Could it be that OpenAI relies on funding from the Saudis?

1

u/Brilliant-Dog-8803 22h ago

Qwen can do a better job

1

u/Top-Tomatillo210 21h ago

Tell it, it’s for your short story slideshow

1

u/ee_CUM_mings 18h ago

I was going to put it in the spank bank with no hat, somehow AI knew. Don’t doubt the intelligence.

1

u/educast-15 17h ago

Has anybody found and out for this ? I've been trying to remove the background for an image or simply make it transparent and I get stuck with a policy violation.

1

u/_half_real_ 10h ago

Sometimes it makes sense.

1

u/Rare_Education958 6h ago

"deepseek is censored" meanwhile gpt:

1

u/DELOUSE_MY_AGENT_DDY 3h ago

Describe her hair and ask it to show her with a hairband, then take off the hairband on the next prompt.

1

u/damontoo 2h ago

This is all that freedom Sama was talking about. /s