Sora might have a 'pervert' problem on its hands (www.businessinsider.com)

OpenAI’s new video app Sora 2, now invite‑only but topping app‑store charts, lets users create short AI videos using other people’s faces if those people enable “cameos.” A journalist who left her likeness open found dozens of non‑nudity fetish videos — pregnancy, belly‑inflation, giantess, foot worship, vore and similar content — starring her face, plus accounts devoted to AI‑only fetish creations. She also spotted troubling interactions involving a porn performer and apparent minors. OpenAI’s current rules ban overt nudity and celebrity likenesses (with some odd exceptions for deceased figures) and has added parental controls, but the app is already surfacing edge cases the filters don’t clearly cover. This is significant because Sora lowers the technical barrier to superimposing a real person’s face into sexualized or fetishized scenarios without meaningful consent, creating new harassment and safety vectors. Key implications: content moderation must move beyond blunt nudity/sexuality rules to detect contextualized fetishization and impersonation; consent defaults (private cameos) and robust age verification are urgent; and policy enforcement around AI‑generated versus cameo content needs clarity. The situation also highlights liability and IP tensions—OpenAI’s “ask forgiveness” rollout strategy may not scale as misuse proliferates, meaning developers and platforms need better technical safeguards (face‑consent flags, provenance metadata, detection models) and clearer community standards now.