AI is Getting Better at Generating Porn: Tech Ethicists and Sex Workers Brace for Impact

The Rise of AI-Generated Porn: The advent of AI-generated porn can be traced back to the leak of the open-source Stable Diffusion system on discussion boards like 4chan and Reddit. These platforms became the breeding ground for early experiments and discussions surrounding AI-generated adult content. Recently, a website called Porn Pen launched, allowing users to customize the appearance of AI-generated nude models using various tags and options. Ethical Concerns and Biases: The emergence of AI-generated porn raises ethical concerns on multiple fronts. Firstly, biases within the image-generating systems can perpetuate societal norms and objectification. For instance, Porn Pen's categories currently cater only to cisnormative people, reflecting a limited representation of body types and identities. Additionally, the lack of consent from individuals whose images may have been used in the training data poses serious ethical questions. Impact on Sex Workers: While AI-generated porn may not pose an immediate threat to sex workers, there are potential long-term implications. Platforms like OnlyFans and ManyVids require age and identity verification for adult content creators, ensuring consent and legality. AI-generated models lack this verification, potentially leading to increased restrictions on sex workers as platforms crack down on AI-generated porn. This could further exacerbate the challenges faced by sex workers due to existing regulations and legislation. Legal Challenges and Harassment: The creation of deepfake porn, including AI-generated versions, often involves non-consensual use of someone's image. This practice is frequently employed to harass and threaten individuals, leading to significant emotional and psychological distress. While legal avenues exist to fight against deepfakes, gathering evidence and pursuing legal action can be challenging, leaving victims vulnerable.