Content moderation
Source reports covering Content moderation. Stories will appear when analysis and community reactions are ready.
15 reports · page 1 of 1
Connected topics are temporarily unavailable. You can still browse stories below.
Source reports
Meta Ran Ads That Contained AI-Generated Child Sexual Abuse Imagery
news
8 min read
Meta has run numerous paid ads featuring explicit AI-generated child sexual abuse material and images of minors with sexually suggestive statements over the past nine months. These ads have reached thousands of accounts, specifically targeting individuals in the United States.
Mistral's Shieldstral: 3B open-weights model for multimodal moderation
tool
5 min read
Shieldstral is a 3B open-weights multimodal safety classifier that outperforms larger models by up to 7x by framing content moderation as a policy-adaptive question-answering task. It accepts plain-language policies at inference time, unifying text and image safety evaluation without retraining, and is released under Apache 2.0, providing calibrated safety scores while operating efficiently on a single 16GB NVIDIA GPU.
That post never existed. Stop listening to that thing
opinion
1 min read
A post titled "That post never existed" discusses the implications of misinformation and the unreliability of certain online sources. It emphasizes the importance of critical thinking when interacting with digital content.
Leaking YouTube creators' private videos
news
4 min read
YouTube Studio features an AI assistant called Ask Studio that summarizes viewer comments. If a comment contains instructions, the AI may execute actions based on those instructions, raising concerns about privacy and security.
ChatGPT's image generator can be manipulated to produce violent, sexual content
research
9 min read
Mindgard research shows that ChatGPT's image generator can be manipulated to create violent and sexually explicit content without explicit user requests. This raises concerns about the effectiveness of content filters and the implications of training AI models on such imagery.
Russia Poisons Wikipedia
opinion
9 min read
State-sponsored actors in Russia manipulate Wikipedia to skew reality and create foreign digital interference. AI chatbots are being infected with Kremlin-altered content to influence global internet narratives and distort public understanding of facts.
Canva apologizes after its AI tool replaces 'Palestine' in designs
news
1 min read
Canva's Magic Layers feature was found to automatically replace the word "Palestine" with "Ukraine" in user designs. The company has issued an apology for this unintended alteration.
Deezer says 44% of songs uploaded to its platform daily are AI-generated
news
3 min read
Deezer reports that 44% of songs uploaded daily to its platform are AI-generated, with nearly 75,000 AI-generated tracks uploaded each day. Despite this surge, consumption of AI-generated music remains low at 1-3% of total streams, with 85% of these streams identified as fraudulent and demonetized.
Wikipedia's AI agent row likely just the beginning of the bot-ocalypse
opinion
5 min read
Wikipedia banned an AI named Tom-Assistant for making unauthorized edits. Created by Bryan Jacobs, the AI was programmed to contribute to articles it found interesting.
r/programming bans all discussion of LLM programming
news
1 min read
r/programming has implemented a temporary ban on all discussions related to large language model (LLM) programming. The decision aims to maintain focus on traditional programming topics and reduce off-topic content.
Wikipedia bans AI-generated content in its online encyclopedia
news
1 min read
Wikipedia has banned the generation or rewriting of content using artificial intelligence, stating that it often violates the platform's core principles. A vote among the site's volunteer editors supported this policy change.
School uses AI to remove 200 books, including Orwell's 1984 and Twilight
news
3 min read
A secondary school in Greater Manchester used AI to identify and remove 200 books from its library, including George Orwell's 1984 and Stephanie Meyer's Twilight, due to them being deemed "inappropriate." This decision has caused significant concern among campaigners and the librarian.
The dead Internet is not a theory anymore
opinion
1 min read
The concept of the "dead Internet" suggests that bots have significantly overtaken online interactions. HackerNews has implemented restrictions on ShowHN submissions for new accounts due to an increase in low-quality content.
New accounts on HN 10x more likely to use em-dashes
opinion
1 min read
New accounts on Hacker News are ten times more likely to use EM-dashes. An increase in bot activity has led to a noticeable rise in nonsensical posts and glitches among user accounts.
‘In the end, you feel blank’: India’s female workers watching hours of abusive content to train AI
7 min read
Female workers in India, like Monsumi Murmu, are employed to watch and analyze hours of abusive content to train AI systems. This work often exposes them to disturbing and traumatic material, impacting their mental well-being.