Worth Knowing
All topics

Topic

Safety

AI news about AI safety, alignment and misuse.

9 stories in the last 3 days

Today

4 stories
  1. Must read 404 Media

    American Voters Overwhelmingly Reject AI Data Centers

    Widespread voter opposition, municipal bans, and power restrictions directly threaten the physical infrastructure and energy access needed to scale AI compute in the United States.

    US voters in the 2026 midterm elections voted against AI data centers in at least 38 of more than 40 ballot measures across 13 states, passing outright bans in six cities and power limits in 12. Pro-data center politicians also lost offices nationwide, including Texas Governor Greg Abbott, who was defeated by Democratic challenger Gina Hinojosa after his support for AI data centers became a central campaign issue.

  2. Worth knowing Google Research

    Agile Deliberation: How AI helps humans define the gray areas

    This framework offers a practical method for aligning AI models with nuanced human intent in subjective domains like content moderation without requiring manual prompt engineering.

    Google Research has introduced Agile Deliberation, an open-source framework that uses vision-language models to help humans build AI image classifiers for subjective categories. The system guides users through scoping concepts and resolving edge cases via borderline images, feeding human feedback into an automated prompt optimization loop.

  3. Worth knowing Quanta Magazine

    New Research Tests Whether AI Models Know Their Own Thoughts

    Testing whether AI models can accurately report on their own internal states is important for model interpretability, safety, and understanding the boundaries of machine cognition.

    Quanta Magazine explores new research investigating whether artificial intelligence models have the capacity for introspection, or awareness of their own internal thought processes. The piece connects this AI research to broader philosophical and psychological debates regarding consciousness and whether introspection is an illusion.

  4. Worth knowing Platformer

    The frontier labs launch election war rooms

    How frontier AI labs monitor and mitigate political deepfakes during major elections is a central test of their safety and misuse prevention strategies.

    Leading AI laboratories have established election war rooms to monitor and respond to deepfakes during the midterm elections. The piece examines whether this traditional social media strategy is effective at countering AI-generated election misinformation.

Yesterday

2 stories
  1. Worth knowing TechCrunch

    Apple restricts dating apps and AI companions to users 18 and up

    Apple's new age restrictions could significantly limit the user base of popular AI companion apps like Character.AI and Replika, which frequently attract younger demographics.

    Apple is updating its App Store policies to require an 18+ age rating for all online dating apps and AI companions that feature romantic or sexual content. Starting November 16, developers must include new content descriptors for these relationship features as well as for apps that share users' real-world locations.

  2. Worth knowing MIT Technology Review

    How “reverse game theory” could keep AI agents in check

    Mechanism design offers a behavioral approach to AI alignment that does not rely on understanding the complex internal workings of frontier models.

    AI safety researchers and economists are exploring "reverse game theory," or mechanism design, to create incentives that make following rules the most rational choice for AI agents. Proposed strategies include rewarding models for predicting another model's output to prevent sandbagging, as well as assigning models alternating roles as problem "solvers" and "auditors" to catch cheating.

Mon, Nov 2

3 stories
  1. Must read Hacker News

    Anthropic reports $17B in Q3 revenue, commitments of $895B in revised S-1

    Anthropic's IPO filings provide an unprecedented public look at the massive revenue scale and nearly $900 billion compute commitments of a frontier AI lab.

    Anthropic filed an amended Form S-1 for its upcoming IPO, reporting $17 billion in third-quarter revenue and $33.24 billion in revenue for the first nine months of the year alongside a $104 billion net loss. The filing also revealed $895.4 billion in future purchase and lease commitments, nearly all of which are dedicated to compute and infrastructure.

  2. Worth knowing Ars Technica

    Claude’s new rules against game cloning won’t stop the AI copying boom

    System prompt restrictions highlight how AI labs attempt to limit copyright liability as coding assistants make cloning existing software increasingly trivial.

    Anthropic updated the system prompt for Claude Code and its Claude Opus 5.5 model to prohibit the recreation of specific existing video games. Although the rule instructs the AI to build only original games rather than clones, observers note it is unlikely to halt the broader trend of AI-assisted game copying and porting.

  3. Worth knowing Wired

    Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features

    This investigation exposes how organized commercial networks easily bypass the safety and moderation guardrails of major tech platforms like Apple, Google, and Meta to distribute non-consensual AI deepfake and CSAM tools at scale.

    A Wired investigation revealed a network of over 400 seemingly mundane mobile apps and domains, linked to Hong Kong-registered KeLing Technology Limited, that covertly load web interfaces for generating sexually explicit AI deepfakes. These apps bypassed Apple and Google app store reviews using bait-and-switch tactics and were heavily promoted through thousands of explicit ads on Meta's platforms.

Show everything