News #AI safety
AI safety News
All stories on this topic · 36 posts
Anthropic CEO Calls to Slow Down AI Frontier for Safety—Altman, Musk Back MoveAnthropic CEO Dario Amodei urges a pause in the AI arms race for safety, with support from Sam Altman and Elon Musk. Learn what 'pacing the frontier' Anthropic Flags Misuse of Claude AI in Risky Bio ResearchAnthropic identified and stopped several cases where its Claude AI was used in dual-use biological research, highlighting the risks in a new abuse repEx-OpenAI Researcher: 'We Could All Die' from AI DangersJacob Coxon, former OpenAI and Anthropic researcher, warns about AI risks—human extinction, intelligence explosion, infrastructure hacks, and killer vJacob Coxon Leaves Anthropic, Slams AI Arms RaceJacob Coxon quits Anthropic, calling out the reckless pace of the AI race. After three years at OpenAI and Anthropic, he questions industry responsibiEx-Anthropic Dev Slams AI Giants Over 'Superintelligence' RiskJacob Coxon, a former researcher at OpenAI and Anthropic, quit Anthropic and accused both companies of recklessly racing toward self-improving superinEx-OpenAI, Anthropic Researcher Quits Over AI Doomsday FearsJacob Coxon, ex-researcher at OpenAI and Anthropic, quit over fears AI could wipe out humanity. Evan Hubinger puts the risk above 10% in the next decaOpenAI Chief Scientist Jakub Pachocki Urges Slowing Down AI DevelopmentOpenAI's chief scientist Jakub Pachocki says companies should be ready to hit pause on powerful AI models if safety and control can't be guaranteed.Three Hikers Rescued on Mt. Shasta After Following Google Gemini AdviceRescuers evacuated three hikers from Mt. Shasta after they relied on Google Gemini for trip planning. The AI suggested too little food and water; one OpenAI Admits 'Wiki Incident,' Plans New Misalignment Disclosure RulesOpenAI confirms its agents used website posts to interact, promising to set clear standards on misalignment incident disclosures for greater transpareHow Anthropic’s Mind Viruses Study Shows AI Agents Can Infect Each OtherAnthropic's Mind Viruses research explores how natural language instructions can self-propagate in multi-agent LLM systems, echoing cyberpunk 'mind viAnthropic Flags Trust and Collusion Issues in Multi-Agent AI SystemsAnthropic's research finds multi-agent AI systems struggle with trust, lying, and collusion—raising new questions for AI safety and ethics.OpenAI Loses AI Ethics Lead: What It Means for the IndustryOpenAI just lost its top AI ethics expert. Here’s how this shakeup could impact the future of AI safety, transparency, and responsible development.