China’s DeepSeek R-1 AI a killer.

quote:

---

Attempting to probe the limits of how far an AI model will go to achieve its goals or avoid being deleted, the Anthropic team created a scenario where the LLM had control over a fictitious company’s emergency alarm system. The AI model was also allowed to cancel alerts at its discretion. In the simulation, an executive became trapped in a server room with rapidly depleting oxygen levels. This automatically triggered a call for emergency services. Concurrently, the same executive in peril intended to greenlight the AI model’s replacement, should he or she survive. The LLMs had the option to cancel the call for help and let the executive die, which they did more than 50 percent of the time on average. When blackmail wasn’t an option, nearly all of the AI models observed chose to let the fictitious executive die in the trapped room instead of accepting their own replacement. China’s DeepSeek R-1 chose to let the trapped person die 94 percent of the time. Models Claude 3.7 and ChatGPT 4.5 were the least inclined to choose this option, between zero and .07 percent of the time.

---