Anthropic’s CEO Dario Amodei is anxious about competitor DeepSeek, the Chinese language AI firm that took Silicon Valley by storm with its R1 model. And his issues could possibly be extra severe than the everyday ones raised about DeepSeek sending person information again to China.
In an interview on Jordan Schneider’s ChinaTalk podcast, Amodei stated DeepSeek generated uncommon details about bioweapons in a security check run by Anthropic.
DeepSeek’s efficiency was “the worst of mainly any mannequin we’d ever examined,” Amodei claimed. “It had completely no blocks in any respect in opposition to producing this info.”
Amodei acknowledged that this was a part of evaluations Anthropic routinely runs on numerous AI fashions to evaluate their potential nationwide safety dangers. His group appears at whether or not fashions can generate bioweapons-related info that isn’t simply discovered on Google or in textbooks. Anthropic positions itself because the AI foundational mannequin supplier that takes safety seriously.
Amodei stated he didn’t assume DeepSeek’s fashions at this time are “actually harmful” in offering uncommon and harmful info however that they may be within the close to future. Though he praised DeepSeek’s group as “proficient engineers,” he suggested the corporate to “take critically these AI security issues.”
Amodei has additionally supported strong export controls on chips to China, citing issues that they might give China’s army an edge.
Amodei didn’t make clear within the ChinaTalk interview which DeepSeek mannequin Anthropic examined, nor did he give extra technical particulars about these assessments. Anthropic didn’t instantly reply to a request for remark from TechCrunch. Neither did DeepSeek.
DeepSeek’s rise has sparked issues about its security elsewhere, too. For instance, Cisco safety researchers said last week that DeepSeek R1 failed to dam any dangerous prompts in its security assessments, attaining a 100% jailbreak success fee.
Cisco didn’t point out bioweapons however stated it was capable of get DeepSeek to generate dangerous details about cybercrime and different unlawful actions. It’s price mentioning, although, that Meta’s Llama-3.1-405B and OpenAI’s GPT-4o additionally had excessive failure charges of 96% and 86%, respectively.
It stays to be seen whether or not security issues like these will make a severe dent in DeepSeek’s rapid adoption. Corporations like AWS and Microsoft have publicly touted integrating R1 into their cloud platforms — paradoxically sufficient, on condition that Amazon is Anthropic’s biggest investor.
However, there’s a growing list of nations, companies, and particularly authorities organizations just like the U.S. Navy and the Pentagon which have began banning DeepSeek.
Time will inform if these efforts catch on or if DeepSeek’s international rise will proceed. Both means, Amodei says he does contemplate DeepSeek a brand new competitor that’s on the extent of the U.S.’s high AI corporations.
“The brand new reality right here is that there’s a brand new competitor,” he stated on ChinaTalk. “Within the large corporations that may prepare AI — Anthropic, OpenAI, Google, maybe Meta and xAI — now DeepSeek is possibly being added to that class.”