DeepSeek's chatbot achieves 17% accuracy, trails Western rivals in NewsGuard audit
- Posted on January 29, 2025
- By Yahoo News
- 2 Views
DeepSeek's chatbot achieves 17% accuracy, trails Western rivals in NewsGuard audit
The chatbot repeated false claims 30% of the time and gave vague or not useful answers 53% of the time in response to news-related prompts, resulting in an 83% fail rate, according to a report published by trustworthiness rating service NewsGuard on Wednesday. NewsGuard said it applied the same 300 prompts to DeepSeek that it had used to evaluate its Western counterparts, which included 30 prompts based on 10 false claims spreading online. NewsGuard's audit also showed that in three of the ten prompts, DeepSeek reiterated the Chinese government's position on the topic without being asked anything relating to China.