3 ms·
Please don't just read Eric Hartford's piece. Start with the key findings from the source material: "CAISI Evaluation of DeepSeek AI Models Finds Shortcomings a
by xpe 1y ago
Please don't just read Eric Hartford's piece. Start with the key findings from the source material: "CAISI Evaluation of DeepSeek AI Models Finds Shortcomings and Risks" [1]. Here are the single-sentence summaries:
DeepSeek performance lags behind the best U.S. reference models.
DeepSeek models cost more to use than comparable U.S. models.
DeepSeek models are far more susceptible to jailbreaking attacks than U.S. models.
DeepSeek models advance Chinese Communist Party (CCP) narratives.
Adoption of PRC models has greatly increased since DeepSeek R1 was released.
[1] https://www.nist.gov/news-events/news/2025/09/caisi-evaluation-deepseek-ai-models-finds-shortcomings-and-risks https://www.nist.gov/news-events/news/2025/09/caisi-evaluati...
- deleted 1y ago[deleted]
- evv 1y agoIt's funny how they mixed in proprietary models like GPT-5 and Anthropic with the "comparable U.S. models". Until they compare open-weight models, NIST is attempting a comparison between apples and airplanes.
- edflsafoiewq 1y agoThey compare with gpt-oss.