SuperCLUE, an organization that benchmarks large language models from China and international labs, recently released a report that evaluated third-party platforms that integrate DeepSeek’s R1 model.
First-party deployments, users access models from the original developers themselves (e.g., OpenAI’s ChatGPT). For third-party deployments, in contrast, users access models from an organization that is external from the original developer.
Based on this preliminary analysis, international third-party platforms that have R1 integrations (Perplexity, together.ai, and Poe) perform better than China third-party platforms that have R1 integrations (SiliconFlow’s pro edition and Luchen Tech Cloud), according to a translation of the report published by ChinAI.
“These findings underscore one of the points I’m starting to get tired of repeating: look at AI through a diffusion-centered lens, not an innovation-centered one. If you do, it’s not that provocative to posit that the US AI ecosystem could benefit more from DeepSeek’s R1 than the Chinese one,” wrote ChinAI’s Jeffrey Ding.