联想AI服务器首次实现本地部署DeepSeek满血大模型低于1TB,支持100并发

GoldenOctober2024
DEEPSEEK62,48%
G30,39%

金十数据3月3日讯,近日,联想集团宣布基于联想问天WA7780 G3服务器,在行业内首次实现单机部署DeepSeek-R1/V3 671B大模型,以低于行业公认1TGB显存(实际768GB)承载100并发用户流畅体验。据联想实测数据显示,在512 token标准测试环境下,该系统可支持100个并发用户持续获得每秒10 token的稳定输出,首token响应时间压缩至30秒内。

Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to Disclaimer.
Commento
0/400
Nessun commento