How Huawei's Ascend AI chips outperform Nvidia processors in running DeepSeek's R1 model
Advertisement
Jointly written by researchers from Huawei and Chinese AI infrastructure
start-up SiliconFlow, the paper described CloudMatrix 384 as a specialised 'AI supernode' that is purpose-built for handling extensive AI workloads.
Huawei expected CloudMatrix 'to reshape the foundation of AI infrastructure', according to the paper released this week. It consists of 384 Ascend 910C neural processing units (NPUs) and 192 Kunpeng server central processing units, which are interconnected through a unified bus providing ultra-high bandwidth and low latency.
The advanced large language model (LLM) serving solution, dubbed CloudMatrix-Infer, leverages that infrastructure, according to the paper. It surpassed the performance of some of the world's most prominent systems in running DeepSeek's 671-billion-parameter
R1 reasoning model.
The architecture reflects
US-sanctioned Huawei's efforts to overcome
Washington's tech control measures , as the company pushes the boundaries of AI system performance.
Advertisement
Data centres are facilities that house large-capacity servers and data-storage systems, with multiple power sources and high-bandwidth internet connections. More enterprises are using data centres to host or manage computing infrastructure for their AI projects.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
South China Morning Post
an hour ago
- South China Morning Post
Asian shippers fear spiralling costs as Iran threatens Strait of Hormuz closure
US air strikes on Iran sent oil prices soaring on Monday, leaving Asian shippers burdened with fresh costs on top of extra insurance premiums of US$1 million more per tanker, as Tehran threatened to close the Strait of Hormuz and paralyse the crucial sea lane. Up to 20 million barrels of oil pass each day through Hormuz, one-fifth of global supply, most of it destined for East Asia's biggest economies – China, South Korea and Japan. The neck of water is controlled by Iran, whose parliament on Sunday approved the closure of the shipping lane in response to the US joining Israel 's bombardment of the country. Any closure of Hormuz will have global ramifications for the Gulf oil-producing nations and the export markets of Asia. Oil spiked to close to US$80 on Monday morning from US$60 a barrel at the beginning of June. Any prolonged rise is likely to soon be felt by Asian consumers.
South China Morning Post
2 hours ago
- South China Morning Post
Hong Kong's New World downplays debt-deal rumours as analysts see path out of crunch
Hong Kong's New World Development said talks with creditors about refinancing its HK$124 billion (US$15.8 billion) debt were 'ongoing', downplaying 'market speculation and rumours' about an imminent deal while analysts said government support and bank leniency would help the company navigate the crunch. The city's most indebted developer said in a stock-exchange filing on Monday that it was aware of speculation about the refinancing of its existing loans, adding that it remained 'actively engaged' with its creditors. The statement followed a recent Bloomberg report that said the debt-laden firm was nearing a HK$87.5 billion deal to refinance its loans after months of negotiation, citing sources familiar with the matter. The deal would require consent from more than 50 lenders by June 30, and failure to meet this threshold could trigger covenant breaches, force the release of pledged collateral or lead to repayment demands, the report said. '[New World's statement] is more about managing investors' expectations given that the refinancing terms have not been finalised,' said Jeff Zhang, an analyst with Morningstar. The proposed refinancing deal was said to be backed by some 40 assets, including the company's New World Tower headquarters and its flagship Victoria Dockside complex in Tsim Sha Tsui. Bloomberg also reported that New World was in the market for a separate HK$15.6 billion loan secured against Victoria Dockside to support the larger refinancing exercise. New World's statement came after Hong Kong Financial Secretary Paul Chan Mo-po signalled a supportive stance from regulators and banks towards developers navigating financing stress.
The Standard
2 hours ago
- The Standard
China's Hellobike sets up new robotaxi firm with Ant Group, CATL
Bicycles of bike-sharing firm Hellobike are seen outside a subway station in Zhengzhou, Henan province, China March 13, 2018. Picture taken March 13, 2018. REUTERS
