Why blocking China's DeepSeek from using AI made in U.S. may be difficult
Top White House advisers this week expressed alarm that China's DeepSeek may have benefited from a method that allegedly piggybacks off the advances of U.S. rivals called "distillation."
The technique, which involves one AI system learning from another AI system, may be difficult to stop, according to executive and investor sources in Silicon Valley.
DeepSeek this month rocked the technology sector with a new AI model that appeared to rival the capabilities of U.S. giants like OpenAI, but at a much lower cost. And the China-based company gave away the code for free.
Some technologists believe that DeepSeek's model may have learned from U.S. models to make some of its gains. The distillation technique involves having an older, more established and powerful AI model evaluate the quality of the answers coming out of a newer model, effectively transferring the older model's learnings.
That means the newer model can reap the benefits of the massive investments of time and computing power that went into building the initial model without the associated costs.
This form of distillation, which is different from how most academic researchers previously used the word, is a common technique used in the AI field. However, it is a violation of the terms of service of some prominent models put out by U.S. tech companies in recent years, including OpenAI.
The ChatGPT maker said that it knows of groups in China actively working to replicate U.S. AI models via distillation and is reviewing whether or not DeepSeek may have distilled its models inappropriately, a spokesperson said. Naveen Rao, vice president of AI at San Francisco-based Databricks, which does not use the technique when terms of service prohibit it, said that learning from rivals is "par for the course" in the AI industry. Rao likened this to how automakers will buy and then examine one another's engines.
"To be completely fair, this happens in every scenario. Competition is a real thing, and when it's extractable information, you're going to extract it and try to get a win," Rao said. "We all try to be good citizens, but we're all competing at the same time."
The DeepSeek app icon on a mobile phone
|
REUTERS
Howard Lutnick, President Donald Trump's nominee for Secretary of Commerce who would oversee future export controls on AI technology, told the U.S. Senate during a confirmation hearing on Wednesday that it appeared DeepSeek had misappropriated U.S. AI technology and vowed to impose restrictions.
"I do not believe that DeepSeek was done all above board. That's nonsense," Lutnick said. "I'm going to be rigorous in our pursuit of restrictions and enforcing those restrictions to keep us in the lead."
David Sacks, the White House's AI and crypto czar, also raised concerns about DeepSeek distillation in a Fox News interview on Tuesday.
DeepSeek did not immediately answer a request for comment on the allegations.
OpenAI added it will work with the U.S. government to protect U.S. technology, though it did not detail how.
"As the leading builder of AI, we engage in countermeasures to protect our IP, including a careful process for which frontier capabilities to include in released models," the company said in a statement.
The most recent round of concern in Washington about China's use of U.S. products to advance its tech sector is similar to previous concerns about the semiconductor industry, where the U.S. has imposed restrictions on what chips and manufacturing tools can be shipped to China and is examining restricting work on certain open technologies.
Technologists said blocking distillation may be harder than it looks.
One of DeepSeek's innovations was showing that a relatively small number of data samples — fewer than 1 million — from a larger, more capable model could drastically improve the capabilities of a smaller model.
When popular products like ChatGPT have hundreds of millions of users, such small amounts of traffic could be hard to detect — and some models, such as Meta Platforms' Llama and French startup Mistral's offerings, can be downloaded freely and used in private data centers, meaning violations of their terms of service may be hard to spot.
"It's impossible to stop model distillation when you have open-source models like Mistral and Llama. They are available to everybody. They can also find OpenAI's model somewhere through customers," said Umesh Padval, managing director at Thomvest Ventures.
The license for Meta's Llama model requires those using it for distillation to disclose that practice, a Meta spokesperson said.
DeepSeek in a paper did disclose using Llama for some distilled versions of the models it released this month, but did not address whether it had ever used Meta's model earlier in the process. The Meta spokesperson declined to say whether the company believed DeepSeek had violated its terms of service.
One source familiar with the thinking at a major AI lab said the only way to stop firms like DeepSeek from distilling U.S. models would be stringent know-your-customer requirements similar to how financial companies identify with whom they do business.
But nothing like that is set in stone, the source said. The administration of former President Joe Biden had put forth such requirements, which President Donald Trump may not embrace.
The White House did not immediately respond to a request for comment.
Jonathan Ross, chief executive of Groq, an AI computing company that hosts AI models in its cloud, has taken the step of blocking all Chinese IP addresses from accessing its cloud to block Chinese firms from allegedly piggybacking off the AI models it hosts.
"That's not sufficient, because people can find ways to get around it," Ross said. "We have ideas that would allow us to prevent that, and it's going to be a cat and mouse game ... I don't know what the solution is. If anyone comes up with it, let us know, and we'll implement it."
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yomiuri Shimbun
22 minutes ago
- Yomiuri Shimbun
Europeans Seek ‘Digital Sovereignty' as US Tech Firms Embrace Trump
BERLIN, June 21 (Reuters) – At a market stall in Berlin run by charity Topio, volunteers help people who want to purge their phones of the influence of U.S. tech firms. Since Donald Trump's inauguration, the queue for their services has grown. Interest in European-based digital services has jumped in recent months, data from digital market intelligence company Similarweb shows. More people are looking for e-mail, messaging and even search providers outside the United States. The first months of Trump's second presidency have shaken some Europeans' confidence in their long-time ally, after he signaled his country would step back from its role in Europe's security and then launched a trade war. 'It's about the concentration of power in U.S. firms,' said Topio's founder Michael Wirths, as his colleague installed on a customer's phone a version of the Android operating system without hooks into the Google ecosystem. Wirths said the type of people coming to the stall had changed: 'Before, it was people who knew a lot about data privacy. Now it's people who are politically aware and feel exposed.' Tesla TSLA.O chief Elon Musk, who also owns social media company X, was a leading adviser to the U.S. president before the two fell out, while the bosses of Amazon AMZN.O, Meta META.O and Google-owner Alphabet GOOGL.O took prominent spots at Trump's inauguration in January. Days before Trump took office, outgoing president Joe Biden had warned of an oligarchic 'tech industrial complex' threatening democracy. Berlin-based search engine Ecosia says it has benefited from some customers' desire to avoid U.S. counterparts like Microsoft's MSFT.O Bing or Google, which dominates web searches and is also the world's biggest email provider. 'The worse it gets, the better it is for us,' founder Christian Kroll said of Ecosia, whose sales pitch is that it spends its profits on environmental projects. Similarweb data shows the number of queries directed to Ecosia from the European Union has risen 27% year-on-year and the company says it has 1% of the German search engine market. But its 122 million visits from the 27 EU countries in February were dwarfed by 10.3 billion visits to Google, whose parent Alphabet made revenues of about $100 billion from Europe, the Middle East and Africa in 2024 – nearly a third of its $350 billion global turnover. Non-profit Ecosia earned 3.2 million euros ($3.65 million) in April, of which 770,000 euros was spent on planting 1.1 million trees. Google declined to comment for this story. Reuters could not determine whether major U.S. tech companies have lost any market share to local rivals in Europe. DIGITAL SOVEREIGNTY The search for alternative providers accompanies a debate in Europe about 'digital sovereignty' – the idea that reliance on companies from an increasingly isolationist United States is a threat to Europe's economy and security. 'Ordinary people, the kind of people who would never have thought it was important they were using an American service are saying, 'hang on!',' said UK-based internet regulation expert Maria Farrell. 'My hairdresser was asking me what she should switch to.' Use in Europe of Swiss-based ProtonMail rose 11.7% year-on-year to March compared to a year ago, according to Similarweb, while use of Alphabet's Gmail, which has some 70% of the global email market, slipped 1.9%. ProtonMail, which offers both free and paid-for services, said it had seen an increase in users from Europe since Trump's re-election, though it declined to give a number. 'My household is definitely disengaging,' said British software engineer Ken Tindell, citing weak U.S. data privacy protections as one factor. Trump's vice president JD Vance shocked European leaders in February by accusing them – at a conference usually known for displays of transatlantic unity – of censoring free speech and failing to control immigration. In May, Secretary of State Marco Rubio threatened visa bans for people who 'censor' speech by Americans, including on social media, and suggested the policy could target foreign officials regulating U.S. tech companies. U.S. social media companies like Facebook and Instagram parent Meta have said the European Union's Digital Services Act amounts to censorship of their platforms. EU officials say the Act will make the online environment safer by compelling tech giants to tackle illegal content, including hate speech and child sexual abuse material. Greg Nojeim, director of the Security and Surveillance Project at the Center for Democracy & Technology, said Europeans' concerns about the U.S. government accessing their data, whether stored on devices or in the cloud, were justified. Not only does U.S. law permit the government to search devices of anyone entering the country, it can compel disclosure of data that Europeans outside the U.S. store or transmit through U.S. communications service providers, Nojeim said. MISSION IMPOSSIBLE? Germany's new government is itself making efforts to reduce exposure to U.S. tech, committing in its coalition agreement to make more use of open-source data formats and locally-based cloud infrastructure. Regional governments have gone further – in conservative-run Schleswig-Holstein, on the Danish border, all IT used by the public administration must run on open-source software. Berlin has also paid for Ukraine to access a satellite-internet network operated by France's instead of Musk's Starlink. But with modern life driven by technology, 'completely divorcing U.S. tech in a very fundamental way is, I would say, possibly not possible,' said Bill Budington of U.S. digital rights nonprofit the Electronic Frontier Foundation. Everything from push notifications to the content delivery networks powering many websites and how internet traffic is routed relies largely on U.S. companies and infrastructure, Budington noted. Both Ecosia and French-based search engine Qwant depend in part on search results provided by Google and Microsoft's Bing, while Ecosia runs on cloud platforms, some hosted by the very same tech giants it promises an escape from. Nevertheless, a group on messaging board Reddit called BuyFromEU has 211,000 members. 'Just canceled my Dropbox and will switch to Proton Drive,' read one post. Mastodon, a decentralized social media service developed by German programmer Eugen Rochko, enjoyed a rush of new users two years ago when Musk bought Twitter, later renamed X. But it remains a niche service. Signal, a messaging app run by a U.S. nonprofit foundation, has also seen a surge in installations from Europe. Similarweb's data showed a 7% month-on-month increase in Signal usage in March, while use of Meta's WhatsApp was static. Meta declined to comment for this story. Signal did not respond to an e-mailed request for comment. But this kind of conscious self-organizing is unlikely on its own to make a dent in Silicon Valley's European dominance, digital rights activist Robin Berjon told Reuters. 'The market is too captured,' he said. 'Regulation is needed as well.'
NHK
35 minutes ago
- NHK
US urges Asian allies to spend 5% of GDP on defense
The United States says its allies in Asia should spend 5 percent of their gross domestic product on defense, which is the level its European allies are discussing as a global standard. NATO nations are currently discussing raising their defense spending, following repeated criticism from US President Donald Trump. He has argued that it is unfair that his European allies depend on the US for defense. Chief spokesperson of the US Defense Department Sean Parnell explained to NHK on Friday the department's view on US allies in Asia. He said, "given the enormous military buildup of China as well as North Korea's ongoing nuclear and missile developments, it is only common sense for Asia-Pacific allies to move rapidly to step up to match Europe's pace and level of defense spending." He added, "It is common sense because it is in our Asia-Pacific allies' own security interests, and in that of the American people's to have more balanced and fairer alliance burden-sharing with our Asian allies."
Asahi Shimbun
5 hours ago
- Asahi Shimbun
Hoyu develops disappearing tattoos, opening doors to body art
A design from Hoyu Co.'s Lucena temporary tattoo series representing the lunar cycle (Provided by Hoyu Co.) 'Tattoo is not taboo,' insist two hair dye company employees, and they've developed the product to prove it—vanishing tattoos made with special inks that disappear in a week. While tattoos are widely accepted as an art form and fashion statement in many countries, in Japan the stigma against them remains fierce. However, the creators of Lucena tattoos are out to challenge these negative assumptions, and hope to contribute to Japanese culture by opening a doorway to body art. Hoyu Co., the Nagoya-based leading manufacturer and distributor of hair coloring products, started selling these made-to-fade tattoos on a trial basis last summer. The Lucena tattoos are characterized by a rich variety of colors and designs. Users can choose their favorite designs from about 70 tattoo sticker sheets. After the stickers are placed on the skin and the inks are applied over the top, the designs will stay visible for about a week. Users can mix inks to create their favorite colors, according to Hoyu. The tattoo series is the brainchild of Jun Fujii, 38, a member of the company's corporate planning division, who has spent extensive time abroad. Fujii initially came up with the idea while studying in the United States. He had noticed a special tattoo showing a blood type on an American friend's arm. His friend explained that this was a medical tattoo designed to prevent transfusions of the wrong blood type in a medical emergency. Fujii began to realize that tattoos might have the potential to be more than just fashion statements. This thought continued to grow after Fujii joined Hoyu and worked in Vietnam, Myanmar and other countries where he was exposed to different cultures that embrace tattoos. About six years ago, Fujii pitched the idea of temporary tattoos to his supervisors, but was shot down. Still, he didn't give up and pitched the idea again in 2023 when an in-house program was launched to create new businesses. Fujii has teamed with a former researcher, Shingo Yamaguchi, also 38, to continue developing the Lucena tattoos, and the company is now ready to commercialize the tattoo series. In Japan, tattoos are still viewed as incredibly taboo. Recently, a tattooed woman employed at a long-established restaurant became a target for defamatory and slanderous comments on social media. One post said, 'I will never go a restaurant where inked employees work.' The vanishing Lucena tattoos are aimed at lessening this stigma and ensuring that people can safely enjoy trying out body art. In recent years, 'fake tattoos' using stickers and body paint have become increasingly popular fashion statements. However, according to the Consumer Affairs Agency, no clear standards have been set for the quality and safety of temporary tattoos in Japan. Incidents of skin irritation and other issues have been reported, the agency cautioned in 2019. Hoyu, which has been developing hair dyes for many years, has conducted extensive research on skin allergens to ensure product safety. Fujii and Yamaguchi used the accumulated research in their development process, and the company manufactures and sells the temporary tattoos as 'cosmetics,' which have established safety standards and need to be reported to local governments. 'Because we are doing everything with just the two of us, there is a limit to the amount we can produce and the places we can visit to promote them,' Yamaguchi said. Still, he said he can see the growing demand for the product, as many young people visit their booths at events and concert venues, eager to experience tattoos that disappear. Fujii added, 'As people get more autonomy over their hair color (at work), there are more opportunities for self-expression. I hope the culture of coloring skin will also spread in Japan.' The brand's Instagram account posts photos showing how to apply Lucena tattoos, and products are being sold on its official website. A set that includes one tattoo sheet and two ink tubes is available for 3,980 yen ($28), including tax.
