SMI CEO claims Nvidia wants SSDs with 100 million IOPS — up to 33X performance uplift could eliminate AI GPU bottlenecks
When you buy through links on our articles, Future and its syndication partners may earn a commission.
Now that the AI industry has exceptionally high-performance GPUs with high-bandwidth memory (HBM), one of the bottlenecks that AI training and inference systems face is storage performance. To that end, Nvidia is working with partners to build SSDs that can hit random read performance of 100 million input/output operations per second (IOPS) in small-block workloads, according to Wallace C. Kuo, who spoke with Tom's Hardware in an exclusive interview.
"Right now, they are aiming for 100 million IOPS — which is huge," Kuo told Tom's Hardware.
Modern AI accelerators, such as Nvidia's B200, feature HBM3E memory bandwidth of around 8 TB/s, which significantly exceeds the capabilities of modern storage subsystems in both overall throughput and latency. Modern PCIe 5.0 x4 SSDs top at around 14.5 GB/s and deliver 2 – 3 million IOPS for both 4K and 512B random reads. Although 4K blocks are better suited for bandwidth, AI models typically perform small, random fetches, which makes 512B blocks a better fit for their latency-sensitive patterns. However, increasing the number of I/O operations per second by 33 times is hard, given the limitations of both SSD controllers and NAND memory.
In fact, Kioxia is already working on an 'AI SSD' based on its XL-Flash memory designed to surpass 10 million 512K IOPS. The company currently plans to release this drive during the second half of next year, possibly to coincide with the rollout of Nvidia's Vera Rubin platform. To get to 100 million IOPS, one might use multiple 'AI SSDs.'
However, the head of SMI believes that achieving 100 million IOPS on a single drive featuring conventional NAND with decent cost and power consumption will be extremely hard, so a new type of memory might be needed.
"I believe they are looking for a media change," said Kuo. "Optane was supposed to be the ideal solution, but it is gone now. Kioxia is trying to bring XL-NAND and improve its performance. SanDisk is trying to introduce High Bandwidth Flash (HBF), but honestly, I don't really believe in it. Right now, everyone is promoting their own technology, but the industry really needs something fundamentally new. Otherwise, it will be very hard to achieve 100 million IOPS and still be cost-effective."
Currently, many companies, including Micron and SanDisk, are developing new types of non-volatile memory. However, when these new types of memory will be commercially viable is something that even the head of Silicon Motion is not sure about.
Follow Tom's Hardware on Google News to get our up-to-date news, analysis, and reviews in your feeds. Make sure to click the Follow button.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
32 minutes ago
- Yahoo
3 dividend shares I think investors MUST consider right now (including a 9.1% yield!)
Dividends are never, ever guaranteed. But investors can vastly improve their chances of receiving a large and growing passive income by buying dividend shares that: Operate in defensive industries, and therefore enjoy long-term earnings stability. Have strong balance sheets with low debt and/or impressive cash flows. Enjoy robust economic moats (like barriers to entry, patented products and brand power). Maintain strong diversification, which protects profits from localised issues. With this in mind, here are three great dividend stocks I think savvy share pickers should look at today. With holdings in 211 companies, the iShares US Equity High Income ETF (LSE:INCU) could be an effective way for investors to reduce risk and source a long-term income. Its exposure is spread far and wide, from tech businesses like Nvidia and Apple to classic safe-havens like consumer goods giant Pepsico, pharmaceuticals developer Merck and telecoms provider AT&T. This isn't all, as it also generates earnings from government bonds and cash, providing additional stability. Right now, iShares US Equity High Income's forward dividend yield is a mighty 9%. Its ongoing charge meanwhile is 0.35%, which I consider reasonable. I think it's a great diversified fund to consider, even though its focus on Stateside stocks could leave it vulnerable if investors continue rotating away from US shares. Like a shares-based ETF, investment trusts can also provide high returns while helping share pickers to reduce risk. As its name implies, the Chelverton UK Dividend Trust (LSE:SDV) is designed to supply a steady stream of passive income. More specifically, this pooled investment vehicle 'aims to deliver a high and growing income through investments in mid to small-cap companies exclusively outside the largest 100 UK stocks.' Such smaller companies can be more susceptible to weakness during economic downturns. But again, a wide variety of holdings (it owns shares in 62 companies today) helps to reduce (if not completely eliminate) this threat. Some of Chelverton's largest holdings are insurer Chesnara, food manufacturer Bakkavor and Arbuthnot Banking. The forward dividend yield here is an impressive 9.1%. In my opinion, Aviva (LSE:AV.) is one of the best FTSE 100 shares to consider for a long-term passive income. And it's not just because its 6.3% forward yield is one of the largest on the UK blue-chip index. The company has significant brand power, which helps protect earnings even during downturns. Its status as the largest life insurer in the UK (market share of 24%) and market-leading positions in other diversified product lines underlines this. It also has a significant position in the defensive general insurance markets to protect revenues when consumers feel the pinch. On top of this, Aviva has a cash-rich balance sheet it can use to pay large dividends while still investing for growth. Its Solvency II capital ratio was 203% as of December. Intense competition remains an ongoing threat. But Aviva's long-term resilience helps soothe any fears I have. The post 3 dividend shares I think investors MUST consider right now (including a 9.1% yield!) appeared first on The Motley Fool UK. More reading 5 Stocks For Trying To Build Wealth After 50 One Top Growth Stock from the Motley Fool Royston Wild has positions in Aviva Plc. The Motley Fool UK has recommended Apple, Chesnara Plc, and Nvidia. Views expressed on the companies mentioned in this article are those of the writer and therefore may differ from the official recommendations we make in our subscription services such as Share Advisor, Hidden Winners and Pro. Here at The Motley Fool we believe that considering a diverse range of insights makes us better investors. Motley Fool UK 2025 Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
CBS News
an hour ago
- CBS News
Grass fire shuts off power at Sacramento's Riverbank Marina, impacting businesses
On a red flag warning day, a brush fire caused several businesses to shut down at the Riverbank Marina in Sacramento after losing power. Hungry customers were greeted by signs that read "Closed due to outage." "I got a front row [parking] spot and I was like, how did that happen? And now I know why, right," said sacramento resident Lori Organ. A grass fire broke out across the street from the marina Saturday morning. Sacramento Fire said they were able to contain it at one acre, but some power lines were damaged, causing outages at nearby restaurants and businesses. We were really excited about this weekend. Obviously, 80-degree weather. We only have about 12 or 14 Saturday's for the summer, so it's a huge impact," said Trevor Shults, owner of Crawdads on the River. Crawdads on the River, one of the several restaurants closed due to no power, had to cancel their saturday live music event. The owner of the restaurant is also thinking about his employees during peak season. Everyone was hoping to make money. We are a seasonal business, we're open year-round, but these summer months are where we make our bread and butter," said Shults. Sac Fire said the fire initially broke out near a power pole. It's unclear at this time what the cause of the fire was, but SMUD was on scene making repairs to the power lines for hours. "Fires start by accident all the time, it's just that time of year to be extra careful," said Archambeault. One company being extra careful is PG&E. They've had power shutoffs in place since Thursday. More than 11,000 customers across 16 counties have been impacted across Northern California. The reason for the shutoffs is so the wind doesn't knock trees into power lines or take power lines down altogether, potentially sparking a fire. PG&E said they understand it's hot out and people want their a/c but the shutoffs are for safety. "We know that for some customers it's an inconvenience. We know for others it's actually more than that because they rely on life-saving medical devices and other things that require electricity. So we certainly don't take decisions like this lightly, but the idea is to prevent catastrophic wildfires that can cause even more significant damage," said PG&E spokesperson Jeff Smith. "Sometimes we have to shut off power and hopefully it's not for a long time. And again the wind has died down," said Archambeault. Crawdads on the River said they will be open for business as usual on Sunday. PG&E said as high-risk fire conditions begin to dwindle into Sunday evening, they are hoping to get everyone's power fully restored.
Motor 1
an hour ago
- Motor 1
Dealership Worker Is Oh-So-Close To Closing Car Sale. Then a Receptionist Ruins It In 1 Minute
After a potential deal was purportedly ruined by a coworker, a car salesman shared what he describes as 'the number one golden rule' for all dealership employees: 'Zip it and go on about your business' when it comes to other salespeople's customers. Salesman Costa (@costacreatescardeals) is clearly peeved in his TikTok. He starts the video by saying, 'When someone is working a deal with a customer, do not ever, and I mean ever, go talk to that customer.' Get the best news, reviews, columns, and more delivered straight to your inbox, daily. back Sign up For more information, read our Privacy Policy and Terms of Use . Costa says that a receptionist essentially snatched a sale from the dealership at the last minute. 'We had a receptionist today go up to a customer—after they signed at the desk, ready to go into finance—telling the customer that she was able to lower her payment when trading out of her vehicle with $12,000 of negative equity,' he alleges. Anyone who's rolled a car loan with negative equity into another car loan knows that the outcome of that is usually, but not always, a higher monthly payment. This was apparently the case with Costa's customer. 'Her payment went up,' he says. 'Not down. And then the customer decided not to do the deal and left while waiting for finance.' He notes that the new payment after trading in a car with negative equity will be determined by multiple factors. 'Every case is different,' he says. 'And it also depends on credit. It depends on many factors.' His bottom line is that if it isn't your sale, you need to butt out. 'Don't ever go and talk to another customer while another salesperson is working a deal with that customer,' Costa says. His advice has people coming for him specifically and car salespersons generally. America's Most Loathed Profession? It's no secret that car salespeople—perhaps especially used car salesmen —are widely reviled. A list of the most hated professions describes used car salesmen as ' fast-talking liars who do it all with smiles on their faces.' While this is just a stereotype and, as with any profession, there are good and bad actors throughout, Costa's TikTok put the taste of scummy car salesmen in many viewers' mouths. Trending Now 'I'm Not [an] Expert:' Man Gets in a Honda Civic. Then It Starts Making This Mystery Noise When He Puts It in Reverse Man Fills Up His Truck. Then He Pulls Out a Trick for When the Handle Clicks and Stops Pumping "Seems like the receptionist was honest with the customer," wrote one user. "Who in their right mind is going to roll $12k negative equity into another loan at probably 10-12%. She did them a favor." "Man, car sales people really do get on here and tell the world how shady they are," wrote a second user. "Wow, an ethical employee working at a dealership! Good for her! She is probably too good to work there," a third user said. Why Would a Newer Model Have Negative Equity? In response to the commenter who claimed that the receptionist was simply being honest with his customer, Costa explained why his colleague may have led the potential buyer astray. It's actually inflation. As he explains in a follow-up TikTok , the increased cost of living due to inflation is making it harder for people to make ends meet on one income. This, he alleges in a text overlay on the post, is 'indirectly' wrecking the car market. Many people, he explains, are using their vehicles for a second source of income, often in the gig economy. While gigging for a rideshare or delivery service can be a flexible way to make ends meet, it also typically puts a lot of miles on your car. This often translates into negative equity. 'They're stacking over 200,000 miles on a car that they bought in 2020,' he explains. 'And now we're in 2025, the depreciation is through the roof.' This is why he cautions, 'you should never use a personal vehicle as a commercial vehicle.' He says that the customer the receptionist talked out of the sale was trading in their vehicle for just this reason. Their vehicle, Costa claims, had become utterly unreliable due to high mileage and the wear and tear this causes. 'It was costing them way too much money,' he says. Costa frames the role of people in his line of work as helping people like his lost customer get a reliable vehicle, 'rather than screwing them.' 'What we're doing is actually losing money on some deals just to trade a customer out of the vehicle so we maintain a long-term relationship with them,' he says. If the business maintains that relationship, he says dealerships realize that the customer is likely to keep coming back for maintenance and repairs. So ultimately, taking a loss on a sale can translate into a profit in the long term. 'It's actually a very smart decision to sell them a car,' he says. "And if you can make money, hey, that's what we're in it for. But sometimes you'll actually lose money and sell them a car." Motor1 reached out to Costa via TikTok comment and direct message for comment. We'll be sure to update this if he responds. More From Motor1 Toyota Salesman Finds Thousands of Dollars of 'Missing' Keys. Now He's Exposing Dealerships for Failing to Give Buyers the Spare 'We Get It Fixed': Woman Says Her 2020 Ram's Steering Wheel 'Randomly' Locks Up. The Dealership Says It's Fine 'Lawyer Up': Woman Drops Off Mercedes At Dealership For Oil Change. Then She's Told It's Totaled, Costs $27K To 'Fix 5 Wires' Woman Visits Toyota Dealership. Then a Salesman Refuses to Give Her a Pricing Breakdown When She's Quoted $27,500 Share this Story Facebook X LinkedIn Flipboard Reddit WhatsApp E-Mail Got a tip for us? Email: tips@ Join the conversation ( )
