Latest news with #NVIDIADOCA
Time of India
8 hours ago
- Business
- Time of India
F5 expands performance, multi-tenancy, and security capabilities for fast-evolving AI landscape with NVIDIA
F5, the global leader in delivering and securing every app and API, today announced new capabilities for F5 BIG-IP Next for Kubernetes accelerated with NVIDIA BlueField-3 DPUs and the NVIDIA DOCA software framework, underscored by customer Sesterce's validation deployment. Sesterce is a leading European operator specializing in next-generation infrastructures and sovereign AI, designed to meet the needs of accelerated computing and artificial the F5 Application Delivery and Security Platform, BIG-IP Next for Kubernetes running natively on NVIDIA BlueField-3 DPUs delivers high-performance traffic management and security for large-scale AI infrastructure, unlocking greater efficiency, control, and performance for AI applications. In tandem with the compelling performance advantages announced along with general availability earlier this year, Sesterce has successfully completed validation of the F5 and NVIDIA solution across a number of key capabilities, including the following areas: - Enhanced performance, multi-tenancy, and security to meet cloud-grade expectations, initially showing a 20% improvement in GPU utilization. - Integration with NVIDIA Dynamo and KV Cache Manager to reduce latency for the reasoning of large language model ( LLM ) inference systems and optimization of GPUs and memory resources. - Smart LLM routing on BlueField DPUs, running effectively with NVIDIA NIM microservices for workloads requiring multiple models, providing customers the best of all available models. - Scaling and securing Model Context Protocol ( MCP ) including reverse proxy capabilities and protections for more scalable and secure LLMs, enabling customers to swiftly and safely utilize the power of MCP servers. - Powerful data programmability with robust F5 iRules capabilities, allowing rapid customization to support AI applications and evolving security requirements. 'Integration between F5 and NVIDIA was enticing even before we conducted any tests,' said Youssef El Manssouri, CEO and Co-Founder at Sesterce. 'Our results underline the benefits of F5's dynamic load balancing with high-volume Kubernetes ingress and egress in AI environments. This approach empowers us to more efficiently distribute traffic and optimize the use of our GPUs while allowing us to bring additional and unique value to our customers. We are pleased to see F5's support for a growing number of NVIDIA use cases, including enhanced multi-tenancy, and we look forward to additional innovation between the companies in supporting next-generation AI infrastructure.' Highlights of new solution capabilities include: LLM Routing and Dynamic Load Balancing with BIG-IP Next for Kubernetes With this collaborative solution, simple AI-related tasks can be routed to less expensive, lightweight LLMs in supporting generative AI while reserving advanced models for complex queries. This level of customizable intelligence also enables routing functions to leverage domain-specific LLMs, improving output quality and significantly enhancing customer experiences. F5's advanced traffic management ensures queries are sent to the most suitable LLM, lowering latency and improving time to first token. 'Enterprises are increasingly deploying multiple LLMs to power advanced AI experiences—but routing and classifying LLM traffic can be compute-heavy, degrading performance and user experience,' said Kunal Anand, Chief Innovation Officer at F5. 'By programming routing logic directly on NVIDIA BlueField-3 DPUs, F5 BIG-IP Next for Kubernetes is the most efficient approach for delivering and securing LLM traffic. This is just the beginning. Our platform unlocks new possibilities for AI infrastructure, and we're excited to deepen co-innovation with NVIDIA as enterprise AI continues to scale.' Optimizing GPUs for Distributed AI Inference at Scale with NVIDIA Dynamo and KV Cache Integration Earlier this year, NVIDIA Dynamo was introduced , providing a supplementary framework for deploying generative AI and reasoning models in large-scale distributed environments. NVIDIA Dynamo streamlines the complexity of running AI inference in distributed environments by orchestrating tasks like scheduling, routing, and memory management to ensure seamless operation under dynamic workloads. Offloading specific operations from CPUs to BlueField DPUs is one of the core benefits of the combined F5 and NVIDIA solution. With F5, the Dynamo KV Cache Manager feature can intelligently route requests based on capacity, using Key-Value (KV) caching to accelerate generative AI use cases by speeding up processes based on retaining information from previous operations (rather than requiring resource-intensive recomputation). From an infrastructure perspective, organizations storing and reusing KV cache data can do so at a fraction of the cost of using GPU memory for this purpose. 'BIG-IP Next for Kubernetes accelerated with NVIDIA BlueField-3 DPUs gives enterprises and service providers a single point of control for efficiently routing traffic to AI factories to optimize GPU efficiency and to accelerate AI traffic for data ingestion, model training, inference, RAG, and agentic AI,' said Ash Bhalgat, Senior Director of AI Networking and Security Solutions, Ecosystem and Marketing at NVIDIA. 'In addition, F5's support for multi-tenancy and enhanced programmability with iRules continue to provide a platform that is well-suited for continued integration and feature additions such as support for NVIDIA Dynamo Distributed KV Cache Manager.' Improved Protection for MCP Servers with F5 and NVIDIA Model Context Protocol (MCP) is an open protocol developed by Anthropic that standardizes how applications provide context to LLMs. Deploying the combined F5 and NVIDIA solution in front of MCP servers allows F5 technology to serve as a reverse proxy, bolstering security capabilities for MCP solutions and the LLMs they support. In addition, the full data programmability enabled by F5 iRules promotes rapid adaptation and resilience for fast-evolving AI protocol requirements, as well as additional protection against emerging cybersecurity risks. 'Organizations implementing agentic AI are increasingly relying on MCP deployments to improve the security and performance of LLMs,' said Greg Schoeny, SVP, Global Service Provider at World Wide Technology. 'By bringing advanced traffic management and security to extensive Kubernetes environments, F5 and NVIDIA are delivering integrated AI feature sets—along with programmability and automation capabilities—that we aren't seeing elsewhere in the industry right now.' F5 BIG-IP Next for Kubernetes deployed on NVIDIA BlueField-3 DPUs is generally available now. For additional technology details and deployment benefits, go to and further details can also be found in a companion blog from F5 .
Yahoo
11-06-2025
- Business
- Yahoo
Arrcus Powered by NVIDIA BlueField DPUs Enables Scalable and Efficient Networking for Enterprise AI
ArcOS leverages NVIDIA DOCA Software Framework to Offload and Accelerate Datacenter Network Functions to NVIDIA BlueField driving Increased Performance and Superior Energy Efficiencies PARIS, June 11, 2025--(BUSINESS WIRE)--Arrcus, the hyperscale networking software company and a leader in core-to-edge AI networking solutions, today announced the enablement of AI-scale networking on NVIDIA BlueField-3 DPUs to empower enterprise datacenters with superior scalability, security, and resource efficiency—all while reducing power consumption. By integrating its cutting-edge ArcOS® network operating system with NVIDIA BlueField-3, Arrcus is accelerating software-defined datacenter networking, freeing up critical compute resources, and enabling high-performance workloads. Modern datacenter architectures support multitenancy, allowing a single physical or virtual infrastructure to be securely shared among multiple tenants. This design enables efficient resource sharing, on-demand scalability, and reduced costs. Traditionally, virtualized network functions—such as EVPN/VXLAN, routing, IPsec, Access Control Lists (ACLs), and Network Address Translation (NAT)—are executed on the host CPU to facilitate connectivity. However, Arrcus' ArcOS enhances efficiency by offloading these critical networking functions to NVIDIA BlueField-3 DPU instead. This shift significantly improves scalability and accelerates performance while freeing up host CPU resources for mission-critical applications. The result is an optimized, high-performance, and cost-effective datacenter infrastructure. Arrcus ArcOS leverages the NVIDIA DOCA software framework, which provides a broad set of acceleration libraries that enable line-rate, software-defined packet processing and low-latency cloud network connectivity, leveraging purpose-built NVIDIA BlueField hardware accelerators. The combined power of Arrcus ArcOS, NVIDIA BlueField-3 and NVIDIA DOCA delivers: Seamless Connectivity – ArcOS accelerated with BlueField and DOCA provides secure overlay tunnels for robust and scalable multi-cloud networking, enabling enterprises to seamlessly extend workloads across environments. High-Performance Offloading – Functions like Routing, EVPN/VxLAN, IPSec, ACLs, and NAT are processed on BlueField-3 DPUs, enhancing throughput and efficiency while lowering CPU overhead. Optimized Compute Utilization – By reducing the networking burden on CPUs, enterprises can allocate more processing power to other demanding workloads. Advanced Traffic Engineering & Security – Built-in QoS, telemetry, and security functions ensure high performance, reliability, and protection against cyber risks. Simplified provisioning and automation – Simplified provisioning and agility using NVIDIA DOCA Platform Framework (DPF) to orchestrate, configure and monitor ArcOS on BlueField-3 in cloud-native environments. "With the exponential rise of AI-driven workloads, enterprises need datacenter networking solutions that deliver high performance, scalability, and energy efficiency without compromise," said Shekar Ayyar, Chairman and CEO at Arrcus. "By leveraging NVIDIA BlueField-3 with our industry-leading ArcOS, we are transforming software-defined networking and unlocking new levels of efficiency for modern datacenters." "As enterprises rapidly adopt AI, the demand for scalable, high performant data center infrastructure has never been greater," said Ash Bhalgat, Senior Director of AI Networking and Security Solutions, Ecosystem and Marketing at NVIDIA. "ArcOS accelerated with NVIDIA BlueField-3 and DOCA brings new levels of efficiency to enterprise AI factories while supporting zero trust security for agentic AI workloads." ArcOS on NVIDIA BlueField-3 is now available for trials and deployment. To see a demo, please visit us at GTC Paris, Booth S32. For more information on how Arrcus and NVIDIA BlueField-3 are transforming enterprise networking, visit About Arrcus Arrcus is a leading provider of networking software solutions that empower businesses to achieve unparalleled scalability, performance, and reliability in their infrastructure. Arrcus is disrupting the industry with disaggregated solutions that deliver innovative, agile, and cost-effective networking, allowing enterprises to break free from traditional, monolithic systems and embrace a more flexible, efficient, and scalable approach to modern networking. The Arrcus team consists of world-class technologists who have an unparalleled record in shipping industry-leading networking products, complemented by industry thought leaders, operating executives, strategic partners, and top-tier VCs. The company is headquartered in San Jose, Calif. For more information, go to or follow Arrcus on LinkedIn and Twitter/X. View source version on Contacts Media Contact Sean Griffinsean@
Business Wire
11-06-2025
- Business
- Business Wire
Arrcus Powered by NVIDIA BlueField DPUs Enables Scalable and Efficient Networking for Enterprise AI
PARIS--(BUSINESS WIRE)--Arrcus, the hyperscale networking software company and a leader in core-to-edge AI networking solutions, today announced the enablement of AI-scale networking on NVIDIA BlueField-3 DPUs to empower enterprise datacenters with superior scalability, security, and resource efficiency—all while reducing power consumption. By integrating its cutting-edge ArcOS® network operating system with NVIDIA BlueField-3, Arrcus is accelerating software-defined datacenter networking, freeing up critical compute resources, and enabling high-performance workloads. Modern datacenter architectures support multitenancy, allowing a single physical or virtual infrastructure to be securely shared among multiple tenants. This design enables efficient resource sharing, on-demand scalability, and reduced costs. Traditionally, virtualized network functions—such as EVPN/VXLAN, routing, IPsec, Access Control Lists (ACLs), and Network Address Translation (NAT)—are executed on the host CPU to facilitate connectivity. However, Arrcus' ArcOS enhances efficiency by offloading these critical networking functions to NVIDIA BlueField-3 DPU instead. This shift significantly improves scalability and accelerates performance while freeing up host CPU resources for mission-critical applications. The result is an optimized, high-performance, and cost-effective datacenter infrastructure. Arrcus ArcOS leverages the NVIDIA DOCA software framework, which provides a broad set of acceleration libraries that enable line-rate, software-defined packet processing and low-latency cloud network connectivity, leveraging purpose-built NVIDIA BlueField hardware accelerators. The combined power of Arrcus ArcOS, NVIDIA BlueField-3 and NVIDIA DOCA delivers: Seamless Connectivity – ArcOS accelerated with BlueField and DOCA provides secure overlay tunnels for robust and scalable multi-cloud networking, enabling enterprises to seamlessly extend workloads across environments. High-Performance Offloading – Functions like Routing, EVPN/VxLAN, IPSec, ACLs, and NAT are processed on BlueField-3 DPUs, enhancing throughput and efficiency while lowering CPU overhead. Optimized Compute Utilization – By reducing the networking burden on CPUs, enterprises can allocate more processing power to other demanding workloads. Advanced Traffic Engineering & Security – Built-in QoS, telemetry, and security functions ensure high performance, reliability, and protection against cyber risks. Simplified provisioning and automation – Simplified provisioning and agility using NVIDIA DOCA Platform Framework (DPF) to orchestrate, configure and monitor ArcOS on BlueField-3 in cloud-native environments. 'With the exponential rise of AI-driven workloads, enterprises need datacenter networking solutions that deliver high performance, scalability, and energy efficiency without compromise,' said Shekar Ayyar, Chairman and CEO at Arrcus. 'By leveraging NVIDIA BlueField-3 with our industry-leading ArcOS, we are transforming software-defined networking and unlocking new levels of efficiency for modern datacenters.' 'As enterprises rapidly adopt AI, the demand for scalable, high performant data center infrastructure has never been greater,' said Ash Bhalgat, Senior Director of AI Networking and Security Solutions, Ecosystem and Marketing at NVIDIA. 'ArcOS accelerated with NVIDIA BlueField-3 and DOCA brings new levels of efficiency to enterprise AI factories while supporting zero trust security for agentic AI workloads.' ArcOS on NVIDIA BlueField-3 is now available for trials and deployment. To see a demo, please visit us at GTC Paris, Booth S32. For more information on how Arrcus and NVIDIA BlueField-3 are transforming enterprise networking, visit About Arrcus Arrcus is a leading provider of networking software solutions that empower businesses to achieve unparalleled scalability, performance, and reliability in their infrastructure. Arrcus is disrupting the industry with disaggregated solutions that deliver innovative, agile, and cost-effective networking, allowing enterprises to break free from traditional, monolithic systems and embrace a more flexible, efficient, and scalable approach to modern networking. The Arrcus team consists of world-class technologists who have an unparalleled record in shipping industry-leading networking products, complemented by industry thought leaders, operating executives, strategic partners, and top-tier VCs. The company is headquartered in San Jose, Calif. For more information, go to or follow Arrcus on LinkedIn and Twitter/X.
