Spectrum Ethernet – NVIDIA Technical Blog News and tutorials for developers, data scientists, and IT admins 2025-07-03T22:20:47Z http://www.open-lab.net/blog/feed/ Erez Tweg <![CDATA[NVIDIA ConnectX-8 SuperNICs Advance AI Platform Architecture with PCIe Gen6 Connectivity]]> http://www.open-lab.net/blog/?p=99991 2025-05-29T17:31:03Z 2025-05-19T04:07:33Z As AI workloads grow in complexity and scale��from large language models (LLMs) to agentic AI reasoning and physical AI��the demand for faster, more scalable...]]> As AI workloads grow in complexity and scale��from large language models (LLMs) to agentic AI reasoning and physical AI��the demand for faster, more scalable...

As AI workloads grow in complexity and scale��from large language models (LLMs) to agentic AI reasoning and physical AI��the demand for faster, more scalable compute infrastructure has never been greater. Meeting these demands requires rethinking system architecture from the ground up. NVIDIA is advancing platform architecture with NVIDIA ConnectX-8 SuperNICs, the industry��s first SuperNIC to��

Source

]]>
0
Berkin Kartal <![CDATA[AI Fabric Resiliency and Why Network Convergence Matters]]> http://www.open-lab.net/blog/?p=98574 2025-05-29T19:05:04Z 2025-05-14T16:20:00Z High-performance computing and deep learning workloads are extremely sensitive to latency. Packet loss forces retransmission or stalls in the communication...]]> High-performance computing and deep learning workloads are extremely sensitive to latency. Packet loss forces retransmission or stalls in the communication...Typical data center interconnection schema for Clos fabric.

High-performance computing and deep learning workloads are extremely sensitive to latency. Packet loss forces retransmission or stalls in the communication pipeline, which directly increases latency and disrupts the synchronization between GPUs. This can degrade the performance of collective operations such as all-reduce or broadcast, where every GPU��s participation is required before progressing.

Source

]]>
0
Brad Smith <![CDATA[A New Era in Data Center Networking with NVIDIA Silicon Photonics-based Network Switching]]> http://www.open-lab.net/blog/?p=97917 2025-04-03T18:45:19Z 2025-03-27T16:00:00Z NVIDIA is breaking new ground by integrating silicon photonics directly with its NVIDIA Quantum and NVIDIA Spectrum switch ICs. At GTC 2025, we announced the...]]> NVIDIA is breaking new ground by integrating silicon photonics directly with its NVIDIA Quantum and NVIDIA Spectrum switch ICs. At GTC 2025, we announced the...

NVIDIA is breaking new ground by integrating silicon photonics directly with its NVIDIA Quantum and NVIDIA Spectrum switch ICs. At GTC 2025, we announced the world��s most advanced Silicon Photonics Switch systems, powered by cutting-edge 200G SerDes technology. This innovation, known as co-packaged silicon photonics, delivers significant benefits such as 3.5x lower power consumption��

Source

]]>
0
Pradyumna Desale <![CDATA[Automating AI Factories with NVIDIA Mission Control]]> http://www.open-lab.net/blog/?p=98012 2025-04-03T18:47:00Z 2025-03-25T18:45:11Z Advanced AI models such as DeepSeek-R1 are proving that enterprises can now build cutting-edge AI models specialized with their own data and expertise. These...]]> Advanced AI models such as DeepSeek-R1 are proving that enterprises can now build cutting-edge AI models specialized with their own data and expertise. These...

Advanced AI models such as DeepSeek-R1 are proving that enterprises can now build cutting-edge AI models specialized with their own data and expertise. These models can be tailored to unique use cases, tackling diverse challenges like never before. Based on the success of early AI adopters, many organizations are shifting their focus to full-scale production AI factories. Yet the process of��

Source

]]>
0
Tim Lustig <![CDATA[Featured Networking Sessions at NVIDIA GTC 2025]]> http://www.open-lab.net/blog/?p=96189 2025-02-20T15:52:20Z 2025-02-17T05:34:30Z Explore the latest advancements in AI infrastructure, acceleration, and security from March 17-21.]]> Explore the latest advancements in AI infrastructure, acceleration, and security from March 17-21.

Explore the latest advancements in AI infrastructure, acceleration, and security from March 17-21.

Source

]]>
0
Leigh Engel <![CDATA[Simplify System Memory Management with the Latest NVIDIA GH200 NVL2 Enterprise RA]]> http://www.open-lab.net/blog/?p=96079 2025-04-23T02:45:13Z 2025-02-13T21:26:30Z NVIDIA Enterprise Reference Architectures (Enterprise RAs) can reduce the time and cost of deploying AI infrastructure solutions. They provide a streamlined...]]> NVIDIA Enterprise Reference Architectures (Enterprise RAs) can reduce the time and cost of deploying AI infrastructure solutions. They provide a streamlined...

NVIDIA Enterprise Reference Architectures (Enterprise RAs) can reduce the time and cost of deploying AI infrastructure solutions. They provide a streamlined approach for building flexible and cost-effective accelerated infrastructure while ensuring compatibility and interoperability. The latest Enterprise RA details an optimized cluster configuration for systems integrated with NVIDIA GH200��

Source

]]>
2
Taylor Allison <![CDATA[Accelerating AI Storage by up to 48% with NVIDIA Spectrum-X Networking Platform and Partners]]> http://www.open-lab.net/blog/?p=95432 2025-04-23T02:48:15Z 2025-02-04T15:00:00Z AI factories rely on more than just compute fabrics. While the East-West network connecting the GPUs is critical to AI application performance, the storage...]]> AI factories rely on more than just compute fabrics. While the East-West network connecting the GPUs is critical to AI application performance, the storage...

AI factories rely on more than just compute fabrics. While the East-West network connecting the GPUs is critical to AI application performance, the storage fabric��connecting high-speed storage arrays��is equally important. Storage performance plays a key role across several stages of the AI lifecycle, including training checkpointing, inference techniques such as retrieval-augmented generation��

Source

]]>
0
Leigh Engel <![CDATA[Deploying NVIDIA H200 NVL at Scale with New Enterprise Reference Architecture]]> http://www.open-lab.net/blog/?p=93686 2024-12-12T19:35:14Z 2024-12-12T00:40:45Z Last month at the Supercomputing 2024 conference, NVIDIA announced the availability of NVIDIA H200 NVL, the latest NVIDIA Hopper platform. Optimized for...]]> Last month at the Supercomputing 2024 conference, NVIDIA announced the availability of NVIDIA H200 NVL, the latest NVIDIA Hopper platform. Optimized for...

Last month at the Supercomputing 2024 conference, NVIDIA announced the availability of NVIDIA H200 NVL, the latest NVIDIA Hopper platform. Optimized for enterprise workloads, NVIDIA H200 NVL is a versatile platform that delivers accelerated performance for a wide range of AI and HPC applications. With its dual-slot PCIe form-factor and 600W TGP, the H200 NVL enables flexible configuration options��

Source

]]>
0
Itay Ozery <![CDATA[Powering Next-Generation AI Networking with NVIDIA SuperNICs]]> http://www.open-lab.net/blog/?p=90176 2024-11-01T14:27:00Z 2024-10-15T16:30:00Z In the era of generative AI, accelerated networking is essential to build high-performance computing fabrics for massively distributed AI workloads. NVIDIA...]]> In the era of generative AI, accelerated networking is essential to build high-performance computing fabrics for massively distributed AI workloads. NVIDIA...Decorative image of SuperNICs on a black background.

In the era of generative AI, accelerated networking is essential to build high-performance computing fabrics for massively distributed AI workloads. NVIDIA continues to lead in this space, offering state-of-the-art Ethernet and InfiniBand solutions that maximize the performance and efficiency of AI factories and cloud data centers. At the core of these solutions are NVIDIA SuperNICs��a new��

Source

]]>
0
Scot Schultz <![CDATA[Optimize Large-Scale AI Workloads with NVIDIA Spectrum-X]]> http://www.open-lab.net/blog/?p=87888 2024-10-11T20:02:14Z 2024-08-27T16:00:00Z In today��s rapidly evolving technological landscape, staying ahead of the curve is not just a goal��it's a necessity. The surge of innovations, particularly...]]> In today��s rapidly evolving technological landscape, staying ahead of the curve is not just a goal��it's a necessity. The surge of innovations, particularly...Decorative image of networking switches.

In today��s rapidly evolving technological landscape, staying ahead of the curve is not just a goal��it��s a necessity. The surge of innovations, particularly in AI, is driving dramatic changes across the technology stack. One area witnessing profound transformation is Ethernet networking, a cornerstone of digital communication that has been foundational to enterprise and data center��

Source

]]>
0
David Wills <![CDATA[Just Released: DOCA 2.8 Software Framework]]> http://www.open-lab.net/blog/?p=87199 2024-08-22T18:24:57Z 2024-08-14T16:00:00Z The new release includes support for Spectrum-X 1.1 RA and new features for AI Cloud Data Centers.]]> The new release includes support for Spectrum-X 1.1 RA and new features for AI Cloud Data Centers.

The new release includes support for Spectrum-X 1.1 RA and new features for AI Cloud Data Centers.

Source

]]>
0
David Wills <![CDATA[Enhancing AI Cloud Data Centers and NVIDIA Spectrum-X with NVIDIA DOCA 2.7]]> http://www.open-lab.net/blog/?p=82639 2024-10-11T20:02:15Z 2024-05-22T20:00:00Z The NVIDIA DOCA acceleration framework empowers developers with extensive libraries, drivers, and APIs to create high-performance applications and services for...]]> The NVIDIA DOCA acceleration framework empowers developers with extensive libraries, drivers, and APIs to create high-performance applications and services for...

The NVIDIA DOCA acceleration framework empowers developers with extensive libraries, drivers, and APIs to create high-performance applications and services for NVIDIA BlueField DPUs and SuperNICs. DOCA 2.7 is a comprehensive, feature-rich release that further underpins the scope and value of the DOCA software framework. It offers several new libraries, turn-key applications��

Source

]]>
0
Anuradha Karuppiah <![CDATA[Webinar: Enhance LLMs with RAG and Accelerate Enterprise AI with Pure Storage and NVIDIA]]> http://www.open-lab.net/blog/?p=81325 2024-06-06T14:49:03Z 2024-04-23T19:30:00Z Join Pure Storage and NVIDIA on April 25 to discover the benefits of enhancing LLMs with RAG for enterprise-scale generative AI applications.]]> Join Pure Storage and NVIDIA on April 25 to discover the benefits of enhancing LLMs with RAG for enterprise-scale generative AI applications.

Join Pure Storage and NVIDIA on April 25 to discover the benefits of enhancing LLMs with RAG for enterprise-scale generative AI applications.

Source

]]>
0
Anuradha Karuppiah <![CDATA[Scaling Enterprise RAG with Accelerated Ethernet Networking and Networked Storage]]> http://www.open-lab.net/blog/?p=79614 2024-10-28T21:58:50Z 2024-03-18T22:00:00Z In the era of generative AI, where machines are not just learning from data but generating human-like text, images, video, and more, retrieval-augmented...]]> In the era of generative AI, where machines are not just learning from data but generating human-like text, images, video, and more, retrieval-augmented...Decorative image of a RAG pipeline against a black background.

In the era of generative AI, where machines are not just learning from data but generating human-like text, images, video, and more, retrieval-augmented generation (RAG) stands out as a groundbreaking approach. A RAG workflow builds on large language models (LLMs), which can understand queries and generate responses. However, LLMs have limitations, including training complexity and a lack of��

Source

]]>
1
Brian Sparks <![CDATA[Benchmarking NVIDIA Spectrum-X for AI Network Performance, Now Available from Supermicro]]> http://www.open-lab.net/blog/?p=77990 2024-10-11T20:02:16Z 2024-02-22T17:54:05Z NVIDIA Spectrum-X is swiftly gaining traction as the leading networking platform tailored for AI in hyperscale cloud infrastructures. Spectrum-X networking...]]> NVIDIA Spectrum-X is swiftly gaining traction as the leading networking platform tailored for AI in hyperscale cloud infrastructures. Spectrum-X networking...

NVIDIA Spectrum-X is swiftly gaining traction as the leading networking platform tailored for AI in hyperscale cloud infrastructures. Spectrum-X networking technologies help enterprise customers accelerate generative AI workloads. NVIDIA announced significant OEM adoption of the platform in a November 2023 press release, along with an update on the NVIDIA Israel-1 Supercomputer powered by Spectrum��

Source

]]>
2
Tim Lustig <![CDATA[Modernizing the Data Center with Accelerated Networking]]> http://www.open-lab.net/blog/?p=77260 2024-10-11T20:02:17Z 2024-01-30T20:00:00Z Accelerated networking combines CPUs, GPUs, DPUs (data processing units), or SuperNICs into an accelerated computing fabric specifically designed to optimize...]]> Accelerated networking combines CPUs, GPUs, DPUs (data processing units), or SuperNICs into an accelerated computing fabric specifically designed to optimize...

Accelerated networking combines CPUs, GPUs, DPUs (data processing units), or SuperNICs into an accelerated computing fabric specifically designed to optimize networking workloads. It uses specialized hardware to offload demanding tasks to enhance server capabilities. As AI and other new workloads continue to grow in complexity and scale, the need for accelerated networking becomes paramount.

Source

]]>
0
Brian Sparks <![CDATA[Networking for Data Centers and the Era of AI]]> http://www.open-lab.net/blog/?p=71474 2023-11-02T18:14:42Z 2023-10-12T16:30:00Z Traditional cloud data centers have served as the bedrock of computing infrastructure for over a decade, catering to a diverse range of users and applications....]]> Traditional cloud data centers have served as the bedrock of computing infrastructure for over a decade, catering to a diverse range of users and applications....

Traditional cloud data centers have served as the bedrock of computing infrastructure for over a decade, catering to a diverse range of users and applications. However, data centers have evolved in recent years to keep up with advancements in technology and the surging demand for AI-driven computing. This post explores the pivotal role that networking plays in shaping the future of data centers��

Source

]]>
0
Aviv Dahan <![CDATA[Maximizing Network Performance for Storage with NVIDIA Spectrum Ethernet]]> http://www.open-lab.net/blog/?p=66884 2023-11-29T23:19:54Z 2023-06-26T15:00:00Z As data generation continues to increase, linear performance scaling has become an absolute requirement for scale-out storage. Storage networks are like car...]]> As data generation continues to increase, linear performance scaling has become an absolute requirement for scale-out storage. Storage networks are like car...

As data generation continues to increase, linear performance scaling has become an absolute requirement for scale-out storage. Storage networks are like car roadway systems: if the road is not built for speed, the potential speed of a car does not matter. Even a Ferrari is slow on an unpaved dirt road full of obstacles. Scale-out storage performance can be hindered by the Ethernet fabric��

Source

]]>
0
Peter Rizk <![CDATA[Turbocharging Generative AI Workloads with NVIDIA Spectrum-X Networking Platform]]> http://www.open-lab.net/blog/?p=65131 2024-10-11T20:02:19Z 2023-05-29T07:00:00Z Large language models (LLMs) and AI applications such as ChatGPT and DALL-E have recently seen rapid growth. Thanks to GPUs, CPUs, DPUs, high-speed storage, and...]]> Large language models (LLMs) and AI applications such as ChatGPT and DALL-E have recently seen rapid growth. Thanks to GPUs, CPUs, DPUs, high-speed storage, and...Ethernet switches

Large language models (LLMs) and AI applications such as ChatGPT and DALL-E have recently seen rapid growth. Thanks to GPUs, CPUs, DPUs, high-speed storage, and AI-optimized software innovations, AI is now widely accessible. You can even deploy AI in the cloud or on-premises. Yet AI applications can be very taxing on the network, and this growth is burdening CPU and GPU servers��

Source

]]>
0
Igor Miroshnichenko <![CDATA[Diagnosing Network Issues Faster with NVIDIA WJH]]> http://www.open-lab.net/blog/?p=64050 2023-05-23T23:56:01Z 2023-05-04T17:02:54Z AI has seamlessly integrated into our lives and changed us in ways we couldn't even imagine just a few years ago. In the past, the perception of AI was...]]> AI has seamlessly integrated into our lives and changed us in ways we couldn't even imagine just a few years ago. In the past, the perception of AI was...

AI has seamlessly integrated into our lives and changed us in ways we couldn��t even imagine just a few years ago. In the past, the perception of AI was something futuristic and complex. Only giant corporations used AI on their supercomputers with HPC technologies to forecast weather and make breakthrough discoveries in healthcare and science. Today, thanks to GPUs, CPUs, high-speed storage��

Source

]]>
0
Stav Sitnikov <![CDATA[Choosing NVIDIA Spectrum for Microsoft Azure SONiC]]> http://www.open-lab.net/blog/?p=54684 2022-11-03T19:26:46Z 2022-10-31T23:30:00Z Everyone agrees that open solutions are the best solutions but, there are few truly open operating systems for Ethernet switches. At NVIDIA, we embraced open...]]> Everyone agrees that open solutions are the best solutions but, there are few truly open operating systems for Ethernet switches. At NVIDIA, we embraced open...

Everyone agrees that open solutions are the best solutions but, there are few truly open operating systems for Ethernet switches. At NVIDIA, we embraced open source for our Ethernet switches. Besides supporting SONiC, we have contributed many innovations to open-source community projects. This post was originally published on the Mellanox blog in June 2018 but has been updated.

Source

]]>
0
Rama Darbha <![CDATA[Achieve Innovative Hyperconverged Networking with NVIDIA Spectrum Ethernet and Microsoft Azure Stack HCI]]> http://www.open-lab.net/blog/?p=56256 2023-11-29T23:20:22Z 2022-10-25T16:00:00Z Enterprises of all sizes are increasingly leveraging virtualization and hyperconverged infrastructure (HCI). This technology delivers reliable and secure...]]> Enterprises of all sizes are increasingly leveraging virtualization and hyperconverged infrastructure (HCI). This technology delivers reliable and secure...

Enterprises of all sizes are increasingly leveraging virtualization and hyperconverged infrastructure (HCI). This technology delivers reliable and secure compute resources for operations while reducing data center footprint. HCI clusters rely on robust, feature-rich networking fabrics to deliver on-premises solutions that can seamlessly connect to the cloud. Microsoft Azure Stack HCI is a��

Source

]]>
3
Yam Gellis <![CDATA[Calculating and Synchronizing Time?with the Precision Timing Protocol on the NVIDIA Spectrum Switch]]> http://www.open-lab.net/blog/?p=54221 2023-06-12T09:01:16Z 2022-09-09T15:46:47Z PTP uses an algorithm and method for synchronizing clocks on various devices across packet-based networks to provide submicrosecond accuracy. NVIDIA Spectrum...]]> PTP uses an algorithm and method for synchronizing clocks on various devices across packet-based networks to provide submicrosecond accuracy. NVIDIA Spectrum...

PTP uses an algorithm and method for synchronizing clocks on various devices across packet-based networks to provide submicrosecond accuracy. NVIDIA Spectrum supports PTP in both one-step and two-step modes and can serve either as a boundary or a transparent clock. Here��s how the switch calculates and synchronizes time in one-step mode when acting as a transparent clock. Later in this post��

Source

]]>
0
Aviv Dahan <![CDATA[Proving Superior Cloud, AI, and Storage Performance with NVIDIA Spectrum-3 Switches]]> http://www.open-lab.net/blog/?p=37844 2023-02-13T18:22:09Z 2021-09-23T01:15:18Z Does the switch matter? The network fabric is key to the performance of modern data centers. There are many requirements for data center switches, but the most...]]> Does the switch matter? The network fabric is key to the performance of modern data centers. There are many requirements for data center switches, but the most...

Does the switch matter? The network fabric is key to the performance of modern data centers. There are many requirements for data center switches, but the most basic is to provide equal amounts of bandwidth to all clients so that resources are shared evenly. Without fair networking, all workloads experience unpredictable performance due to throughput deterioration, delay��

Source

]]>
0
Sophia Schuur <![CDATA[Building an NVIDIA Verified SONiC Image]]> http://www.open-lab.net/blog/?p=23834 2024-10-07T16:19:15Z 2021-02-17T18:56:00Z This blog post was updated on 9/23/2024. NVIDIA is committed to your success when you choose?SONiC?(Software for Open Networking in the Cloud), the free,...]]> This blog post was updated on 9/23/2024. NVIDIA is committed to your success when you choose?SONiC?(Software for Open Networking in the Cloud), the free,...

This blog post was updated on 9/23/2024. NVIDIA is committed to your success when you choose SONiC (Software for Open Networking in the Cloud), the free, community-developed, Linux-based network operating system (NOS) hardened in the data centers of some of the largest cloud service providers. SONiC is an ideal choice for centers looking for a low-cost, scalable, and fully controllable NOS��

Source

]]>
7
���˳���97caoporen����