Houston Hoffman – NVIDIA Technical Blog News and tutorials for developers, data scientists, and IT admins 2025-02-03T22:25:21Z http://www.open-lab.net/blog/feed/ Houston Hoffman <![CDATA[Constant Time Launch for Straight-Line CUDA Graphs and Other Performance Enhancements]]> http://www.open-lab.net/blog/?p=88631 2024-09-19T19:32:10Z 2024-09-11T16:00:00Z CUDA Graphs are a way to define and batch GPU operations as a graph rather than a sequence of stream launches. A CUDA Graph groups a set of CUDA kernels and...]]>

CUDA Graphs are a way to define and batch GPU operations as a graph rather than a sequence of stream launches. A CUDA Graph groups a set of CUDA kernels and other CUDA operations together and executes them with a specified dependency tree. It speeds up the workflow by combining the driver activities associated with CUDA kernel launches and CUDA API calls. It also enforces the dependencies with…

Source

]]>
1
Houston Hoffman <![CDATA[Dynamic Control Flow in CUDA Graphs with Conditional Nodes]]> http://www.open-lab.net/blog/?p=81012 2025-02-03T22:25:21Z 2024-05-10T18:43:37Z Post updated on February 3, 2025 with details about CUDA 12.8. CUDA Graphs can provide a significant performance increase, as the driver is able to optimize...]]>

Post updated on February 3, 2025 with details about CUDA 12.8. CUDA Graphs can provide a significant performance increase, as the driver is able to optimize execution using the complete description of tasks and dependencies. Graphs provide incredible benefits for static workflows where the overhead of graph creation can be amortized over many successive launches. However…

Source

]]>
2
���˳���97caoporen����