We welcome you to share your thoughts and discuss this session with others. Recent comments are shown below, but to read the full thread, click on the button below. Please don't post questions or requests specifically for the presenter(s), this is a place for the community to share,chat and engage with each other.
ISC 2020: Running Multiple Workloads on a Single A100 GPU
DemoTeam, NVIDIA
ISC 2020
Today, researchers and developers get a dedicated GPU to run their workload, even if the workload only uses a fraction of the GPU's compute power. The NVIDIA A100 Tensor Core GPU includes a groundbreaking feature called Multi-Instance GPU (MIG), which partitions the GPU into as many as seven instances, each with dedicated compute, memory, and bandwidth. This allows multiple users to run their workloads on the same GPU, maximizing per-GPU utilization and user productivity. This demo runs AI and high-performance computing (HPC) workloads simultaneously on the same A100 GPU.