Training AI Models – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Fri, 07 Feb 2025 06:43:06 +0000 ko-KR hourly 1 OpenAI Triton, NVIDIA Blackwell?? AI ?? ? ??????? ?? http://www.open-lab.net/ko-kr/blog/openai-triton-on-nvidia-blackwell-boosts-ai-performance-and-programmability/ Fri, 07 Feb 2025 06:42:28 +0000 http://www.open-lab.net/ko-kr/blog/?p=3469 Reading Time: 3 minutes ?? ??? ??? ????? ?? AI ????? ??? ?????. NVIDIA cuDNN? ?? ?????? ??? ???? ??? ????, CUTLASS? ?? ?????? ?? ?? ?????? ??? ?????. ??? ?? ???? ???? ??? ???????? ?? ?? ?? ??? ???? ??? ???. ???? Triton ????? NVIDIA Blackwell ?????? ??? ??? ????, Blackwell? ?? ??? ???? ????? ??? ?? ?????. … Continued]]> Reading Time: 3 minutes ?? ??? ??? ????? ?? AI ????? ??? ?????. NVIDIA cuDNN? ?? ?????? ??? ???? ??? ????, CUTLASS? ?? ?????? ?? ?? ?????? ??? ?????. ??? ?? ???? ???? ??? ???????? ?? ?? ?? ??? ???? ??? ???. ???? Triton ????? NVIDIA Blackwell ?????? ??? ??? ????, Blackwell? ?? ??? ???? ????? ??? ?? ?????. NVIDIA? OpenAI? ???? ?? ??, Triton ????? ?? NVIDIA Blackwell ????? ?????.

Source

]]> 3469 Hymba ????? ?? ????? ??? ?? ?? ?? ?? http://www.open-lab.net/ko-kr/blog/hymba-hybrid-head-architecture-boosts-small-language-model-performance/ Fri, 29 Nov 2024 01:35:55 +0000 http://www.open-lab.net/ko-kr/blog/?p=3311 Reading Time: 8 minutes ??? ?? ????? ?? ?????? ??? ??, ?? ??, ?-?(KV) ??? ??? ?? ?? ?? ??? ?? ??(LM)?? ?? ?? ?????. ??? ?? ??? ????? ???? ??? ???? ?? ???? ???? ??? ????. ??, Mamba ? Mamba-2? ?? ?? ?? ??(SSM)? ???? ???? ??? ???? ???? ?????, ????(memory recall) ???? ??? ??? ???? ???? ??? … Continued]]> Reading Time: 8 minutes ??? ?? ????? ?? ?????? ??? ??, ?? ??, ?-?(KV) ??? ??? ?? ?? ?? ??? ?? ??(LM)?? ?? ?? ?????. ??? ?? ??? ????? ???? ??? ???? ?? ???? ???? ??? ????. ??, Mamba ? Mamba-2? ?? ?? ?? ??(SSM)? ???? ???? ??? ???? ???? ?????, ????(memory recall) ???? ??? ??? ???? ???? ??? ??? ????. NVIDIA ????? ?? ???? ?? ??? ?? ???? ?? ????? ??? ????? SSM? ???? ????? ?? ?? ????? ???? ?? ?? ??…

Source

]]> 3311 MLPerf Training v4.1?? LLM ???? ??? ? ?? ???? NVIDIA Blackwell http://www.open-lab.net/ko-kr/blog/nvidia-blackwell-doubles-llm-training-performance-in-mlperf-training-v4-1/ Fri, 22 Nov 2024 02:24:36 +0000 http://www.open-lab.net/ko-kr/blog/?p=3293 Reading Time: 5 minutes ??? ??? ? ?? ???? ????? ??? ???? ???? ???? ????. ?? ??? ??? ????? ????? ??? ?? ??? ?????. GTC 2024?? ???? ?? ?? ?? ?? NVIDIA Blackwell ???? GPU, CPU, DPU, NVLink Switch ?, InfiniBand Switch, Ethernet Switch ? 7?? ??? ?? ?????. Blackwell ???? GPU? ??? ?? ?????, ? ??? AI ????? … Continued]]> Reading Time: 5 minutes ??? ??? ? ?? ???? ????? ??? ???? ???? ???? ????. ?? ??? ??? ????? ????? ??? ?? ??? ?????. GTC 2024?? ???? ?? ?? ?? ?? NVIDIA Blackwell ???? GPU, CPU, DPU, NVLink Switch ?, InfiniBand Switch, Ethernet Switch ? 7?? ??? ?? ?????. Blackwell ???? GPU? ??? ?? ?????, ? ??? AI ????? ??? ? ?? ??? ??? LLM ??? ??? ?? ??? ?????. AI ???? ???? ???? MLPerf Training?? NVIDIA? ???…

Source

]]> 3293 ????? ?? ?? ?? ??? ?? LLM ??? ????? NVIDIA NeMo http://www.open-lab.net/ko-kr/blog/nvidia-nemo-accelerates-llm-innovation-with-hybrid-state-space-model-support/ http://www.open-lab.net/ko-kr/blog/nvidia-nemo-accelerates-llm-innovation-with-hybrid-state-space-model-support/#respond Wed, 24 Jul 2024 05:54:00 +0000 http://www.open-lab.net/ko-kr/blog/?p=2935 Reading Time: 4 minutes ???? ?? ?? ??(LLM)? 2017?? ??? ????? ?? ????? ???? ???. 2017? ??? AI ??? ??? ??? ???? ? ? ????? ?? LLM? ??? ? ?? ??? ??? ?? ???????. ?? ????? ?? LLM? ??? ??, ??? ?? ??, ? ??? ?? ?? ???? ??????? ???? ????. ??? LLM? ??????? ????? ???? ????? ??? ?????. … Continued]]> Reading Time: 4 minutes ???? ?? ?? ??(LLM)? 2017?? ??? ????? ?? ????? ???? ???. 2017? ??? AI ??? ??? ??? ???? ? ? ????? ?? LLM? ??? ? ?? ??? ??? ?? ???????. ?? ????? ?? LLM? ??? ??, ??? ?? ??, ? ??? ?? ?? ???? ??????? ???? ????. ??? LLM? ??????? ????? ???? ????? ??? ?????. NVIDIA NeMo? LLM? ????, ?????, ??? ? ?? ?? ? ?? ???? ?????. NeMo ?????? ??? ??? Megatron-Core? PyTorch ?? ??????…

Source

]]> http://www.open-lab.net/ko-kr/blog/nvidia-nemo-accelerates-llm-innovation-with-hybrid-state-space-model-support/feed/ 0 2935 Union.ai ? NVIDIA DGX Cloud? ?? AI ????? ??? http://www.open-lab.net/ko-kr/blog/democratizing-ai-workflows-with-union-ai-and-nvidia-dgx-cloud/ http://www.open-lab.net/ko-kr/blog/democratizing-ai-workflows-with-union-ai-and-nvidia-dgx-cloud/#respond Fri, 03 May 2024 06:23:15 +0000 http://www.open-lab.net/ko-kr/blog/?p=2622 Reading Time: 4 minutes GPU? ??? ??? ???? 3D ???? ????? ? ???? ???? ?? ?? ?? ??? ???????. ??? GPU? AI ??? ??? ?? ??? ?????.  ?? ??? ??? ??? ???? ? ?? ????? ????, ???? ??? ????? ?????? ???? ??? ? ????.  ??? AI ?? ???? ??? ???? ?? ???? GPU? ?????? ?? ? ????? ????. ?? … Continued]]> Reading Time: 4 minutes GPU? ??? ??? ???? 3D ???? ????? ? ???? ???? ?? ?? ?? ??? ???????. ??? GPU? AI ??? ??? ?? ??? ?????. ?? ??? ??? ??? ???? ? ?? ????? ????, ???? ??? ????? ?????? ???? ??? ? ????. ??? AI ?? ???? ??? ???? ?? ???? GPU? ?????? ?? ? ????? ????. ?? ?? ??? ?? ???? ???? ???? ? ?? ?? ?? ???????. NVIDIA DGX Cloud? AI ??? ???? ???? ?? ???? ???? ?? ??, ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/democratizing-ai-workflows-with-union-ai-and-nvidia-dgx-cloud/feed/ 0 2622 LLM, ?? ??? ? GNN? ?? ??? ??? ???: NVIDIA GH200 NVL32 http://www.open-lab.net/ko-kr/blog/one-giant-superchip-for-llms-recommenders-and-gnns-introducing-nvidia-gh200-nvl32/ http://www.open-lab.net/ko-kr/blog/one-giant-superchip-for-llms-recommenders-and-gnns-introducing-nvidia-gh200-nvl32/#respond Wed, 29 Nov 2023 05:35:53 +0000 http://www.open-lab.net/ko-kr/blog/?p=2256 Reading Time: 6 minutes AWS re:Invent 2023?? AWS? NVIDIA? AWS? ???? ???? ? ??? NVIDIA DGX ????? ?? NVIDIA NVLink ??? ?? ???? Amazon Elastic Compute Cloud(Amazon EC2)?? ???? NVIDIA GH200 Grace Hopper ???? ???? ? ???? ??????. ?? ???? ???? ??? ??? ?????. NVIDIA DGX ???? ?? Amazon ???? ?? ? ??? ???? NVIDIA GH200 NVL32? 32-GPU NVIDIA … Continued]]> Reading Time: 6 minutes AWS re:Invent 2023?? AWS? NVIDIA? AWS? ???? ???? ? ??? NVIDIA DGX ????? ?? NVIDIA NVLink ??? ?? ???? Amazon Elastic Compute Cloud(Amazon EC2)?? ???? NVIDIA GH200 Grace Hopper ???? ???? ? ???? ??????. ?? ???? ???? ??? ??? ?????. NVIDIA DGX ???? ?? Amazon ???? ?? ? ??? ???? NVIDIA GH200 NVL32? 32-GPU NVIDIA NVLink ???? 19.5TB? ??? ?? ???? ?????. ?? ???? ??? ??? ???? ?…

Source

]]> http://www.open-lab.net/ko-kr/blog/one-giant-superchip-for-llms-recommenders-and-gnns-introducing-nvidia-gh200-nvl32/feed/ 0 2256 LLM ?? ?????: ?? http://www.open-lab.net/ko-kr/blog/mastering-llm-techniques-training/ http://www.open-lab.net/ko-kr/blog/mastering-llm-techniques-training/#respond Fri, 24 Nov 2023 06:31:56 +0000 http://www.open-lab.net/ko-kr/blog/?p=2232 Reading Time: 9 minutes ?? ?? ??(LLM)? ??? ??? ??? ???? ??? ??, ??, ??, ??, ??? ? ?? ????? ????? ???? ??? ??? AI ??? ? ?????. LLM? ??? ?? ?? ??? ???? ? ?? ???? ??? ???, ??? ??? ??? ??? ???? ?? ?? ?????. ? ?????? ?? ????, ??? ????, ??? ??, ?? ?? ?? ??? … Continued]]> Reading Time: 9 minutes ?? ?? ??(LLM)? ??? ??? ??? ???? ??? ??, ??, ??, ??, ??? ? ?? ????? ????? ???? ??? ??? AI ??? ? ?????. LLM? ??? ?? ?? ??? ???? ? ?? ???? ??? ???, ??? ??? ??? ??? ???? ?? ?? ?????. ? ?????? ?? ????, ??? ????, ??? ??, ?? ?? ?? ??? ???? ????? ????? ???? ??? LLM? ?? ??? ?????. ?? ????? ????? ????? ??? ????, ??? ??? ??? ????? ?????. LLM? ????? ?? ???…

Source

]]> http://www.open-lab.net/ko-kr/blog/mastering-llm-techniques-training/feed/ 0 2232 人人超碰97caoporen国产