Data Center / Cloud – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Mon, 26 May 2025 04:02:09 +0000 ko-KR hourly 1 NVIDIA Dynamo, ??? ?? ?? ??? ?? llm-d ???? ????? ??? http://www.open-lab.net/ko-kr/blog/nvidia-dynamo-accelerates-llm-d-community-initiatives-for-advancing-large-scale-distributed-inference/ Wed, 21 May 2025 02:52:29 +0000 http://www.open-lab.net/ko-kr/blog/?p=3808 Reading Time: 3 minutes 2025? Red Hat Summit?? ??? llm-d ????? ???? ????? ??? AI ?? ??? ???? ??? ?????.llm-d? vLLM? Inference Gateway ?? ?????, Kubernetes ?? ????? ?? ??? ?? ??? ?? vLLM? ??? ?????. ? ???? llm-d ????? ???? ?? NVIDIA Dynamo ?? ??? ?????. ?? ?? ??? ?? ??? ?? ??? ??, ?????, ??? ?? ??? … Continued]]> Reading Time: 3 minutes 2025? Red Hat Summit?? ??? llm-d ????? ???? ????? ??? AI ?? ??? ???? ??? ?????.llm-d? vLLM? Inference Gateway ?? ?????, Kubernetes ?? ????? ?? ??? ?? ??? ?? vLLM? ??? ?????. ? ???? llm-d ????? ???? ?? NVIDIA Dynamo ?? ??? ?????. ??? ?? ??? ??, ?????, ??? ?? ??? ?? ?? ?? ??? ????, ?? ?? ? ?? ?? ?? ??? ???? ??? ?????. ??, ??? ??? ????? prefill? decode ??? GPU…

Source

]]>
3808
NVIDIA ??? ???? ?? AI ?? ?? ??? http://www.open-lab.net/ko-kr/blog/optimize-ai-inference-performance-with-nvidia-full-stack-solutions/ Thu, 15 May 2025 03:31:05 +0000 http://www.open-lab.net/ko-kr/blog/?p=3729 Reading Time: 5 minutes 2025? 3? 18??? NVIDIA Triton Inference Server? ?? NVIDIA Dynamo? ??? ???????. AI ?? ??????? ???? ???, ??? ?? ??? ?? ??? ? ?? ???? ??? ??? ???? ?? ???? AI ??? ???? ?? ?? ??? ?? ????. NVIDIA? ?, ???, ?????? ??? ??? ??? ?? ????? AI ???? ????? ???? ??? ??? ??? ? … Continued]]> Reading Time: 5 minutes 2025? 3? 18??? NVIDIA Triton Inference Server? ?? NVIDIA Dynamo? ??? ???????. AI ?? ??????? ???? ???, ??? ?? ??? ?? ??? ? ?? ???? ??? ??? ???? ?? ???? AI ??? ???? ?? ?? ??? ?? ????. NVIDIA? ?, ???, ?????? ??? ??? ??? ?? ????? AI ???? ????? ???? ??? ??? ??? ? ??? ???? ????, ??? AI ??? ? ?? ??? ? ???, ?????, ?? ???????. ???? ?? ?? ??? ?? ??? ??? ?????.

Source

]]>
3729
Spotlight: NVIDIA TensorRT-LLM? ??? NAVER Place? SLM Vertical Service ?? ???? http://www.open-lab.net/ko-kr/blog/spotlight-naver-place-optimizes-slm-based-vertical-services-with-nvidia-tensorrt-llm/ Wed, 12 Mar 2025 05:49:01 +0000 http://www.open-lab.net/ko-kr/blog/?p=3592 Reading Time: 7 minutes NAVER Place??? Place ??? ??? SLM Vertical Service? ???? ???? ???? ??(????, ??, ??)? ???? ???? ????.  ? ???? NVIDIA? NAVER? SLM Vertical Service ??? ?? TensorRT-LLM ?? ???? ??? Triton server? ??? ?? ???? ???? ??? ???? ????. ??? ???? ?? ??? ?????. ???? ???? Introduction to NAVER Place AI Development Team? ??????.  NAVER … Continued]]> Reading Time: 7 minutes NAVER Place??? Place ??? ??? SLM Vertical Service? ???? ???? ???? ??(????, ??, ??)? ???? ???? ????. ? ???? NVIDIA? NAVER? SLM Vertical Service ??? ?? TensorRT-LLM ?? ???? ??? Triton server? ??? ?? ???? ???? ??? ???? ????. ??? ???? ?? ??? ?????. ???? ???? Introduction to NAVER Place AI Development Team? ??????. SLM?? ?? ?? ??(LLM)? ?? ????? ?? ?? ?????…

Source

]]>
3592
??? AI? NVIDIA Earth-2? ?? ?? ?? ??? ???? ?? http://www.open-lab.net/ko-kr/blog/how-generative-ai-is-empowering-climate-tech-with-nvidia-earth-2/ http://www.open-lab.net/ko-kr/blog/how-generative-ai-is-empowering-climate-tech-with-nvidia-earth-2/#respond Fri, 12 Apr 2024 05:31:06 +0000 http://www.open-lab.net/ko-kr/blog/?p=2558 Reading Time: 8 minutes ?? ???? ?? ?? ? ????? ????? ???? ?? NVIDIA Earth-2? ???? ????? ???? ?? ??? ???? ????? ???? ????. Earth-2? ?? ??? ??? ?? ????? ? ?? ?? ????? ?? ?? ?????? ???? ????. ?? ?? ??? ???? ???? ??? ???? ???? ???? ?????? ??, ??, ??? ?? ?? ??? ?? ?? ??? ???? … Continued]]> Reading Time: 8 minutes ?? ???? ?? ?? ? ????? ????? ???? ?? NVIDIA Earth-2? ???? ????? ???? ?? ??? ???? ????? ???? ????. Earth-2? ?? ??? ??? ?? ????? ? ?? ?? ????? ?? ?? ?????? ???? ????. ?? ?? ??? ???? ???? ??? ???? ???? ???? ?????? ??, ??, ??? ?? ?? ??? ?? ?? ??? ???? ? ??? ??? ? ??? ??? ? ????. ? ?????? ??? AI? ??? ??????? ??? ?? AI ?? ?? ? ??? ?? ??? ???? NVIDIA Earth-2 ?? ???? ??…

Source

]]>
http://www.open-lab.net/ko-kr/blog/how-generative-ai-is-empowering-climate-tech-with-nvidia-earth-2/feed/ 0 2558
?? ?? ???? LLM ???? ? ??? ??? ???? NVIDIA GB200 NVL72 http://www.open-lab.net/ko-kr/blog/nvidia-gb200-nvl72-delivers-trillion-parameter-llm-training-and-real-time-inference/ http://www.open-lab.net/ko-kr/blog/nvidia-gb200-nvl72-delivers-trillion-parameter-llm-training-and-real-time-inference/#respond Wed, 03 Apr 2024 06:05:57 +0000 http://www.open-lab.net/ko-kr/blog/?p=2530 Reading Time: 6 minutes ? ?? ???? ??? ?? ???? ?? ??? ?? ?? ??? ???, ??? ?? ??? ??? ??? ? ??? ??? ?? ??? ??? ????: ??? ??? ??? ??? ???? ???? ?? ?? ??? ?? ?? ??? ???? ? ????. ??? ??? ????? ??? ?? ????? ?? ????? ??? ???? ???? ???? ??? ?? ?????. ??? … Continued]]> Reading Time: 6 minutes ? ?? ???? ??? ?? ???? ?? ??? ?? ?? ??? ???, ??? ?? ??? ??? ??? ? ??? ??? ?? ??? ??? ????: ??? ??? ??? ??? ???? ???? ?? ?? ??? ?? ?? ??? ???? ? ????. ??? ??? ????? ??? ?? ????? ?? ????? ??? ???? ???? ???? ??? ?? ?????. ??? NVIDIA GB200 NVL72? ??? ??? ??? ??? ? ?????. ?? ???? ?? ??? ??(MoE) ??? ?? ???????. ? ??? ?? ???(expert)?? ?? ??? ???? ?? ?? ?? ? ?????…

Source

]]>
http://www.open-lab.net/ko-kr/blog/nvidia-gb200-nvl72-delivers-trillion-parameter-llm-training-and-real-time-inference/feed/ 0 2530
??? AI ?? ??? ?? ???? ?? ???????? ???? NVIDIA NIM http://www.open-lab.net/ko-kr/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/ http://www.open-lab.net/ko-kr/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/#respond Fri, 22 Mar 2024 01:34:13 +0000 http://www.open-lab.net/ko-kr/blog/?p=2520 Reading Time: 4 minutes ??? AI ??? ??? ?????. 2022? OpenAI? ChatGPT ??? ??? ? ??? ??? ? ? ?? 1? ? ??? ???? ?????, ?? ?? ???? ?? ??? ??????. 2023??? ????? Meta, Mistral, Stability ?? API? ?? ?? ???? ??? ???? POC? ??????. 2024?? ????? ???? AI ??? ?? ?????? ???? ????, ??? ?? ??? ???, ??, … Continued]]> Reading Time: 4 minutes ??? AI ??? ??? ?????. 2022? OpenAI? ChatGPT ??? ??? ? ??? ??? ? ? ?? 1? ? ??? ???? ?????, ?? ?? ???? ?? ??? ??????. 2023??? ????? Meta, Mistral, Stability ?? API? ?? ?? ???? ??? ???? POC? ??????. 2024?? ????? ???? AI ??? ?? ?????? ???? ????, ??? ?? ??? ???, ??, ????, ?? ?? ????? ? ???? ???? ??? ??? ??? ????. ?????? ?? ? ??? ???? ??? ?? ????, ?? ???? ?? ?? ??…

Source

]]>
http://www.open-lab.net/ko-kr/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/feed/ 0 2520
NVIDIA AI ?? ????? ???? Diffusion XL? ?? ??? ???? http://www.open-lab.net/ko-kr/blog/generate-stunning-images-with-stable-diffusion-xl-on-the-nvidia-ai-inference-platform/ http://www.open-lab.net/ko-kr/blog/generate-stunning-images-with-stable-diffusion-xl-on-the-nvidia-ai-inference-platform/#respond Fri, 08 Mar 2024 06:15:17 +0000 http://www.open-lab.net/ko-kr/blog/?p=2485 Reading Time: 8 minutes ?? ??? ?? ??? ?????? ?????? ???? ????. ? ??? ??? ?? ?? ??? ?? ??? ???? ????? AI ?? ???? ???? ??? ??? ?? ??? ??? ???? ?? ???? ?????. ? ??? ???? ?? ???? ??? ??, ?? ? ??? ?? ??? ??? ?? ??, ??? ??? ?? ? ??? ??? ? ??? ?? … Continued]]> Reading Time: 8 minutes ?? ??? ?? ??? ?????? ?????? ???? ????. ? ??? ??? ?? ?? ??? ?? ??? ???? ????? AI ?? ???? ???? ??? ??? ?? ??? ??? ???? ?? ???? ?????. ? ??? ???? ?? ???? ??? ??, ?? ? ??? ?? ??? ??? ?? ??, ??? ??? ?? ? ??? ??? ? ??? ?? ?? ??? ??? ? ????. ?? ??? ?????? ???? ? ??? ??? ? ? ???, ???? ??? ?? ?? ???? ??? ? ? ????. 4?? ???? ??? ?? ??? ???? ? CPU? ?? ??? ??????? ? ?? ?? ? ???…

Source

]]>
http://www.open-lab.net/ko-kr/blog/generate-stunning-images-with-stable-diffusion-xl-on-the-nvidia-ai-inference-platform/feed/ 0 2485
MONAI ? RAPIDS? ?? ??? ?? ???? ??? ?? http://www.open-lab.net/ko-kr/blog/whole-slide-image-analysis-in-real-time-with-monai-and-rapids/ http://www.open-lab.net/ko-kr/blog/whole-slide-image-analysis-in-real-time-with-monai-and-rapids/#respond Wed, 19 Jul 2023 21:52:18 +0000 http://www.open-lab.net/ko-kr/blog/?p=1792 Reading Time: 6 minutes ??? ?? ???? ???? ??? ???? ?????. ?? ????? ????? 40??? ???? ???? ???? ?????. ??? ?? ?? ??? ????? 1~2GB? ?? ? ???, ? ?? ??? ???? ??, ??, ????, ??? ??? ?????. ???? ?? ???? ???? ?? ???? ??? ??? ?? ?? ??? ???? ?????. ?? ???? ????? ???? ? ??? ?? ?? … Continued]]> Reading Time: 6 minutes ??? ?? ???? ???? ??? ???? ?????. ?? ????? ????? 40??? ???? ???? ???? ?????. ??? ?? ?? ??? ????? 1~2GB? ?? ? ???, ? ?? ??? ???? ??, ??, ????, ??? ??? ?????. ???? ?? ???? ???? ?? ???? ??? ??? ?? ?? ??? ???? ?????. ?? ???? ????? ???? ? ??? ?? ?? ????? ??? ???? ?? ??? ? ????. ?? ?? ???? ?? ????? ?????. ??? ???? ???? ?? ??? ????? ????? ?? ???? ??? ?? ??? ???? ??? ?????.

Source

]]>
http://www.open-lab.net/ko-kr/blog/whole-slide-image-analysis-in-real-time-with-monai-and-rapids/feed/ 0 1792
Azure Machine Learning?? NVIDIA AI Enterprise? ?? ???? http://www.open-lab.net/ko-kr/blog/harnessing-the-power-of-nvidia-ai-enterprise-on-azure-machine-learning/ http://www.open-lab.net/ko-kr/blog/harnessing-the-power-of-nvidia-ai-enterprise-on-azure-machine-learning/#respond Wed, 14 Jun 2023 05:26:26 +0000 http://www.open-lab.net/ko-kr/blog/?p=1671 Reading Time: 5 minutes AI? ??? ??? ?? ???? ??? ??? ??? ????? ????? ??? ?? ??? ??? ???? ????. ? ?? ??? ??? AI? ???? ?? ??? ???? ??? ??? ??? ?????, ?????, ????? ???? ?? ??? ??? ????.  NVIDIA AI Enterprise? ??? ??, ???, API ??? ? ??????? ??? ?? ??????? AI, ?? ??(ML) ? ??? ??? ???? … Continued]]> Reading Time: 5 minutes AI? ??? ??? ?? ???? ??? ??? ??? ????? ????? ??? ?? ??? ??? ???? ????. ? ?? ??? ??? AI? ???? ?? ??? ???? ??? ??? ??? ?????, ?????, ????? ???? ?? ??? ??? ????. NVIDIA AI Enterprise? ??? ??, ???, API ??? ? ??????? ??? ?? ??????? AI, ?? ??(ML) ? ??? ??? ???? ??? ? ??? ??? ???? ????? ??????. AI ???? ???? ?? ??? ? ??? ??? ???? ???? ????? ?? ??? ?? ?? ?????…

Source

]]>
http://www.open-lab.net/ko-kr/blog/harnessing-the-power-of-nvidia-ai-enterprise-on-azure-machine-learning/feed/ 0 1671
NVIDIA DGX GH200 ??: ??? 100????? GPU ??? ??? http://www.open-lab.net/ko-kr/blog/announcing-nvidia-dgx-gh200-first-100-terabyte-gpu-memory-system/ http://www.open-lab.net/ko-kr/blog/announcing-nvidia-dgx-gh200-first-100-terabyte-gpu-memory-system/#respond Wed, 07 Jun 2023 01:49:42 +0000 http://www.open-lab.net/ko-kr/blog/?p=1639 Reading Time: 4 minutes COMPUTEX 2023?? NVIDIA? ?? ???? ??? AI ????? ???? GPU ?? ??? ??? ? ?? ??? NVIDIA DGX GH200? ??????. ? ?????? NVIDIA DGX GH200 ????? ??? ?? ?? ??? NVIDIA Base Command? ??? ??? ??? ????, ???? ???? ?????, ??? ??? ??????? ?? ?????. GPU? ?? ??? ????? ??? ?? 7? ?? ??? ?? … Continued]]> Reading Time: 4 minutes COMPUTEX 2023?? NVIDIA? ?? ???? ??? AI ????? ???? GPU ?? ??? ??? ? ?? ??? NVIDIA DGX GH200? ??????. ? ?????? NVIDIA DGX GH200 ????? ??? ?? ?? ??? NVIDIA Base Command? ??? ??? ??? ????, ???? ???? ?????, ??? ??? ??????? ?? ?????. GPU? ?? ??? ????? ??? ?? 7? ?? ??? ?? ??? ?????? ???? ??? ??? ???????. 2016? NVIDIA? GPU ?? ????? ?? ??? ???? ???? ??? CUDA-6? ?? NVLink ???…

Source

]]>
http://www.open-lab.net/ko-kr/blog/announcing-nvidia-dgx-gh200-first-100-terabyte-gpu-memory-system/feed/ 0 1639
人人超碰97caoporen国产