Hardware / Semiconductor – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Mon, 14 Jul 2025 09:22:54 +0000 ko-KR hourly 1 ????? ????, ????? ??? ????: ??? ?? ??? ???? 32? ? ?? ??? ?? http://www.open-lab.net/ko-kr/blog/asking-an-encyclopedia-sized-question-how-to-make-the-world-smarter-with-multi-million-token-real-time-inference/ Wed, 09 Jul 2025 09:14:08 +0000 http://www.open-lab.net/ko-kr/blog/?p=3930 Reading Time: 6 minutes ?? AI ??????? ?? ?? ??? ???? ???? ???? ??? ?? ????? ??? ??? ?? ? ???? ????. ????? ??? ???? AI ????, ???? ? ??? ??? ??? ??? ???? ?? ?? ??, ??? ?? ???? ???? ?? ???? ?? ??, ??? ??? ?? ??? ???? ???? ???? ???? ??? ??? ???? ???? ?? ??? … Continued]]> Reading Time: 6 minutes ?? AI ??????? ?? ?? ??? ???? ???? ???? ??? ?? ????? ??? ??? ?? ? ???? ????. ????? ??? ???? AI ????, ???? ? ??? ??? ??? ??? ???? ?? ?? ??, ??? ?? ???? ???? ?? ???? ?? ??, ??? ??? ?? ??? ???? ???? ???? ???? ??? ??? ???? ???? ?? ??? ???? ???? ?? ??????. ??? ?? ????? ??? ?????? ??? ?????. ??? ??? ???? ????? ?????, ?? GPU? ??? ?? ? ?? ??? ???? ??? ??? FP4 ??? NVIDIA…

Source

]]> 3930 ??? ????? ?? GPU ?? ???? http://www.open-lab.net/ko-kr/blog/get-started-with-gpu-acceleration-for-data-science/ Tue, 08 Apr 2025 04:41:21 +0000 http://www.open-lab.net/ko-kr/blog/?p=3651 Reading Time: 5 minutes ??? ???? ???? ?? ???? ?? ? ????, ????? ?? ??? ??? ???? ? ?? ???? ?????. GPU ???? ?? ?????? ???? ??? ????, ??? ?? ??? ???? ????. RAPIDS? ???? ?? ???? GPU? ???? ??? ???? ?????? ?????? ??? NVIDIA?? ??? ?? ?? ??????? ????? ??????. ??? ??? ?? cuDF, ?? ??? ?? cuML, … Continued]]> Reading Time: 5 minutes ??? ???? ???? ?? ???? ?? ? ????, ????? ?? ??? ??? ???? ? ?? ???? ?????. GPU ???? ?? ?????? ???? ??? ????, ??? ?? ??? ???? ????. RAPIDS? ???? ?? ???? GPU? ???? ??? ???? ?????? ?????? ??? NVIDIA?? ??? ?? ?? ??????? ????? ??????. ??? ??? ?? cuDF, ?? ??? ?? cuML, ??? ??? ?? cuGraph? ?? ??? ???? RAPIDS? ?? Python ?????? ???? ??? ? ?? ??? ??????? ? ??? ????? ??? ? ???…

Source

]]> 3651 AI ????? ?? 48% ????? NVIDIA Spectrum-X ???? ??? http://www.open-lab.net/ko-kr/blog/accelerating-ai-storage-by-up-to-48-with-nvidia-spectrum-x-networking-platform-and-partners/ Thu, 06 Feb 2025 04:52:22 +0000 http://www.open-lab.net/ko-kr/blog/?p=3461 Reading Time: 4 minutes AI ???? ??? ??? ???? ???? ????. GPU? ???? ?? ????? AI ?????? ??? ?? ??? ???, ?? ???? ???? ???? ???? ??? ?? ?????. ???? ??? AI ????? ?? ???? ???? ??? ????. ???? ?? ?????, ?? ?? ??(Retrieval Augmented Generation, RAG)? ?? ?? ?? ?? ????. ??? ??? ????? ?? NVIDIA? ???? ???? … Continued]]> Reading Time: 4 minutes AI ???? ??? ??? ???? ???? ????. GPU? ???? ?? ????? AI ?????? ??? ?? ??? ???, ?? ???? ???? ???? ???? ??? ?? ?????. ???? ??? AI ????? ?? ???? ???? ??? ????. ???? ?? ?????, ?? ?? ??(Retrieval Augmented Generation, RAG)? ?? ?? ?? ?? ????. ??? ??? ????? ?? NVIDIA? ???? ???? NVIDIA Spectrum-X ???? ???? ??? ???? ????? ???? ????. ?? ?? ? ?? ??? ? ?? AI ?? ??? ??? ? ?? ????.

Source

]]> 3461 NVIDIA NIM? ?? ???? ?? LoRA ??? ?? http://www.open-lab.net/ko-kr/blog/seamlessly-deploying-a-swarm-of-lora-adapters-with-nvidia-nim/ http://www.open-lab.net/ko-kr/blog/seamlessly-deploying-a-swarm-of-lora-adapters-with-nvidia-nim/#respond Wed, 03 Jul 2024 05:11:10 +0000 http://www.open-lab.net/ko-kr/blog/?p=2855 Reading Time: 7 minutes ?? ??? ????? ?? ?? ??(LLM)?? ??? ?? ?? ??? ??? ?? ?? ?? ??? ??? ?? ?? ???????. ?? ???? ?? ?? ??? ?? ???? ??? ??? ?????. ???? ???? ??? ??? LLM? ???? ???? ?????? ???? ????? ???? ??? ???? ??? ? ??? ???.  ?? ?? ? ?? ??? ??? ? ? ?? … Continued]]> Reading Time: 7 minutes ?? ??? ????? ?? ?? ??(LLM)?? ??? ?? ?? ??? ??? ?? ?? ?? ??? ??? ?? ?? ???????. ?? ???? ?? ?? ??? ?? ???? ??? ??? ?????. ???? ???? ??? ??? LLM? ???? ???? ?????? ???? ????? ???? ??? ???? ??? ? ??? ???. ?? ?? ? ?? ??? ??? ? ? ?? LLM? ????? ??? ? ?? ??? ???? ??? ?? ??? ?? ?? ? ????. ??? ?? ????? ??? ?? ??? ????? ?? ? ?? ???? ??? ??? ??? ? ????. ?? ? LLM? ?? ??? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/seamlessly-deploying-a-swarm-of-lora-adapters-with-nvidia-nim/feed/ 0 2855 ?????? NVIDIA TensorRT 10.0? ???, ??, AI ?? ?? http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-10-0-upgrades-usability-performance-and-ai-model-support/ http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-10-0-upgrades-usability-performance-and-ai-model-support/#respond Wed, 29 May 2024 07:47:46 +0000 http://www.open-lab.net/ko-kr/blog/?p=2761 Reading Time: 4 minutes NVIDIA? ?? ??? ? ?? ??? ?? API ?????? NVIDIA TensorRT? ?? ???? ??????. TensorRT?? ???? ??????? ?? ??? ?? ???? ?? ?? ??? ? ?? ???? ?????.  ? ?????? ??? ??, ??? ???, ??? ??, ????? ???? ?? AI ??? ???? ?? ???? ?? ?? ? ?????? ???? ?????. ??? ?? ????? Debian ? … Continued]]> Reading Time: 4 minutes NVIDIA? ?? ??? ? ?? ??? ?? API ?????? NVIDIA TensorRT? ?? ???? ??????. TensorRT?? ???? ??????? ?? ??? ?? ???? ?? ?? ??? ? ?? ???? ?????. ? ?????? ??? ??, ??? ???, ??? ??, ????? ???? ?? AI ??? ???? ?? ???? ?? ?? ? ?????? ???? ?????. Debian ? RPM ?????? ?????? TensorRT 10.0? ?? ???? ??? ? ????. ?? ?? ?? pip install tensorrt? ???? C++ ?? Python? ?? ?? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-10-0-upgrades-usability-performance-and-ai-model-support/feed/ 0 2761 NVIDIA TensorRT Model Optimizer? ??? AI ?? ?? ??? http://www.open-lab.net/ko-kr/blog/accelerate-generative-ai-inference-performance-with-nvidia-tensorrt-model-optimizer-now-publicly-available/ http://www.open-lab.net/ko-kr/blog/accelerate-generative-ai-inference-performance-with-nvidia-tensorrt-model-optimizer-now-publicly-available/#respond Fri, 17 May 2024 02:26:54 +0000 http://www.open-lab.net/ko-kr/blog/?p=2682 Reading Time: 6 minutes ??? ???? ??? AI ???? ???? ?? ??? ?? ??? ??? ??? ?????. ?? ??? ???? ??????? ???? ?? ??? ????? ??? ???? ???? ?? ???? ??? ???? ? ???? ?? ??? ????. NVIDIA ???? ??? ??? ????? ?, ???, ?????, ???? ? ?? ?? ??? ?? ??? ?? ???? ?? ??? ?????.  NVIDIA? ??? … Continued]]> Reading Time: 6 minutes ??? ???? ??? AI ???? ???? ?? ??? ?? ??? ??? ??? ?????. ?? ??? ???? ??????? ???? ?? ??? ????? ??? ???? ???? ?? ???? ??? ???? ? ???? ?? ??? ????. NVIDIA ???? ??? ??? ????? ?, ???, ?????, ???? ? ?? ?? ??? ?? ??? ?? ???? ?? ??? ?????. NVIDIA? ??? ?? ???? ? ???? ???? ?? ??? ??? ?? ?????? NVIDIA TensorRT Model Optimizer? ?? ?? ???? ???? ????. ??? ???? ?? ???? ??? ?? ??? ?…

Source

]]> http://www.open-lab.net/ko-kr/blog/accelerate-generative-ai-inference-performance-with-nvidia-tensorrt-model-optimizer-now-publicly-available/feed/ 0 2682 NVIDIA H100 Tensor ?? GPU??? ???? ??? ?? ??? ?? http://www.open-lab.net/ko-kr/blog/announcing-confidential-computing-general-access-on-nvidia-h100-tensor-core-gpus/ http://www.open-lab.net/ko-kr/blog/announcing-confidential-computing-general-access-on-nvidia-h100-tensor-core-gpus/#respond Sat, 11 May 2024 05:40:41 +0000 http://www.open-lab.net/ko-kr/blog/?p=2675 Reading Time: 2 minutes NVIDIA? 2023? 7? NVIDIA LaunchPad? ?? ???? ???(CC) ?? ?? ???? ??? ??? ??? ?? ??? ???? ??????. ???? ???? ???? ???? ??? ? ??? ?? ?? ??? ???? ?? ??? ??? ?????. NVIDIA H100 Tensor ?? GPU? CC? ?? ??? ??? ??? GPU???.  ? ???? ???? ?? ??? ?? CUDA 12.4?? CC? ?? ?? … Continued]]> Reading Time: 2 minutes NVIDIA? 2023? 7? NVIDIA LaunchPad? ?? ???? ???(CC) ?? ?? ???? ??? ??? ??? ?? ??? ???? ??????. ???? ???? ???? ???? ??? ? ??? ?? ?? ??? ???? ?? ??? ??? ?????. NVIDIA H100 Tensor ?? GPU? CC? ?? ??? ??? ??? GPU???. ? ???? ???? ?? ??? ?? CUDA 12.4?? CC? ?? ?? GPU ???? ??? ?? ?? ???? ?????. ???? ?? ??? ? NVIDIA H100 ???? ???? ?? ???? VM ?????? ??? ?????.

Source

]]> http://www.open-lab.net/ko-kr/blog/announcing-confidential-computing-general-access-on-nvidia-h100-tensor-core-gpus/feed/ 0 2675 NVIDIA AI Enterprise IGX? ?? ???? ?? ??? AI ?? http://www.open-lab.net/ko-kr/blog/powering-mission-critical-ai-at-the-edge-with-ai-enterprise-igx/ http://www.open-lab.net/ko-kr/blog/powering-mission-critical-ai-at-the-edge-with-ai-enterprise-igx/#respond Fri, 26 Apr 2024 04:27:29 +0000 http://www.open-lab.net/ko-kr/blog/?p=2607 Reading Time: 3 minutes NVIDIA SDK? ??? ??, ??, ????? ???? ??? ?? ???? AI ??????? ???? ? ??? ??? ?????. ??? ?? ? ??? ??? ???? ???? ?? ??? ?? ??? ????? AI ???? ????? ??????? ??? ???? ????? ?????? ?? ?????.  NVIDIA? ???? ?? ??? AI ??????? ???? ????. NVIDIA AI Enterprise IGX? NVIDIA IGX ????? ?? … Continued]]> Reading Time: 3 minutes NVIDIA SDK? ??? ??, ??, ????? ???? ??? ?? ???? AI ??????? ???? ? ??? ??? ?????. ??? ?? ? ??? ??? ???? ???? ?? ??? ?? ??? ????? AI ???? ????? ??????? ??? ???? ????? ?????? ?? ?????. NVIDIA? ???? ?? ??? AI ??????? ???? ????. NVIDIA AI Enterprise IGX? NVIDIA IGX ????? ?? AI? ???? ?? ??????? ????? ??????. NVIDIA IGX? ??? ?? ??, ?? ?? ??, ?? ?? ????? ?? ??? ??? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/powering-mission-critical-ai-at-the-edge-with-ai-enterprise-igx/feed/ 0 2607 LLM ????? Mixture of Experts(MoE)? ???? http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/ http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/#respond Fri, 15 Mar 2024 06:21:35 +0000 http://www.open-lab.net/ko-kr/blog/?p=2511 Reading Time: 7 minutes Mixture of Experts(MoE) ?? ?? ??(LLM) ????? ?? GPT-4? ?? ?? LLM? ?? Mixtral 8x7B? ?? ?? ??? ?? ???? ????? ???? ????. Mixtral ??? ??? ??? ???? ?? MoE? LLM ??????? ??? ?? ?? ??? ??? ??? ???????. ???? MoE? ???? ? ??? ????? MoE? ??? ??? ?? ??(?: ?? ???, MLP ?? attention … Continued]]> Reading Time: 7 minutes Mixture of Experts(MoE) ?? ?? ??(LLM) ????? ?? GPT-4? ?? ?? LLM? ?? Mixtral 8x7B? ?? ?? ??? ?? ???? ????? ???? ????. Mixtral ??? ??? ??? ???? ?? MoE? LLM ??????? ??? ?? ?? ??? ??? ??? ???????. ???? MoE? ???? ? ??? ????? MoE? ??? ??? ?? ??(?: ?? ???, MLP ?? attention projection)? ??? ?? ?? “???(expert)” ?? ????? ???? ???? ???? ?????. ??? ?? ????? ?? ????? ?? ??? ????…

Source

]]> http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/feed/ 0 2511 Supermicro?? ???? AI ???? ??? ?? NVIDIA Spectrum-X ????, ?? ?? ?? http://www.open-lab.net/ko-kr/blog/benchmarking-nvidia-spectrum-x-for-ai-network-performance-now-available-from-supermicro/ http://www.open-lab.net/ko-kr/blog/benchmarking-nvidia-spectrum-x-for-ai-network-performance-now-available-from-supermicro/#respond Fri, 23 Feb 2024 06:10:46 +0000 http://www.open-lab.net/ko-kr/blog/?p=2443 Reading Time: 4 minutes NVIDIA Spectrum-X? ?????? ???? ????? AI? ???? ???? ???? ????? ??? ???? ????. Spectrum-X ???? ??? ?????? ??? ??? AI ????? ???? ? ??? ?????. ?? NVIDIA? 2023? 11? ????? ?? Spectrum-X ?? NVIDIA ????-1 ?????? ?? ????? ?? ? ???? ??? OEM ??? ??????. NVIDIA? ?? Supermicro? Spectrum-X ???? OEM ???? ????? ?????. Spectrum-X? … Continued]]> Reading Time: 4 minutes NVIDIA Spectrum-X? ?????? ???? ????? AI? ???? ???? ???? ????? ??? ???? ????. Spectrum-X ???? ??? ?????? ??? ??? AI ????? ???? ? ??? ?????. ?? NVIDIA? 2023? 11? ????? ?? Spectrum-X ?? NVIDIA ????-1 ?????? ?? ????? ?? ? ???? ??? OEM ??? ??????. NVIDIA? ?? Supermicro? Spectrum-X ???? OEM ???? ????? ?????. Spectrum-X? 4U, 5U ? 8U ? ??? ???? ?????? GPU ????? ????…

Source

]]> http://www.open-lab.net/ko-kr/blog/benchmarking-nvidia-spectrum-x-for-ai-network-performance-now-available-from-supermicro/feed/ 0 2443 人人超碰97caoporen国产