Consumer Internet – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Wed, 12 Mar 2025 07:32:22 +0000 ko-KR hourly 1 Spotlight: NVIDIA TensorRT-LLM? ??? NAVER Place? SLM Vertical Service ?? ???? http://www.open-lab.net/ko-kr/blog/spotlight-naver-place-optimizes-slm-based-vertical-services-with-nvidia-tensorrt-llm/ Wed, 12 Mar 2025 05:49:01 +0000 http://www.open-lab.net/ko-kr/blog/?p=3592 Reading Time: 7 minutes NAVER Place??? Place ??? ??? SLM Vertical Service? ???? ???? ???? ??(????, ??, ??)? ???? ???? ????.  ? ???? NVIDIA? NAVER? SLM Vertical Service ??? ?? TensorRT-LLM ?? ???? ??? Triton server? ??? ?? ???? ???? ??? ???? ????. ??? ???? ?? ??? ?????. ???? ???? Introduction to NAVER Place AI Development Team? ??????.  NAVER … Continued]]> Reading Time: 7 minutes NAVER Place??? Place ??? ??? SLM Vertical Service? ???? ???? ???? ??(????, ??, ??)? ???? ???? ????. ? ???? NVIDIA? NAVER? SLM Vertical Service ??? ?? TensorRT-LLM ?? ???? ??? Triton server? ??? ?? ???? ???? ??? ???? ????. ??? ???? ?? ??? ?????. ???? ???? Introduction to NAVER Place AI Development Team? ??????. SLM?? ?? ?? ??(LLM)? ?? ????? ?? ?? ?????…

Source

]]> 3592 Nemotron-CC? ?????: LLM ?? ??? ?? 1? ?? ??? ?? ??? ?? ?? http://www.open-lab.net/ko-kr/blog/announcing-nemotron-cc-a-trillion-token-english-language-dataset-for-llm-pretraining/ Fri, 17 Jan 2025 07:16:45 +0000 http://www.open-lab.net/ko-kr/blog/?p=3414 Reading Time: 3 minutes NVIDIA? 1? 9?? ?? ?? ?? ???? ???? ?? ??? ?? ?? ??(LLM)? ?? ??? ?? 6? 3?? ?? ???? ??? ?? ?? ??(Common Crawl) ??? ??? Nemotron-CC? ??? ???? ?????. ??? LLM? ???? ? ?? ?? ? ??? ???? ?? ?? ??? ????, ?? Meta Llama ???? ?? ??? LLM? 15? ?? ???? ??? … Continued]]> Reading Time: 3 minutes NVIDIA? 1? 9?? ?? ?? ?? ???? ???? ?? ??? ?? ?? ??(LLM)? ?? ??? ?? 6? 3?? ?? ???? ??? ?? ?? ??(Common Crawl) ??? ??? Nemotron-CC? ??? ???? ?????. ??? LLM? ???? ? ?? ?? ? ??? ???? ?? ?? ??? ????, ?? Meta Llama ???? ?? ??? LLM? 15? ?? ???? ??? ??? ?? ???? ???????. ??? ? 15? ?? ??? ??? ??? ???? ??? ?? ?? ????. Nemotron-CC? ? ??? ???? ? ?? ????? ?? ??? LLM? ??? ? ??? ??…

Source

]]> 3414 NVIDIA NIM ??????? ? LangChain?? AI ???? ???? http://www.open-lab.net/ko-kr/blog/building-ai-agents-with-nvidia-nim-microservices-and-langchain/ http://www.open-lab.net/ko-kr/blog/building-ai-agents-with-nvidia-nim-microservices-and-langchain/#respond Fri, 09 Aug 2024 04:44:31 +0000 http://www.open-lab.net/ko-kr/blog/?p=2977 Reading Time: 2 minutes NVIDIA AI Enterprise? ??? NVIDIA NIM? ?? Llama 3.1? ?? ??? ?? ?? ?? ??? ?????. ?? LangChain? ???? ???? ?????? ??? ? ?? ???? ?? ???? ?????. NIM ???????? Llama 3.1? ?? ?? ?? ??? ??? ??? ????, LangChain ??????? NVIDIA API ?????? ??? ???? ? ????. NVIDIA NIM?? AI ???? ???? Llama 3.1 … Continued]]> Reading Time: 2 minutes NVIDIA AI Enterprise? ??? NVIDIA NIM? ?? Llama 3.1? ?? ??? ?? ?? ?? ??? ?????. ?? LangChain? ???? ???? ?????? ??? ? ?? ???? ?? ???? ?????. NIM ???????? Llama 3.1? ?? ?? ?? ??? ??? ??? ????, LangChain ??????? NVIDIA API ?????? ??? ???? ? ????. Llama 3.1 NIM ???????? ???? ???? ??? ?? ?? ??? ?? ??? AI ??????? ??? ? ????. ??? ???? ??? ?? ???? ??? ??? ???? ?? ????…

Source

]]> http://www.open-lab.net/ko-kr/blog/building-ai-agents-with-nvidia-nim-microservices-and-langchain/feed/ 0 2977 NVIDIA NIM? ?? ???? ?? LoRA ??? ?? http://www.open-lab.net/ko-kr/blog/seamlessly-deploying-a-swarm-of-lora-adapters-with-nvidia-nim/ http://www.open-lab.net/ko-kr/blog/seamlessly-deploying-a-swarm-of-lora-adapters-with-nvidia-nim/#respond Wed, 03 Jul 2024 05:11:10 +0000 http://www.open-lab.net/ko-kr/blog/?p=2855 Reading Time: 7 minutes ?? ??? ????? ?? ?? ??(LLM)?? ??? ?? ?? ??? ??? ?? ?? ?? ??? ??? ?? ?? ???????. ?? ???? ?? ?? ??? ?? ???? ??? ??? ?????. ???? ???? ??? ??? LLM? ???? ???? ?????? ???? ????? ???? ??? ???? ??? ? ??? ???.  ?? ?? ? ?? ??? ??? ? ? ?? … Continued]]> Reading Time: 7 minutes ?? ??? ????? ?? ?? ??(LLM)?? ??? ?? ?? ??? ??? ?? ?? ?? ??? ??? ?? ?? ???????. ?? ???? ?? ?? ??? ?? ???? ??? ??? ?????. ???? ???? ??? ??? LLM? ???? ???? ?????? ???? ????? ???? ??? ???? ??? ? ??? ???. ?? ?? ? ?? ??? ??? ? ? ?? LLM? ????? ??? ? ?? ??? ???? ??? ?? ??? ?? ?? ? ????. ??? ?? ????? ??? ?? ??? ????? ?? ? ?? ???? ??? ??? ??? ? ????. ?? ? LLM? ?? ??? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/seamlessly-deploying-a-swarm-of-lora-adapters-with-nvidia-nim/feed/ 0 2855 ?????? NVIDIA TensorRT 10.0? ???, ??, AI ?? ?? http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-10-0-upgrades-usability-performance-and-ai-model-support/ http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-10-0-upgrades-usability-performance-and-ai-model-support/#respond Wed, 29 May 2024 07:47:46 +0000 http://www.open-lab.net/ko-kr/blog/?p=2761 Reading Time: 4 minutes NVIDIA? ?? ??? ? ?? ??? ?? API ?????? NVIDIA TensorRT? ?? ???? ??????. TensorRT?? ???? ??????? ?? ??? ?? ???? ?? ?? ??? ? ?? ???? ?????.  ? ?????? ??? ??, ??? ???, ??? ??, ????? ???? ?? AI ??? ???? ?? ???? ?? ?? ? ?????? ???? ?????. ??? ?? ????? Debian ? … Continued]]> Reading Time: 4 minutes NVIDIA? ?? ??? ? ?? ??? ?? API ?????? NVIDIA TensorRT? ?? ???? ??????. TensorRT?? ???? ??????? ?? ??? ?? ???? ?? ?? ??? ? ?? ???? ?????. ? ?????? ??? ??, ??? ???, ??? ??, ????? ???? ?? AI ??? ???? ?? ???? ?? ?? ? ?????? ???? ?????. Debian ? RPM ?????? ?????? TensorRT 10.0? ?? ???? ??? ? ????. ?? ?? ?? pip install tensorrt? ???? C++ ?? Python? ?? ?? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-10-0-upgrades-usability-performance-and-ai-model-support/feed/ 0 2761 NVIDIA TensorRT Model Optimizer? ??? AI ?? ?? ??? http://www.open-lab.net/ko-kr/blog/accelerate-generative-ai-inference-performance-with-nvidia-tensorrt-model-optimizer-now-publicly-available/ http://www.open-lab.net/ko-kr/blog/accelerate-generative-ai-inference-performance-with-nvidia-tensorrt-model-optimizer-now-publicly-available/#respond Fri, 17 May 2024 02:26:54 +0000 http://www.open-lab.net/ko-kr/blog/?p=2682 Reading Time: 6 minutes ??? ???? ??? AI ???? ???? ?? ??? ?? ??? ??? ??? ?????. ?? ??? ???? ??????? ???? ?? ??? ????? ??? ???? ???? ?? ???? ??? ???? ? ???? ?? ??? ????. NVIDIA ???? ??? ??? ????? ?, ???, ?????, ???? ? ?? ?? ??? ?? ??? ?? ???? ?? ??? ?????.  NVIDIA? ??? … Continued]]> Reading Time: 6 minutes ??? ???? ??? AI ???? ???? ?? ??? ?? ??? ??? ??? ?????. ?? ??? ???? ??????? ???? ?? ??? ????? ??? ???? ???? ?? ???? ??? ???? ? ???? ?? ??? ????. NVIDIA ???? ??? ??? ????? ?, ???, ?????, ???? ? ?? ?? ??? ?? ??? ?? ???? ?? ??? ?????. NVIDIA? ??? ?? ???? ? ???? ???? ?? ??? ??? ?? ?????? NVIDIA TensorRT Model Optimizer? ?? ?? ???? ???? ????. ??? ???? ?? ???? ??? ?? ??? ?…

Source

]]> http://www.open-lab.net/ko-kr/blog/accelerate-generative-ai-inference-performance-with-nvidia-tensorrt-model-optimizer-now-publicly-available/feed/ 0 2682 NVIDIA H100 Tensor ?? GPU??? ???? ??? ?? ??? ?? http://www.open-lab.net/ko-kr/blog/announcing-confidential-computing-general-access-on-nvidia-h100-tensor-core-gpus/ http://www.open-lab.net/ko-kr/blog/announcing-confidential-computing-general-access-on-nvidia-h100-tensor-core-gpus/#respond Sat, 11 May 2024 05:40:41 +0000 http://www.open-lab.net/ko-kr/blog/?p=2675 Reading Time: 2 minutes NVIDIA? 2023? 7? NVIDIA LaunchPad? ?? ???? ???(CC) ?? ?? ???? ??? ??? ??? ?? ??? ???? ??????. ???? ???? ???? ???? ??? ? ??? ?? ?? ??? ???? ?? ??? ??? ?????. NVIDIA H100 Tensor ?? GPU? CC? ?? ??? ??? ??? GPU???.  ? ???? ???? ?? ??? ?? CUDA 12.4?? CC? ?? ?? … Continued]]> Reading Time: 2 minutes NVIDIA? 2023? 7? NVIDIA LaunchPad? ?? ???? ???(CC) ?? ?? ???? ??? ??? ??? ?? ??? ???? ??????. ???? ???? ???? ???? ??? ? ??? ?? ?? ??? ???? ?? ??? ??? ?????. NVIDIA H100 Tensor ?? GPU? CC? ?? ??? ??? ??? GPU???. ? ???? ???? ?? ??? ?? CUDA 12.4?? CC? ?? ?? GPU ???? ??? ?? ?? ???? ?????. ???? ?? ??? ? NVIDIA H100 ???? ???? ?? ???? VM ?????? ??? ?????.

Source

]]> http://www.open-lab.net/ko-kr/blog/announcing-confidential-computing-general-access-on-nvidia-h100-tensor-core-gpus/feed/ 0 2675 NVIDIA TensorRT-LLM?? LoRA LLM ?? ? ?? http://www.open-lab.net/ko-kr/blog/tune-and-deploy-lora-llms-with-nvidia-tensorrt-llm/ http://www.open-lab.net/ko-kr/blog/tune-and-deploy-lora-llms-with-nvidia-tensorrt-llm/#respond Thu, 18 Apr 2024 07:04:12 +0000 http://www.open-lab.net/ko-kr/blog/?p=2586 Reading Time: 10 minutes ?? ?? ??(LLM)? ??? ?? ???? ???? ??? ?? ? ??? ?? ???? ??? ???? ???? ???? ??? ??(NLP)? ??????.?????LLM? ????? ?? ???? ????, ??? ?? ??? ?? ????? ???????? ??? ??? ????.??? LLM? ????? ???? ??? ?? ?????? ????, ?? ???? ????? ??? ? ????. ??? ??? ?? ?? ??? ???? ?? LLM? ??? … Continued]]> Reading Time: 10 minutes ?? ?? ??(LLM)? ??? ?? ???? ???? ??? ?? ? ??? ?? ???? ??? ???? ???? ???? ??? ??(NLP)? ??????. ??? LLM? ????? ?? ???? ????, ??? ?? ??? ?? ?? ?? ???? ??? ??? ??? ????. ?? LLM? ????? ???? ??? ?? ?????? ????, ?? ???? ????? ??? ? ????. ??? ??? ?? ?? ??? ???? ?? LLM? ??? ??? ? ????? ??? ??? ? ??? LoRA(Low-Rank Adaptation)???. ??? NLP ?? ? ????? ?? ???? ?? ????? ? ?? ???…

Source

]]> http://www.open-lab.net/ko-kr/blog/tune-and-deploy-lora-llms-with-nvidia-tensorrt-llm/feed/ 0 2586 LLM ????? Mixture of Experts(MoE)? ???? http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/ http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/#respond Fri, 15 Mar 2024 06:21:35 +0000 http://www.open-lab.net/ko-kr/blog/?p=2511 Reading Time: 7 minutes Mixture of Experts(MoE) ?? ?? ??(LLM) ????? ?? GPT-4? ?? ?? LLM? ?? Mixtral 8x7B? ?? ?? ??? ?? ???? ????? ???? ????. Mixtral ??? ??? ??? ???? ?? MoE? LLM ??????? ??? ?? ?? ??? ??? ??? ???????. ???? MoE? ???? ? ??? ????? MoE? ??? ??? ?? ??(?: ?? ???, MLP ?? attention … Continued]]> Reading Time: 7 minutes Mixture of Experts(MoE) ?? ?? ??(LLM) ????? ?? GPT-4? ?? ?? LLM? ?? Mixtral 8x7B? ?? ?? ??? ?? ???? ????? ???? ????. Mixtral ??? ??? ??? ???? ?? MoE? LLM ??????? ??? ?? ?? ??? ??? ??? ???????. ???? MoE? ???? ? ??? ????? MoE? ??? ??? ?? ??(?: ?? ???, MLP ?? attention projection)? ??? ?? ?? “???(expert)” ?? ????? ???? ???? ???? ?????. ??? ?? ????? ?? ????? ?? ??? ????…

Source

]]> http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/feed/ 0 2511 NVIDIA TensorRT? ???? ??? ???? ?? ?? http://www.open-lab.net/ko-kr/blog/new-stable-diffusion-models-accelerated-with-nvidia-tensorrt/ http://www.open-lab.net/ko-kr/blog/new-stable-diffusion-models-accelerated-with-nvidia-tensorrt/#respond Fri, 19 Jan 2024 07:33:38 +0000 http://www.open-lab.net/ko-kr/blog/?p=2375 Reading Time: 2 minutes CES?? NVIDIA? SDXL Turbo, LCM-LoRA ? Stable Video Diffusion? ?? NVIDIA TensorRT? ?? ????? ??? ??????. ??? ??? ??? ?? GeForce RTX GPU ???? ????? ???? ???? ??? ?? ??? ???? ?????? ?? ??? ? ????. SDXL Turbo SDXL Turbo? ??? ?? ??? ??? ??? ???? ?? ??? ???? ??? ? ????. Tensor ??? TensorRT? … Continued]]> Reading Time: 2 minutes CES?? NVIDIA? SDXL Turbo, LCM-LoRA ? Stable Video Diffusion? ?? NVIDIA TensorRT? ?? ????? ??? ??????. ??? ??? ??? ?? GeForce RTX GPU ???? ????? ???? ???? ??? ?? ??? ???? ?????? ?? ??? ? ????. SDXL Turbo? ??? ?? ??? ??? ??? ???? ?? ??? ???? ??? ? ????. Tensor ??? TensorRT? ???? NVIDIA ????? ?? ?? 4?? ???? ??? ? ?? ?? ??? ??? SDXL ??? ??? ???? ? ????.

Source

]]> http://www.open-lab.net/ko-kr/blog/new-stable-diffusion-models-accelerated-with-nvidia-tensorrt/feed/ 0 2375 人人超碰97caoporen国产