Terry Kong

Terry Kong is a senior deep learning engineer at NVIDIA, working on model alignment and interested in problems at the intersection of infrastructure and deep learning algorithms. He earned his M.S. in electrical engineering from Stanford University.
Avatar photo

Posts by Terry Kong

Icon image of a chart and search symbol, on a purple background.
Generative AI Dec 17, 2024

Data-Efficient Knowledge Distillation for Supervised Fine-Tuning with NVIDIA NeMo-Aligner

Knowledge distillation is an approach for transferring the knowledge of a much larger teacher model to a smaller student model, ideally yielding a compact,... 5 MIN READ