← All topics
knowledge-distillation
Latest stories covering knowledge-distillation, with summaries and links to related coverage.
1 stories · 1 reports · page 1 of 1
Connected topics
Knowledge Distillation of Black-Box Large Language Models (2024)
research
2 min read
Knowledge distillation (KD) enhances the performance of smaller models by transferring knowledge from proprietary large language models (LLMs) like GPT-4. This method aims to improve the capabilities of smaller models while utilizing the strengths of black-box teachers.