#knowledge-distillation

[ follow ]
Artificial intelligence
fromWIRED
1 week ago

Distillation Can Make AI Models Smaller and Cheaper

Knowledge distillation enables smaller models to mimic larger ones efficiently and can explain DeepSeek R1's claims and the resulting industry reaction.
[ Load more ]