Large Language Models: TinyBERT - Distilling BERT for NLP | Towards Data Science

Unlocking the power of Transformer distillation in LLMs