Multi-Head Attention - Formally Explained and Defined | Towards Data Science

A comprehensive and detailed formalization of multi-head attention.