Google Approaches BERT-Level Performance Using 300x Fewer Parameters with Extension of Its New NLP model PRADO | Synced

The trimmed-down pQRNN extension to Google AI’s projection attention neural network PRADO compares to BERT on text classification tasks for on-device use.