SPICE of Efficient Transformers: A Survey by Tay et al

TL-DR:
Surveying the X in X-formers

The SPICE for this is disseminated via two formats.

  1. Static SPICE (PDF with URLs to the papers)

  2. Interactive SPICE below. (Click on the links and the representative Image appears. Click on 'Fullscreen')