Resources

Attention Is All You Need

paper

The seminal paper on Transformers.

Beyond Softmax: The Future of Attention Mechanisms

video