Memorization Capacity of Multi-Head Attention in Transformers

By Sadegh Mahdavi, Renjie Liao, Christos Thrampoulidis