Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
Ashok Vardhan Makkuva, Marco Bondaschi, Adway Girish, Alliot Nagle, Martin Jaggi, Hyeji Kim et al. · arXiv: 2402.04161v1 · Summary page
A press kit for every paper: arXiv, journals and preprints. What is really new, a hype check (peer review, sample size, claims that go beyond the results), key sentences quoted word for word, questions to ask the authors, researchers who work on the same topic but did not sign the paper, and a glossary.