MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding
Jian Chen, Vashisth Tiwari, Ranajoy Sadhukhan, Zhuoming Chen, Jinyuan Shi, Ian En-Hsu Yen et al. · arXiv: 2408.11049v3 · Summary page
Your journal club presentation, ready in a minute. About ten slides with the figures of the paper when its license allows it, what to say on each one, the strengths and limits of the paper, and questions to start the discussion. Present it full screen or save it as PDF.