Gemini: A Family of Highly Capable Multimodal Models
Authors: Aakanksha Chowdhery, Tianhe Yu, Jeffrey Zhao, Dian Yu, Izhak Shafran, Yuan Cao, Alexander Pritzel, David Silver, Fan Yang, Basil Mustafa, Neil Houlsby, Sholto Douglas, Jacob Devlin, James Bradbury, Anselm Levskaya, Kefan Xiao, Shivani Agrawal, Zizhao Zhang, Mary Phuong, Timothy Lillicrap, Tao Wang, David Reitter, Behnam Neyshabur, Shuo-yiin Chang, Chung-Cheng Chiu, Yonghui Wu, Yuanzhong Xu, Ed Chi, Mostafa Dehghani, Elena Buchatskaya, Chih-Kuan Yeh, Benjamin Lee, Mohammad Saleh, Aviral Kumar, George Tucker, Edouard Leurent, Julian Schrittwieser, Lev Proleev, Diana Mincu, Subhrajit Roy, Le Hou, Nenad Tomasev, Andrew Lee, Sebastian Borgeaud, Arthur Mensch, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Jack W. Rae, Laurent Sifre, Pranav Shyam, Lu Liu, Henryk Michalewski, Jacob Austin, Hexiang Hu, Ming-Wei Chang, Andrew M. Dai, Justin Gilmer, Mehran Kazemi, Jean-Baptiste Lespiau, Roman Ring, Loren Maggiore, Albin Cassirer, Michela Paganini, Geoffrey Irving, Siamak Shakeri, Tianqi Liu, Dmitry Lepikhin, Maxim Krikun, Orhan Firat, Marie Pellat, Kevin Robinson, Xi Chen, Josip Djolonga, Mario Lučić, Sebastian Riedel, Cheng Li, Yingjie Miao, Srivatsan Srinivasan, Tom Le Paine, Richard Powell, Petko Georgiev, Xuehan Xiong, Zhen Yang, Michael Fink, Zhe Chen, Shaobo Hou, Anirudh Goyal, Jian Li, Jakub Sygnowski, Maja Trebacz, Maribeth Rauh, Jonathan Uesato, Will Hawkins, William Isaac, Machel Reid, Disha Shrivastava, Elliot Catt, Matthew Aitchison, Kate Baumli, Natalie Clay, Sarah York, Denis Teplyashin, Junhyuk Oh, Amelia Glaese, Fangyu Liu, Rohan Anil, Melvin Johnson, Emanuel Taropa, Paige Bailey, Laurent El Shafey, Gaurav Mishra, Erica Moreira, Yujing Zhang, Junwhan Ahn, Siddhartha Brahma, Yong Cheng, Ethan Dyer, Fangxiaoyu Feng, Xavier Garcia, Lucas Gonzalez, Steven Hand, Michael Isard, Wenhao Jia, Chang Lan, Music Li, YaGuang Li, Hyeontaek Lim, Hanzhao Lin, Marcello Maggioni, Joshua Maynez, Vedant Misra, Zachary Nado, Martin Polacek, Siyuan Qiao, Aurko Roy, Rajkumar Samuel, Ambrose Slone, Daniel Sohn, Simon Tokumine, Dasha Valter, Vijay Vasudevan, Kiran Vodrahalli, Pidong Wang, Yunhan Xu, Jiahui Yu, Qiao Zhang, Ce Zheng, Slav Petrov, Sanjay Ghemawat, Thanumalayan Sankaranarayana Pillai, Albert Webson, Nora Kassner, Dan Garrette, Luowei Zhou, Allan Dafoe, Jilin Chen, James Qin, Ankur Bapna, Nanxin Chen, Jason Riesa, Tara Sainath, Johan Schalkwyk, Arthur Guez, Elena Gribovskaya, Angeliki Lazaridou, Thibault Sottiaux, Mantas Pajarskas, Zhitao Gong, Yujia Li, Matthew Johnson, Kareem Ayoub, Jeff Stanway, Ioannis Antonoglou, Aditya Siddhant, Chenjie Gu, Andrew Brock, Ankesh Anand, Piyush Patil, Laura Culp, Yunxuan Li, Antoine Miech, Anja Hauth, Shashi Narayan, Nino Vieillard, Léonard Hussenot, Oran Lang, Johan Ferret, Gemini Team, Jean-Baptiste Alayrac, Radu Soricut, Emily Pitler, James Molloy, Paul R. Barham, Fabio Viola, Malcolm Reynolds, Ryan Doherty, Eli Collins, Clemens Meyer, Megha Goel, Enrique Piqueras, Iain Barr, Nikolay Savinov, Ivo Danihelka, Becca Roelofs, Anaïs White, Anders Andreassen, Tamara von Glehn, Lakshman Yagati, Misha Khalman, Alexandre Frechette, Charlotte Smith, Yi Luan, James Lottes, Nathan Schucher, Federico Lebron, Alban Rrustemi, Phil Crone, Tomas Kocisky, Bartek Perz, Heidi Howard, Adam Bloniarz, Han Lu, Fred Alcober, Megan Barnes, Shantanu Thakoor, Gabriel Barth-Maron, William Wong, Rishabh Joshi, Rahma Chaabouni, Deeni Fatiha, Arun Ahuja, Ruibo Liu, Sarah Cogan, Jeremy Chen, Chao Jia, Jordan Grimstad, Ale Jakse Hartman, Martin Chadwick, Gaurav Singh Tomar, Evan Senter, Michael Laskin, Connie Tao, Lorenzo Blanco, Adrià Puigdomènech Badia, Mianna Chen, Jenny Brennan, Clara Rivera, Sergey Brin, Shariq Iqbal, Gabriela Surita, Jane Labanowski, Abhi Rao, Stephanie Winkler, Emilio Parisotto, Yiming Gu, Kate Olszewska, Ravi Addanki, Annie Louis, Geoff Brown, Nithya Attaluri, Jan Balaguer, Jackie Xiang, Zoe Ashwood, Anton Briukhov, Sanjay Ganapathy, Smit Sanghavi, Ajay Kannan, Axel Stjerngren, Yuting Sun, Pedram Pejman, Cindy Wang, Juliette Love, Dawn Bloxwich, Kehang Han, Peter Humphreys, Thibault Sellam, Varun Godbole, Sina Samangooei, Alex Kaskasoli, Sébastien M. R. Arnold, Shubham Agrawal, Richard Tanburn, Sarah Hodkinson, Ankush Garg, Minh Giang, Alexander Neitz, Zaheer Abbas, Elizabeth Cole, Dipanjan Das, Dominika Rogozińska, Vitaly Nikolaev, Pablo Sprechmann, Lukas Zilka, Flavien Prost, Luheng He, Marianne Monteiro, Chris Welty, Josh Newlan, Dawei Jia, Miltiadis Allamanis, Clara Huiyi Hu, Raoul de Liedekerke, Carl Saroufim, Shruti Rijhwani, Anirudh Baddepudi, Alex Goldin, Adnan Ozturel, Devendra Sachan, Reinald Kim Amplayo, Craig Swanson, Dessie Petrova, Jessica Landon, Miteyan Patel, Ruizhe Zhao, Kevin Villela, Luyu Wang, Matthew Rahtz, Mai Giménez, Legg Yeung, James Keeling, Boxi Wu, Salem Haykal, Rachel Saputro, Zeynep Cankara, Abhanshu Sharma, Nick Fernando, Solomon Kim, Adrian Hutter, Priyanka Agrawal, Alex Castro-Ros, Paul Komarek, Ross McIlroy, Guodong Zhang, Wael Farhan, Michael Sharman, Paul Natsev, Paul Michel, Yamini Bansal, Kris Cao, Christina Butterfield, Justin Chung, Paul Kishan Rubenstein, Kedar Soparkar, Karel Lenc, Timothy Chung, Aedan Pope, Jackie Kay, Priya Jhakra, Shibo Wang, Taylor Tobin, Andrea Tacchetti, Yash Katariya, Nimesh Ghelani, Lora Aroyo, Jonas Adler, Mateo Wirth, Lisa Lee, Thais Kagohara, Jay Pavagadhi, Sophie Bridgers, Anna Bortsova, Zafarali Ahmed, Vijay Bolina, Mariko Iinuma, Polina Zablotskaia, James Besley, Da-Woon Chung, Timothy Dozat, Ramona Comanescu, Xiance Si, Jeremy Greer, Guolong Su, Raphaël Lopez Kaufman, Mohamed Elhawaty, Jinwei Xing, Christina Greer, Helen Miller, Shereen Ashraf, Ada Ma, Angelos Filos, Milos Besta, Rory Blevins, Ted Klimenko, Soravit Changpinyo, Jiaqi Mu, Oscar Chang, Carrie Muir, Vered Cohen, Charline Le Lan, Krishna Haridasan, Amit Marathe, Steven Hansen, Mingqiu Wang, Sophia Austin, Jiepu Jiang, Justin Chiu, Jaime Alonso Lorenzo, Lars Lowe Sjösund, Sébastien Cevey, Zach Gleicher, Thi Avrahami, Anudhyan Boral, Hansa Srinivasan, Vittorio Selo, Rhys May, Konstantinos Aisopos, Livio Baldini Soares, Michael B. Chang, Adrià Recasens, Ben Caine, Filip Pavetic, Fabio Pardo, Anita Gergely, Justin Frye, Vinay Ramasesh, Dan Horgan, Kartikeya Badola, Víctor Campos, Alex Tomala, Yunhao Tang, Dalia El Badawy, Elspeth White, Abhishek Jindal, Sharad Vikram, Sergi Caelles, Ross Hemsley, Gregory Thornton, Wojciech Stokowiec, Phoebe Thacker, Çağlar Ünlü, Zhishuai Zhang, James Svensson, Max Bileschi, Katerina Tsihlas, Arpi Vezer, Marco Selvi, Toby Shevlane, Mikel Rodriguez, Tom Kwiatkowski, Samira Daruki, Keran Rong, Nicholas FitzGerald, Keren Gu-Lemberg, Mina Khan, Vladimir Feinberg, James Cobon-Kerr, Sayed Hadi Hashemi, Richard Ives, Yana Hasson, Nathan Byrd, Qingze Wang, Alexandre Moufarek, Samer Hassan, Kaushik Shivakumar, Joost van Amersfoort, Amol Mandhane, Pratik Joshi, Matthew Tung, Hannah Sheahan, Nemanja Rakićević, Sid Mittal, Seb Noury, Eren Sezener, Fantine Huot, Matthew Lamm, Nicola De Cao, Charlie Chen, Gamaleldin Elsayed, Mahdis Mahdieh, Ian Tenney, Nan Hua, Ivan Petrychenko, Patrick Kane, Dylan Scandinaro, Rishub Jain, Romina Datta, Adam Sadovsky, Oskar Bunyan, Dominik Rabiej, Shimu Wu, John Zhang, Gautam Vasudevan, Mahmoud Alnahlawi, Ionut Georgescu, Nan Wei, Ivy Zheng, Betty Chan, Pam G Rabinovitch, Piotr Stanczyk, Ye Zhang, David Steiner, Subhajit Naskar, Michael Azzam, Adam Paszke, Jaume Sanchez Elias, Afroz Mohiuddin, Faizan Muhammad, Jin Miao, Sahitya Potluri, Jane Park, Elnaz Davoodi, Jiageng Zhang, Drew Garmon, Abhijit Karmarkar, Zhe Dong, Jong Lee, Jonathan Evens, Johnson Jia, Zhenkai Zhu, Chris Gorgolewski, Peter Grabowski, Yu Mao, Alberto Magni, Kaisheng Yao, Javier Snaider, Norman Casagrande, Paul Suganthan, Evan Palmer, Edward Loper, Manaal Faruqui, Isha Arkatkar, Alfonso Castaño, Irene Giannoumis, Wooyeol Kim, Mikołaj Rybiński, Ashwin Sreevatsa, Jennifer Prendki, David Soergel, Adrian Goedeckemeyer, Willi Gierke, Mohsen Jafari, Meenu Gaba, Jeremy Wiesner, Diana Gage Wright, Yawen Wei, Harsha Vashisht, Yana Kulizhskaya, Jay Hoover, Maigo Le, Lu Li, Chimezie Iwuanyanwu, Kevin Ramirez, Andrey Khorlin, Albert Cui, Tian LIN, Marin Georgiev, Marcus Wu, Ricardo Aguilar, Keith Pallo, Abhishek Chakladar, Alena Repina, Xihui Wu, Tom van der Weide, Priya Ponnapalli, Caroline Kaplan, Jiri Simsa, Shuangfeng Li, Olivier Dousse
Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of Gemini models in cross-modal reasoning and language understanding will enable a wide variety of use cases and we discuss our approach toward deploying them responsibly to users.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Look for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.