Author: "Krikun, A." / Database: OAIster - Searchworks@Jio Institute Digital Library Search Results

Your search keyword '"Krikun, A."' showing total 176 results

Start Over Author "Krikun, A." Database OAIster

176 results on '"Krikun, A."'

1. Holographic timelike superconductor

Author: Krikun, Alexander, Elinos, Uriel, Krikun, Alexander, and Elinos, Uriel
Abstract: We explore the state of matter characterized by the charged timelike vector order parameter. We employ holographic duality in order to construct such a state and study its thermoelectric transport, fermionic spectral function and the character of the Meissner effect. We uncover the unusual features of this “timelike superconductor”: the absence of the gap in the fermionic spectrum and co-existence of Drude peak and supercurrent in the AC transport, which are reminiscent to those of time-reversal-odd and gapless superconductors, correspondingly. We show that this state is dynamically stable and thermodynamically at least metastable. Along the way we develop the holographic model of the charged vector field, which acquires mass due to a variant of the Stueckelberg mechanism with the adjoint Higgs field., QC 20240314
Published: 2024
Full Text: View/download PDF

2. Holographic timelike superconductor

Author: Krikun, Alexander, Elinos, Uriel, Krikun, Alexander, and Elinos, Uriel
Abstract: We explore the state of matter characterized by the charged timelike vector order parameter. We employ holographic duality in order to construct such a state and study its thermoelectric transport, fermionic spectral function and the character of the Meissner effect. We uncover the unusual features of this “timelike superconductor”: the absence of the gap in the fermionic spectrum and co-existence of Drude peak and supercurrent in the AC transport, which are reminiscent to those of time-reversal-odd and gapless superconductors, correspondingly. We show that this state is dynamically stable and thermodynamically at least metastable. Along the way we develop the holographic model of the charged vector field, which acquires mass due to a variant of the Stueckelberg mechanism with the adjoint Higgs field.
Published: 2024
Full Text: View/download PDF

3. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Author: Gemini Team, Reid, Machel, Savinov, Nikolay, Teplyashin, Denis, Dmitry, Lepikhin, Lillicrap, Timothy, Alayrac, Jean-baptiste, Soricut, Radu, Lazaridou, Angeliki, Firat, Orhan, Schrittwieser, Julian, Antonoglou, Ioannis, Anil, Rohan, Borgeaud, Sebastian, Dai, Andrew, Millican, Katie, Dyer, Ethan, Glaese, Mia, Sottiaux, Thibault, Lee, Benjamin, Viola, Fabio, Reynolds, Malcolm, Xu, Yuanzhong, Molloy, James, Chen, Jilin, Isard, Michael, Barham, Paul, Hennigan, Tom, McIlroy, Ross, Johnson, Melvin, Schalkwyk, Johan, Collins, Eli, Rutherford, Eliza, Moreira, Erica, Ayoub, Kareem, Goel, Megha, Meyer, Clemens, Thornton, Gregory, Yang, Zhen, Michalewski, Henryk, Abbas, Zaheer, Schucher, Nathan, Anand, Ankesh, Ives, Richard, Keeling, James, Lenc, Karel, Haykal, Salem, Shakeri, Siamak, Shyam, Pranav, Chowdhery, Aakanksha, Ring, Roman, Spencer, Stephen, Sezener, Eren, Vilnis, Luke, Chang, Oscar, Morioka, Nobuyuki, Tucker, George, Zheng, Ce, Woodman, Oliver, Attaluri, Nithya, Kocisky, Tomas, Eltyshev, Evgenii, Chen, Xi, Chung, Timothy, Selo, Vittorio, Brahma, Siddhartha, Georgiev, Petko, Slone, Ambrose, Zhu, Zhenkai, Lottes, James, Qiao, Siyuan, Caine, Ben, Riedel, Sebastian, Tomala, Alex, Chadwick, Martin, Love, Juliette, Choy, Peter, Mittal, Sid, Houlsby, Neil, Tang, Yunhao, Lamm, Matthew, Bai, Libin, Zhang, Qiao, He, Luheng, Cheng, Yong, Humphreys, Peter, Li, Yujia, Brin, Sergey, Cassirer, Albin, Miao, Yingjie, Zilka, Lukas, Tobin, Taylor, Xu, Kelvin, Proleev, Lev, Sohn, Daniel, Magni, Alberto, Hendricks, Lisa Anne, Gao, Isabel, Ontanon, Santiago, Bunyan, Oskar, Byrd, Nathan, Sharma, Abhanshu, Zhang, Biao, Pinto, Mario, Sinha, Rishika, Mehta, Harsh, Jia, Dawei, Caelles, Sergi, Webson, Albert, Morris, Alex, Roelofs, Becca, Ding, Yifan, Strudel, Robin, Xiong, Xuehan, Ritter, Marvin, Dehghani, Mostafa, Chaabouni, Rahma, Karmarkar, Abhijit, Lai, Guangda, Mentzer, Fabian, Xu, Bibo, Li, YaGuang, Zhang, Yujing, Paine, Tom Le, Goldin, Alex, Neyshabur, Behnam, Baumli, Kate, Levskaya, Anselm, Laskin, Michael, Jia, Wenhao, Rae, Jack W., Xiao, Kefan, He, Antoine, Giordano, Skye, Yagati, Lakshman, Lespiau, Jean-Baptiste, Natsev, Paul, Ganapathy, Sanjay, Liu, Fangyu, Martins, Danilo, Chen, Nanxin, Xu, Yunhan, Barnes, Megan, May, Rhys, Vezer, Arpi, Oh, Junhyuk, Franko, Ken, Bridgers, Sophie, Zhao, Ruizhe, Wu, Boxi, Mustafa, Basil, Sechrist, Sean, Parisotto, Emilio, Pillai, Thanumalayan Sankaranarayana, Larkin, Chris, Gu, Chenjie, Sorokin, Christina, Krikun, Maxim, Guseynov, Alexey, Landon, Jessica, Datta, Romina, Pritzel, Alexander, Thacker, Phoebe, Yang, Fan, Hui, Kevin, Hauth, Anja, Yeh, Chih-Kuan, Barker, David, Mao-Jones, Justin, Austin, Sophia, Sheahan, Hannah, Schuh, Parker, Svensson, James, Jain, Rohan, Ramasesh, Vinay, Briukhov, Anton, Chung, Da-Woon, von Glehn, Tamara, Butterfield, Christina, Jhakra, Priya, Wiethoff, Matthew, Frye, Justin, Grimstad, Jordan, Changpinyo, Beer, Lan, Charline Le, Bortsova, Anna, Wu, Yonghui, Voigtlaender, Paul, Sainath, Tara, Gu, Shane, Smith, Charlotte, Hawkins, Will, Cao, Kris, Besley, James, Srinivasan, Srivatsan, Omernick, Mark, Gaffney, Colin, Surita, Gabriela, Burnell, Ryan, Damoc, Bogdan, Ahn, Junwhan, Brock, Andrew, Pajarskas, Mantas, Petrushkina, Anastasia, Noury, Seb, Blanco, Lorenzo, Swersky, Kevin, Ahuja, Arun, Avrahami, Thi, Misra, Vedant, de Liedekerke, Raoul, Iinuma, Mariko, Polozov, Alex, York, Sarah, Driessche, George van den, Michel, Paul, Chiu, Justin, Blevins, Rory, Gleicher, Zach, Recasens, Adrià, Rrustemi, Alban, Gribovskaya, Elena, Roy, Aurko, Gworek, Wiktor, Arnold, Sébastien M. R., Lee, Lisa, Lee-Thorp, James, Maggioni, Marcello, Piqueras, Enrique, Badola, Kartikeya, Vikram, Sharad, Gonzalez, Lucas, Baddepudi, Anirudh, Senter, Evan, Devlin, Jacob, Qin, James, Azzam, Michael, Trebacz, Maja, Polacek, Martin, Krishnakumar, Kashyap, Chang, Shuo-yiin, Tung, Matthew, Penchev, Ivo, Joshi, Rishabh, Olszewska, Kate, Muir, Carrie, Wirth, Mateo, Hartman, Ale Jakse, Newlan, Josh, Kashem, Sheleem, Bolina, Vijay, Dabir, Elahe, van Amersfoort, Joost, Ahmed, Zafarali, Cobon-Kerr, James, Kamath, Aishwarya, Hrafnkelsson, Arnar Mar, Hou, Le, Mackinnon, Ian, Frechette, Alexandre, Noland, Eric, Si, Xiance, Taropa, Emanuel, Li, Dong, Crone, Phil, Gulati, Anmol, Cevey, Sébastien, Adler, Jonas, Ma, Ada, Silver, David, Tokumine, Simon, Powell, Richard, Lee, Stephan, Vodrahalli, Kiran, Hassan, Samer, Mincu, Diana, Yang, Antoine, Levine, Nir, Brennan, Jenny, Wang, Mingqiu, Hodkinson, Sarah, Zhao, Jeffrey, Lipschultz, Josh, Pope, Aedan, Chang, Michael B., Li, Cheng, Shafey, Laurent El, Paganini, Michela, Douglas, Sholto, Bohnet, Bernd, Pardo, Fabio, Odoom, Seth, Rosca, Mihaela, Santos, Cicero Nogueira dos, Soparkar, Kedar, Guez, Arthur, Hudson, Tom, Hansen, Steven, Asawaroengchai, Chulayuth, Addanki, Ravi, Yu, Tianhe, Stokowiec, Wojciech, Khan, Mina, Gilmer, Justin, Lee, Jaehoon, Bostock, Carrie Grimes, Rong, Keran, Caton, Jonathan, Pejman, Pedram, Pavetic, Filip, Brown, Geoff, Sharma, Vivek, Lučić, Mario, Samuel, Rajkumar, Djolonga, Josip, Mandhane, Amol, Sjösund, Lars Lowe, Buchatskaya, Elena, White, Elspeth, Clay, Natalie, Jiang, Jiepu, Lim, Hyeontaek, Hemsley, Ross, Cankara, Zeyncep, Labanowski, Jane, De Cao, Nicola, Steiner, David, Hashemi, Sayed Hadi, Austin, Jacob, Gergely, Anita, Blyth, Tim, Stanton, Joe, Shivakumar, Kaushik, Siddhant, Aditya, Andreassen, Anders, Araya, Carlos, Sethi, Nikhil, Shivanna, Rakesh, Hand, Steven, Bapna, Ankur, Khodaei, Ali, Miech, Antoine, Tanzer, Garrett, Swing, Andy, Thakoor, Shantanu, Aroyo, Lora, Pan, Zhufeng, Nado, Zachary, Sygnowski, Jakub, Winkler, Stephanie, Yu, Dian, Saleh, Mohammad, Maggiore, Loren, Bansal, Yamini, Garcia, Xavier, Kazemi, Mehran, Patil, Piyush, Dasgupta, Ishita, Barr, Iain, Giang, Minh, Kagohara, Thais, Danihelka, Ivo, Marathe, Amit, Feinberg, Vladimir, Elhawaty, Mohamed, Ghelani, Nimesh, Horgan, Dan, Miller, Helen, Walker, Lexi, Tanburn, Richard, Tariq, Mukarram, Shrivastava, Disha, Xia, Fei, Wang, Qingze, Chiu, Chung-Cheng, Ashwood, Zoe, Baatarsukh, Khuslen, Samangooei, Sina, Kaufman, Raphaël Lopez, Alcober, Fred, Stjerngren, Axel, Komarek, Paul, Tsihlas, Katerina, Boral, Anudhyan, Comanescu, Ramona, Chen, Jeremy, Liu, Ruibo, Welty, Chris, Bloxwich, Dawn, Chen, Charlie, Sun, Yanhua, Feng, Fangxiaoyu, Mauger, Matthew, Dotiwalla, Xerxes, Hellendoorn, Vincent, Sharman, Michael, Zheng, Ivy, Haridasan, Krishna, Barth-Maron, Gabe, Swanson, Craig, Rogozińska, Dominika, Andreev, Alek, Rubenstein, Paul Kishan, Sang, Ruoxin, Hurt, Dan, Elsayed, Gamaleldin, Wang, Renshen, Lacey, Dave, Ilić, Anastasija, Zhao, Yao, Iwanicki, Adam, Lince, Alejandro, Chen, Alexander, Lyu, Christina, Lebsack, Carl, Griffith, Jordan, Gaba, Meenu, Sandhu, Paramjit, Chen, Phil, Koop, Anna, Rajwar, Ravi, Yeganeh, Soheil Hassas, Chang, Solomon, Zhu, Rui, Radpour, Soroush, Davoodi, Elnaz, Lei, Ving Ian, Xu, Yang, Toyama, Daniel, Segal, Constant, Wicke, Martin, Lin, Hanzhao, Bulanova, Anna, Badia, Adrià Puigdomènech, Rakićević, Nemanja, Sprechmann, Pablo, Filos, Angelos, Hou, Shaobo, Campos, Víctor, Kassner, Nora, Sachan, Devendra, Fortunato, Meire, Iwuanyanwu, Chimezie, Nikolaev, Vitaly, Lakshminarayanan, Balaji, Jazayeri, Sadegh, Varadarajan, Mani, Tekur, Chetan, Fritz, Doug, Khalman, Misha, Reitter, David, Dasgupta, Kingshuk, Sarcar, Shourya, Ornduff, Tina, Snaider, Javier, Huot, Fantine, Jia, Johnson, Kemp, Rupert, Trdin, Nejc, Vijayakumar, Anitha, Kim, Lucy, Angermueller, Christof, Lao, Li, Liu, Tianqi, Zhang, Haibin, Engel, David, Greene, Somer, White, Anaïs, Austin, Jessica, Taylor, Lilly, Ashraf, Shereen, Liu, Dangyi, Georgaki, Maria, Cai, Irene, Kulizhskaya, Yana, Goenka, Sonam, Saeta, Brennan, Xu, Ying, Frank, Christian, de Cesare, Dario, Robenek, Brona, Richardson, Harry, Alnahlawi, Mahmoud, Yew, Christopher, Ponnapalli, Priya, Tagliasacchi, Marco, Korchemniy, Alex, Kim, Yelin, Li, Dinghua, Rosgen, Bill, Levin, Kyle, Wiesner, Jeremy, Banzal, Praseem, Srinivasan, Praveen, Yu, Hongkun, Ünlü, Çağlar, Reid, David, Tung, Zora, Finchelstein, Daniel, Kumar, Ravin, Elisseeff, Andre, Huang, Jin, Zhang, Ming, Aguilar, Ricardo, Giménez, Mai, Xia, Jiawei, Dousse, Olivier, Gierke, Willi, Yates, Damion, Jalan, Komal, Li, Lu, Latorre-Chimoto, Eri, Nguyen, Duc Dung, Durden, Ken, Kallakuri, Praveen, Liu, Yaxin, Johnson, Matthew, Tsai, Tomy, Talbert, Alice, Liu, Jasmine, Neitz, Alexander, Elkind, Chen, Selvi, Marco, Jasarevic, Mimi, Soares, Livio Baldini, Cui, Albert, Wang, Pidong, Wang, Alek Wenjiao, Ye, Xinyu, Kallarackal, Krystal, Loher, Lucia, Lam, Hoi, Broder, Josef, Holtmann-Rice, Dan, Martin, Nina, Ramadhana, Bramandia, Shukla, Mrinal, Basu, Sujoy, Mohan, Abhi, Fernando, Nick, Fiedel, Noah, Paterson, Kim, Li, Hui, Garg, Ankush, Park, Jane, Choi, DongHyun, Wu, Diane, Singh, Sankalp, Zhang, Zhishuai, Globerson, Amir, Yu, Lily, Carpenter, John, Quitry, Félix de Chaumont, Radebaugh, Carey, Lin, Chu-Cheng, Tudor, Alex, Shroff, Prakash, Garmon, Drew, Du, Dayou, Vats, Neera, Lu, Han, Iqbal, Shariq, Yakubovich, Alex, Tripuraneni, Nilesh, Manyika, James, Qureshi, Haroon, Hua, Nan, Ngani, Christel, Raad, Maria Abi, Forbes, Hannah, Stanway, Jeff, Sundararajan, Mukund, Ungureanu, Victor, Bishop, Colton, Li, Yunjie, Venkatraman, Balaji, Li, Bo, Thornton, Chloe, Scellato, Salvatore, Gupta, Nishesh, Wang, Yicheng, Tenney, Ian, Wu, Xihui, Shenoy, Ashish, Carvajal, Gabriel, Wright, Diana Gage, Bariach, Ben, Xiao, Zhuyun, Hawkins, Peter, Dalmia, Sid, Farabet, Clement, Valenzuela, Pedro, Yuan, Quan, Agarwal, Ananth, Chen, Mia, Kim, Wooyeol, Hulse, Brice, Dukkipati, Nandita, Paszke, Adam, Bolt, Andrew, Choo, Kiam, Beattie, Jennifer, Prendki, Jennifer, Vashisht, Harsha, Santamaria-Fernandez, Rebeca, Cobo, Luis C., Wilkiewicz, Jarek, Madras, David, Elqursh, Ali, Uy, Grant, Ramirez, Kevin, Harvey, Matt, Liechty, Tyler, Zen, Heiga, Seibert, Jeff, Hu, Clara Huiyi, Khorlin, Andrey, Le, Maigo, Aharoni, Asaf, Li, Megan, Wang, Lily, Kumar, Sandeep, Casagrande, Norman, Hoover, Jay, Badawy, Dalia El, Soergel, David, Vnukov, Denis, Miecnikowski, Matt, Simsa, Jiri, Kumar, Praveen, Sellam, Thibault, Vlasic, Daniel, Daruki, Samira, Shabat, Nir, Zhang, John, Su, Guolong, Zhang, Jiageng, Liu, Jeremiah, Sun, Yi, Palmer, Evan, Ghaffarkhah, Alireza, Xiong, Xi, Cotruta, Victor, Fink, Michael, Dixon, Lucas, Sreevatsa, Ashwin, Goedeckemeyer, Adrian, Dimitriev, Alek, Jafari, Mohsen, Crocker, Remi, FitzGerald, Nicholas, Kumar, Aviral, Ghemawat, Sanjay, Philips, Ivan, Liu, Frederick, Liang, Yannie, Sterneck, Rachel, Repina, Alena, Wu, Marcus, Knight, Laura, Georgiev, Marin, Lee, Hyo, Askham, Harry, Chakladar, Abhishek, Louis, Annie, Crous, Carl, Cate, Hardie, Petrova, Dessie, Quinn, Michael, Owusu-Afriyie, Denese, Singhal, Achintya, Wei, Nan, Kim, Solomon, Vincent, Damien, Nasr, Milad, Choquette-Choo, Christopher A., Tojo, Reiko, Lu, Shawn, Casas, Diego de Las, Cheng, Yuchung, Bolukbasi, Tolga, Lee, Katherine, Fatehi, Saaber, Ananthanarayanan, Rajagopal, Patel, Miteyan, Kaed, Charbel, Li, Jing, Belle, Shreyas Rammohan, Chen, Zhe, Konzelmann, Jaclyn, Põder, Siim, Garg, Roopal, Koverkathu, Vinod, Brown, Adam, Dyer, Chris, Liu, Rosanne, Nova, Azade, Xu, Jun, Walton, Alanna, Parrish, Alicia, Epstein, Mark, McCarthy, Sara, Petrov, Slav, Hassabis, Demis, Kavukcuoglu, Koray, Dean, Jeffrey, Vinyals, Oriol, Gemini Team, Reid, Machel, Savinov, Nikolay, Teplyashin, Denis, Dmitry, Lepikhin, Lillicrap, Timothy, Alayrac, Jean-baptiste, Soricut, Radu, Lazaridou, Angeliki, Firat, Orhan, Schrittwieser, Julian, Antonoglou, Ioannis, Anil, Rohan, Borgeaud, Sebastian, Dai, Andrew, Millican, Katie, Dyer, Ethan, Glaese, Mia, Sottiaux, Thibault, Lee, Benjamin, Viola, Fabio, Reynolds, Malcolm, Xu, Yuanzhong, Molloy, James, Chen, Jilin, Isard, Michael, Barham, Paul, Hennigan, Tom, McIlroy, Ross, Johnson, Melvin, Schalkwyk, Johan, Collins, Eli, Rutherford, Eliza, Moreira, Erica, Ayoub, Kareem, Goel, Megha, Meyer, Clemens, Thornton, Gregory, Yang, Zhen, Michalewski, Henryk, Abbas, Zaheer, Schucher, Nathan, Anand, Ankesh, Ives, Richard, Keeling, James, Lenc, Karel, Haykal, Salem, Shakeri, Siamak, Shyam, Pranav, Chowdhery, Aakanksha, Ring, Roman, Spencer, Stephen, Sezener, Eren, Vilnis, Luke, Chang, Oscar, Morioka, Nobuyuki, Tucker, George, Zheng, Ce, Woodman, Oliver, Attaluri, Nithya, Kocisky, Tomas, Eltyshev, Evgenii, Chen, Xi, Chung, Timothy, Selo, Vittorio, Brahma, Siddhartha, Georgiev, Petko, Slone, Ambrose, Zhu, Zhenkai, Lottes, James, Qiao, Siyuan, Caine, Ben, Riedel, Sebastian, Tomala, Alex, Chadwick, Martin, Love, Juliette, Choy, Peter, Mittal, Sid, Houlsby, Neil, Tang, Yunhao, Lamm, Matthew, Bai, Libin, Zhang, Qiao, He, Luheng, Cheng, Yong, Humphreys, Peter, Li, Yujia, Brin, Sergey, Cassirer, Albin, Miao, Yingjie, Zilka, Lukas, Tobin, Taylor, Xu, Kelvin, Proleev, Lev, Sohn, Daniel, Magni, Alberto, Hendricks, Lisa Anne, Gao, Isabel, Ontanon, Santiago, Bunyan, Oskar, Byrd, Nathan, Sharma, Abhanshu, Zhang, Biao, Pinto, Mario, Sinha, Rishika, Mehta, Harsh, Jia, Dawei, Caelles, Sergi, Webson, Albert, Morris, Alex, Roelofs, Becca, Ding, Yifan, Strudel, Robin, Xiong, Xuehan, Ritter, Marvin, Dehghani, Mostafa, Chaabouni, Rahma, Karmarkar, Abhijit, Lai, Guangda, Mentzer, Fabian, Xu, Bibo, Li, YaGuang, Zhang, Yujing, Paine, Tom Le, Goldin, Alex, Neyshabur, Behnam, Baumli, Kate, Levskaya, Anselm, Laskin, Michael, Jia, Wenhao, Rae, Jack W., Xiao, Kefan, He, Antoine, Giordano, Skye, Yagati, Lakshman, Lespiau, Jean-Baptiste, Natsev, Paul, Ganapathy, Sanjay, Liu, Fangyu, Martins, Danilo, Chen, Nanxin, Xu, Yunhan, Barnes, Megan, May, Rhys, Vezer, Arpi, Oh, Junhyuk, Franko, Ken, Bridgers, Sophie, Zhao, Ruizhe, Wu, Boxi, Mustafa, Basil, Sechrist, Sean, Parisotto, Emilio, Pillai, Thanumalayan Sankaranarayana, Larkin, Chris, Gu, Chenjie, Sorokin, Christina, Krikun, Maxim, Guseynov, Alexey, Landon, Jessica, Datta, Romina, Pritzel, Alexander, Thacker, Phoebe, Yang, Fan, Hui, Kevin, Hauth, Anja, Yeh, Chih-Kuan, Barker, David, Mao-Jones, Justin, Austin, Sophia, Sheahan, Hannah, Schuh, Parker, Svensson, James, Jain, Rohan, Ramasesh, Vinay, Briukhov, Anton, Chung, Da-Woon, von Glehn, Tamara, Butterfield, Christina, Jhakra, Priya, Wiethoff, Matthew, Frye, Justin, Grimstad, Jordan, Changpinyo, Beer, Lan, Charline Le, Bortsova, Anna, Wu, Yonghui, Voigtlaender, Paul, Sainath, Tara, Gu, Shane, Smith, Charlotte, Hawkins, Will, Cao, Kris, Besley, James, Srinivasan, Srivatsan, Omernick, Mark, Gaffney, Colin, Surita, Gabriela, Burnell, Ryan, Damoc, Bogdan, Ahn, Junwhan, Brock, Andrew, Pajarskas, Mantas, Petrushkina, Anastasia, Noury, Seb, Blanco, Lorenzo, Swersky, Kevin, Ahuja, Arun, Avrahami, Thi, Misra, Vedant, de Liedekerke, Raoul, Iinuma, Mariko, Polozov, Alex, York, Sarah, Driessche, George van den, Michel, Paul, Chiu, Justin, Blevins, Rory, Gleicher, Zach, Recasens, Adrià, Rrustemi, Alban, Gribovskaya, Elena, Roy, Aurko, Gworek, Wiktor, Arnold, Sébastien M. R., Lee, Lisa, Lee-Thorp, James, Maggioni, Marcello, Piqueras, Enrique, Badola, Kartikeya, Vikram, Sharad, Gonzalez, Lucas, Baddepudi, Anirudh, Senter, Evan, Devlin, Jacob, Qin, James, Azzam, Michael, Trebacz, Maja, Polacek, Martin, Krishnakumar, Kashyap, Chang, Shuo-yiin, Tung, Matthew, Penchev, Ivo, Joshi, Rishabh, Olszewska, Kate, Muir, Carrie, Wirth, Mateo, Hartman, Ale Jakse, Newlan, Josh, Kashem, Sheleem, Bolina, Vijay, Dabir, Elahe, van Amersfoort, Joost, Ahmed, Zafarali, Cobon-Kerr, James, Kamath, Aishwarya, Hrafnkelsson, Arnar Mar, Hou, Le, Mackinnon, Ian, Frechette, Alexandre, Noland, Eric, Si, Xiance, Taropa, Emanuel, Li, Dong, Crone, Phil, Gulati, Anmol, Cevey, Sébastien, Adler, Jonas, Ma, Ada, Silver, David, Tokumine, Simon, Powell, Richard, Lee, Stephan, Vodrahalli, Kiran, Hassan, Samer, Mincu, Diana, Yang, Antoine, Levine, Nir, Brennan, Jenny, Wang, Mingqiu, Hodkinson, Sarah, Zhao, Jeffrey, Lipschultz, Josh, Pope, Aedan, Chang, Michael B., Li, Cheng, Shafey, Laurent El, Paganini, Michela, Douglas, Sholto, Bohnet, Bernd, Pardo, Fabio, Odoom, Seth, Rosca, Mihaela, Santos, Cicero Nogueira dos, Soparkar, Kedar, Guez, Arthur, Hudson, Tom, Hansen, Steven, Asawaroengchai, Chulayuth, Addanki, Ravi, Yu, Tianhe, Stokowiec, Wojciech, Khan, Mina, Gilmer, Justin, Lee, Jaehoon, Bostock, Carrie Grimes, Rong, Keran, Caton, Jonathan, Pejman, Pedram, Pavetic, Filip, Brown, Geoff, Sharma, Vivek, Lučić, Mario, Samuel, Rajkumar, Djolonga, Josip, Mandhane, Amol, Sjösund, Lars Lowe, Buchatskaya, Elena, White, Elspeth, Clay, Natalie, Jiang, Jiepu, Lim, Hyeontaek, Hemsley, Ross, Cankara, Zeyncep, Labanowski, Jane, De Cao, Nicola, Steiner, David, Hashemi, Sayed Hadi, Austin, Jacob, Gergely, Anita, Blyth, Tim, Stanton, Joe, Shivakumar, Kaushik, Siddhant, Aditya, Andreassen, Anders, Araya, Carlos, Sethi, Nikhil, Shivanna, Rakesh, Hand, Steven, Bapna, Ankur, Khodaei, Ali, Miech, Antoine, Tanzer, Garrett, Swing, Andy, Thakoor, Shantanu, Aroyo, Lora, Pan, Zhufeng, Nado, Zachary, Sygnowski, Jakub, Winkler, Stephanie, Yu, Dian, Saleh, Mohammad, Maggiore, Loren, Bansal, Yamini, Garcia, Xavier, Kazemi, Mehran, Patil, Piyush, Dasgupta, Ishita, Barr, Iain, Giang, Minh, Kagohara, Thais, Danihelka, Ivo, Marathe, Amit, Feinberg, Vladimir, Elhawaty, Mohamed, Ghelani, Nimesh, Horgan, Dan, Miller, Helen, Walker, Lexi, Tanburn, Richard, Tariq, Mukarram, Shrivastava, Disha, Xia, Fei, Wang, Qingze, Chiu, Chung-Cheng, Ashwood, Zoe, Baatarsukh, Khuslen, Samangooei, Sina, Kaufman, Raphaël Lopez, Alcober, Fred, Stjerngren, Axel, Komarek, Paul, Tsihlas, Katerina, Boral, Anudhyan, Comanescu, Ramona, Chen, Jeremy, Liu, Ruibo, Welty, Chris, Bloxwich, Dawn, Chen, Charlie, Sun, Yanhua, Feng, Fangxiaoyu, Mauger, Matthew, Dotiwalla, Xerxes, Hellendoorn, Vincent, Sharman, Michael, Zheng, Ivy, Haridasan, Krishna, Barth-Maron, Gabe, Swanson, Craig, Rogozińska, Dominika, Andreev, Alek, Rubenstein, Paul Kishan, Sang, Ruoxin, Hurt, Dan, Elsayed, Gamaleldin, Wang, Renshen, Lacey, Dave, Ilić, Anastasija, Zhao, Yao, Iwanicki, Adam, Lince, Alejandro, Chen, Alexander, Lyu, Christina, Lebsack, Carl, Griffith, Jordan, Gaba, Meenu, Sandhu, Paramjit, Chen, Phil, Koop, Anna, Rajwar, Ravi, Yeganeh, Soheil Hassas, Chang, Solomon, Zhu, Rui, Radpour, Soroush, Davoodi, Elnaz, Lei, Ving Ian, Xu, Yang, Toyama, Daniel, Segal, Constant, Wicke, Martin, Lin, Hanzhao, Bulanova, Anna, Badia, Adrià Puigdomènech, Rakićević, Nemanja, Sprechmann, Pablo, Filos, Angelos, Hou, Shaobo, Campos, Víctor, Kassner, Nora, Sachan, Devendra, Fortunato, Meire, Iwuanyanwu, Chimezie, Nikolaev, Vitaly, Lakshminarayanan, Balaji, Jazayeri, Sadegh, Varadarajan, Mani, Tekur, Chetan, Fritz, Doug, Khalman, Misha, Reitter, David, Dasgupta, Kingshuk, Sarcar, Shourya, Ornduff, Tina, Snaider, Javier, Huot, Fantine, Jia, Johnson, Kemp, Rupert, Trdin, Nejc, Vijayakumar, Anitha, Kim, Lucy, Angermueller, Christof, Lao, Li, Liu, Tianqi, Zhang, Haibin, Engel, David, Greene, Somer, White, Anaïs, Austin, Jessica, Taylor, Lilly, Ashraf, Shereen, Liu, Dangyi, Georgaki, Maria, Cai, Irene, Kulizhskaya, Yana, Goenka, Sonam, Saeta, Brennan, Xu, Ying, Frank, Christian, de Cesare, Dario, Robenek, Brona, Richardson, Harry, Alnahlawi, Mahmoud, Yew, Christopher, Ponnapalli, Priya, Tagliasacchi, Marco, Korchemniy, Alex, Kim, Yelin, Li, Dinghua, Rosgen, Bill, Levin, Kyle, Wiesner, Jeremy, Banzal, Praseem, Srinivasan, Praveen, Yu, Hongkun, Ünlü, Çağlar, Reid, David, Tung, Zora, Finchelstein, Daniel, Kumar, Ravin, Elisseeff, Andre, Huang, Jin, Zhang, Ming, Aguilar, Ricardo, Giménez, Mai, Xia, Jiawei, Dousse, Olivier, Gierke, Willi, Yates, Damion, Jalan, Komal, Li, Lu, Latorre-Chimoto, Eri, Nguyen, Duc Dung, Durden, Ken, Kallakuri, Praveen, Liu, Yaxin, Johnson, Matthew, Tsai, Tomy, Talbert, Alice, Liu, Jasmine, Neitz, Alexander, Elkind, Chen, Selvi, Marco, Jasarevic, Mimi, Soares, Livio Baldini, Cui, Albert, Wang, Pidong, Wang, Alek Wenjiao, Ye, Xinyu, Kallarackal, Krystal, Loher, Lucia, Lam, Hoi, Broder, Josef, Holtmann-Rice, Dan, Martin, Nina, Ramadhana, Bramandia, Shukla, Mrinal, Basu, Sujoy, Mohan, Abhi, Fernando, Nick, Fiedel, Noah, Paterson, Kim, Li, Hui, Garg, Ankush, Park, Jane, Choi, DongHyun, Wu, Diane, Singh, Sankalp, Zhang, Zhishuai, Globerson, Amir, Yu, Lily, Carpenter, John, Quitry, Félix de Chaumont, Radebaugh, Carey, Lin, Chu-Cheng, Tudor, Alex, Shroff, Prakash, Garmon, Drew, Du, Dayou, Vats, Neera, Lu, Han, Iqbal, Shariq, Yakubovich, Alex, Tripuraneni, Nilesh, Manyika, James, Qureshi, Haroon, Hua, Nan, Ngani, Christel, Raad, Maria Abi, Forbes, Hannah, Stanway, Jeff, Sundararajan, Mukund, Ungureanu, Victor, Bishop, Colton, Li, Yunjie, Venkatraman, Balaji, Li, Bo, Thornton, Chloe, Scellato, Salvatore, Gupta, Nishesh, Wang, Yicheng, Tenney, Ian, Wu, Xihui, Shenoy, Ashish, Carvajal, Gabriel, Wright, Diana Gage, Bariach, Ben, Xiao, Zhuyun, Hawkins, Peter, Dalmia, Sid, Farabet, Clement, Valenzuela, Pedro, Yuan, Quan, Agarwal, Ananth, Chen, Mia, Kim, Wooyeol, Hulse, Brice, Dukkipati, Nandita, Paszke, Adam, Bolt, Andrew, Choo, Kiam, Beattie, Jennifer, Prendki, Jennifer, Vashisht, Harsha, Santamaria-Fernandez, Rebeca, Cobo, Luis C., Wilkiewicz, Jarek, Madras, David, Elqursh, Ali, Uy, Grant, Ramirez, Kevin, Harvey, Matt, Liechty, Tyler, Zen, Heiga, Seibert, Jeff, Hu, Clara Huiyi, Khorlin, Andrey, Le, Maigo, Aharoni, Asaf, Li, Megan, Wang, Lily, Kumar, Sandeep, Casagrande, Norman, Hoover, Jay, Badawy, Dalia El, Soergel, David, Vnukov, Denis, Miecnikowski, Matt, Simsa, Jiri, Kumar, Praveen, Sellam, Thibault, Vlasic, Daniel, Daruki, Samira, Shabat, Nir, Zhang, John, Su, Guolong, Zhang, Jiageng, Liu, Jeremiah, Sun, Yi, Palmer, Evan, Ghaffarkhah, Alireza, Xiong, Xi, Cotruta, Victor, Fink, Michael, Dixon, Lucas, Sreevatsa, Ashwin, Goedeckemeyer, Adrian, Dimitriev, Alek, Jafari, Mohsen, Crocker, Remi, FitzGerald, Nicholas, Kumar, Aviral, Ghemawat, Sanjay, Philips, Ivan, Liu, Frederick, Liang, Yannie, Sterneck, Rachel, Repina, Alena, Wu, Marcus, Knight, Laura, Georgiev, Marin, Lee, Hyo, Askham, Harry, Chakladar, Abhishek, Louis, Annie, Crous, Carl, Cate, Hardie, Petrova, Dessie, Quinn, Michael, Owusu-Afriyie, Denese, Singhal, Achintya, Wei, Nan, Kim, Solomon, Vincent, Damien, Nasr, Milad, Choquette-Choo, Christopher A., Tojo, Reiko, Lu, Shawn, Casas, Diego de Las, Cheng, Yuchung, Bolukbasi, Tolga, Lee, Katherine, Fatehi, Saaber, Ananthanarayanan, Rajagopal, Patel, Miteyan, Kaed, Charbel, Li, Jing, Belle, Shreyas Rammohan, Chen, Zhe, Konzelmann, Jaclyn, Põder, Siim, Garg, Roopal, Koverkathu, Vinod, Brown, Adam, Dyer, Chris, Liu, Rosanne, Nova, Azade, Xu, Jun, Walton, Alanna, Parrish, Alicia, Epstein, Mark, McCarthy, Sara, Petrov, Slav, Hassabis, Demis, Kavukcuoglu, Koray, Dean, Jeffrey, and Vinyals, Oriol
Abstract: In this report, we present the latest model of the Gemini family, Gemini 1.5 Pro, a highly compute-efficient multimodal mixture-of-experts model capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. Gemini 1.5 Pro achieves near-perfect recall on long-context retrieval tasks across modalities, improves the state-of-the-art in long-document QA, long-video QA and long-context ASR, and matches or surpasses Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5 Pro's long-context ability, we find continued improvement in next-token prediction and near-perfect retrieval (>99%) up to at least 10M tokens, a generational leap over existing models such as Claude 2.1 (200k) and GPT-4 Turbo (128k). Finally, we highlight surprising new capabilities of large language models at the frontier; when given a grammar manual for Kalamang, a language with fewer than 200 speakers worldwide, the model learns to translate English to Kalamang at a similar level to a person who learned from the same content.
Published: 2024

4. Holographic timelike superconductor

Author: Krikun, Alexander, Elinos, Uriel, Krikun, Alexander, and Elinos, Uriel
Abstract: We explore the state of matter characterized by the charged timelike vector order parameter. We employ holographic duality in order to construct such a state and study its thermoelectric transport, fermionic spectral function and the sign of the Meissner effect. We uncover the unusual features of this "timelike superconductor": the absence of the gap in the fermionic spectrum and co-existence of Drude peak and supercurrent in the AC transport, which are reminiscent to those of time-reversal-odd and gapless superconductors, correspondingly. We show that this state is dynamically stable and thermodynamically at least metastable. Along the way we develop the holographic model of the charged vector field, which acquires mass due to a variant of the Stueckelberg mechanism with the adjoint Higgs field., Comment: 18 pages plus appendices
Published: 2023
Full Text: View/download PDF

5. Nodal-antinodal dichotomy from anisotropic quantum critical continua in holographic models

Author: Rodgers, Ronnie, Ghosh, Jewel Kumar, Krikun, Alexander, Rodgers, Ronnie, Ghosh, Jewel Kumar, and Krikun, Alexander
Abstract: We demonstrate that the absence of stable quasiparticle excitations on parts of the Fermi surface, similar to the "nodal-antinodal dichotomy" in underdoped cuprate superconductors, can be reproduced in models of strongly correlated electrons defined via a holographic dual. We show analytically that the anisotropy of the quantum critical continuum, which is a feature of these models, may lead to washing out the quasiparticle peak in one direction while leaving it intact in the perpendicular one. The effect relies on the qualitatively different scaling of the self-energy in different directions. Using the explicit example of the anisotropic Q-lattice model, we demonstrate how this effect emerges due to specific features of the near horizon geometry of the black hole in the dual description.
Published: 2023
Full Text: View/download PDF

6. Nodal-antinodal dichotomy from anisotropic quantum critical continua in holographic models

Author: Rodgers, Ronnie, Ghosh, Jewel Kumar, Krikun, Alexander, Rodgers, Ronnie, Ghosh, Jewel Kumar, and Krikun, Alexander
Abstract: We demonstrate that the absence of stable quasiparticle excitations on parts of the Fermi surface, similar to the "nodal-antinodal dichotomy" in underdoped cuprate su-perconductors, can be reproduced in models of strongly correlated electrons defined via a holographic dual. We show analytically that the anisotropy of the quantum critical continuum, which is a feature of these models, may lead to washing out the quasipar-ticle peak in one direction while leaving it intact in the perpendicular one. The effect relies on the qualitatively different scaling of the self-energy in different directions. Us-ing the explicit example of the anisotropic Q-lattice model, we demonstrate how this effect emerges due to specific features of the near horizon geometry of the black hole in the dual description., QC 20230714
Published: 2023
Full Text: View/download PDF

7. The unreasonable effectiveness of few-shot learning for machine translation

Author: Garcia, Xavier, Bansal, Yamini, Cherry, Colin, Foster, George, Krikun, Maxim, Feng, Fangxiaoyu, Johnson, Melvin, Firat, Orhan, Garcia, Xavier, Bansal, Yamini, Cherry, Colin, Foster, George, Krikun, Maxim, Feng, Fangxiaoyu, Johnson, Melvin, and Firat, Orhan
Abstract: We demonstrate the potential of few-shot translation systems, trained with unpaired language data, for both high and low-resource language pairs. We show that with only 5 examples of high-quality translation data shown at inference, a transformer decoder-only model trained solely with self-supervised learning, is able to match specialized supervised state-of-the-art models as well as more general commercial translation systems. In particular, we outperform the best performing system on the WMT'21 English - Chinese news translation task by only using five examples of English - Chinese parallel data at inference. Moreover, our approach in building these models does not necessitate joint multilingual training or back-translation, is conceptually simple and shows the potential to extend to the multilingual setting. Furthermore, the resulting models are two orders of magnitude smaller than state-of-the-art language models. We then analyze the factors which impact the performance of few-shot translation systems, and highlight that the quality of the few-shot demonstrations heavily determines the quality of the translations generated by our models. Finally, we show that the few-shot paradigm also provides a way to control certain attributes of the translation -- we show that we are able to control for regional varieties and formality using only a five examples at inference, paving the way towards controllable machine translation systems.
Published: 2023

8. PaLM 2 Technical Report

Author: Anil, Rohan, Dai, Andrew M., Firat, Orhan, Johnson, Melvin, Lepikhin, Dmitry, Passos, Alexandre, Shakeri, Siamak, Taropa, Emanuel, Bailey, Paige, Chen, Zhifeng, Chu, Eric, Clark, Jonathan H., Shafey, Laurent El, Huang, Yanping, Meier-Hellstern, Kathy, Mishra, Gaurav, Moreira, Erica, Omernick, Mark, Robinson, Kevin, Ruder, Sebastian, Tay, Yi, Xiao, Kefan, Xu, Yuanzhong, Zhang, Yujing, Abrego, Gustavo Hernandez, Ahn, Junwhan, Austin, Jacob, Barham, Paul, Botha, Jan, Bradbury, James, Brahma, Siddhartha, Brooks, Kevin, Catasta, Michele, Cheng, Yong, Cherry, Colin, Choquette-Choo, Christopher A., Chowdhery, Aakanksha, Crepy, Clément, Dave, Shachi, Dehghani, Mostafa, Dev, Sunipa, Devlin, Jacob, Díaz, Mark, Du, Nan, Dyer, Ethan, Feinberg, Vlad, Feng, Fangxiaoyu, Fienber, Vlad, Freitag, Markus, Garcia, Xavier, Gehrmann, Sebastian, Gonzalez, Lucas, Gur-Ari, Guy, Hand, Steven, Hashemi, Hadi, Hou, Le, Howland, Joshua, Hu, Andrea, Hui, Jeffrey, Hurwitz, Jeremy, Isard, Michael, Ittycheriah, Abe, Jagielski, Matthew, Jia, Wenhao, Kenealy, Kathleen, Krikun, Maxim, Kudugunta, Sneha, Lan, Chang, Lee, Katherine, Lee, Benjamin, Li, Eric, Li, Music, Li, Wei, Li, YaGuang, Li, Jian, Lim, Hyeontaek, Lin, Hanzhao, Liu, Zhongtao, Liu, Frederick, Maggioni, Marcello, Mahendru, Aroma, Maynez, Joshua, Misra, Vedant, Moussalem, Maysam, Nado, Zachary, Nham, John, Ni, Eric, Nystrom, Andrew, Parrish, Alicia, Pellat, Marie, Polacek, Martin, Polozov, Alex, Pope, Reiner, Qiao, Siyuan, Reif, Emily, Richter, Bryan, Riley, Parker, Ros, Alex Castro, Roy, Aurko, Saeta, Brennan, Samuel, Rajkumar, Shelby, Renee, Slone, Ambrose, Smilkov, Daniel, So, David R., Sohn, Daniel, Tokumine, Simon, Valter, Dasha, Vasudevan, Vijay, Vodrahalli, Kiran, Wang, Xuezhi, Wang, Pidong, Wang, Zirui, Wang, Tao, Wieting, John, Wu, Yuhuai, Xu, Kelvin, Xu, Yunhan, Xue, Linting, Yin, Pengcheng, Yu, Jiahui, Zhang, Qiao, Zheng, Steven, Zheng, Ce, Zhou, Weikang, Zhou, Denny, Petrov, Slav, Wu, Yonghui, Anil, Rohan, Dai, Andrew M., Firat, Orhan, Johnson, Melvin, Lepikhin, Dmitry, Passos, Alexandre, Shakeri, Siamak, Taropa, Emanuel, Bailey, Paige, Chen, Zhifeng, Chu, Eric, Clark, Jonathan H., Shafey, Laurent El, Huang, Yanping, Meier-Hellstern, Kathy, Mishra, Gaurav, Moreira, Erica, Omernick, Mark, Robinson, Kevin, Ruder, Sebastian, Tay, Yi, Xiao, Kefan, Xu, Yuanzhong, Zhang, Yujing, Abrego, Gustavo Hernandez, Ahn, Junwhan, Austin, Jacob, Barham, Paul, Botha, Jan, Bradbury, James, Brahma, Siddhartha, Brooks, Kevin, Catasta, Michele, Cheng, Yong, Cherry, Colin, Choquette-Choo, Christopher A., Chowdhery, Aakanksha, Crepy, Clément, Dave, Shachi, Dehghani, Mostafa, Dev, Sunipa, Devlin, Jacob, Díaz, Mark, Du, Nan, Dyer, Ethan, Feinberg, Vlad, Feng, Fangxiaoyu, Fienber, Vlad, Freitag, Markus, Garcia, Xavier, Gehrmann, Sebastian, Gonzalez, Lucas, Gur-Ari, Guy, Hand, Steven, Hashemi, Hadi, Hou, Le, Howland, Joshua, Hu, Andrea, Hui, Jeffrey, Hurwitz, Jeremy, Isard, Michael, Ittycheriah, Abe, Jagielski, Matthew, Jia, Wenhao, Kenealy, Kathleen, Krikun, Maxim, Kudugunta, Sneha, Lan, Chang, Lee, Katherine, Lee, Benjamin, Li, Eric, Li, Music, Li, Wei, Li, YaGuang, Li, Jian, Lim, Hyeontaek, Lin, Hanzhao, Liu, Zhongtao, Liu, Frederick, Maggioni, Marcello, Mahendru, Aroma, Maynez, Joshua, Misra, Vedant, Moussalem, Maysam, Nado, Zachary, Nham, John, Ni, Eric, Nystrom, Andrew, Parrish, Alicia, Pellat, Marie, Polacek, Martin, Polozov, Alex, Pope, Reiner, Qiao, Siyuan, Reif, Emily, Richter, Bryan, Riley, Parker, Ros, Alex Castro, Roy, Aurko, Saeta, Brennan, Samuel, Rajkumar, Shelby, Renee, Slone, Ambrose, Smilkov, Daniel, So, David R., Sohn, Daniel, Tokumine, Simon, Valter, Dasha, Vasudevan, Vijay, Vodrahalli, Kiran, Wang, Xuezhi, Wang, Pidong, Wang, Zirui, Wang, Tao, Wieting, John, Wu, Yuhuai, Xu, Kelvin, Xu, Yunhan, Xue, Linting, Yin, Pengcheng, Yu, Jiahui, Zhang, Qiao, Zheng, Steven, Zheng, Ce, Zhou, Weikang, Zhou, Denny, Petrov, Slav, and Wu, Yonghui
Abstract: We introduce PaLM 2, a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture of objectives. Through extensive evaluations on English and multilingual language, and reasoning tasks, we demonstrate that PaLM 2 has significantly improved quality on downstream tasks across different model sizes, while simultaneously exhibiting faster and more efficient inference compared to PaLM. This improved efficiency enables broader deployment while also allowing the model to respond faster, for a more natural pace of interaction. PaLM 2 demonstrates robust reasoning capabilities exemplified by large improvements over PaLM on BIG-Bench and other reasoning tasks. PaLM 2 exhibits stable performance on a suite of responsible AI evaluations, and enables inference-time control over toxicity without additional overhead or impact on other capabilities. Overall, PaLM 2 achieves state-of-the-art performance across a diverse set of tasks and capabilities. When discussing the PaLM 2 family, it is important to distinguish between pre-trained models (of various sizes), fine-tuned variants of these models, and the user-facing products that use these models. In particular, user-facing products typically include additional pre- and post-processing steps. Additionally, the underlying models may evolve over time. Therefore, one should not expect the performance of user-facing products to exactly match the results reported in this report.
Published: 2023

9. Gemini: A Family of Highly Capable Multimodal Models

Author: Gemini Team, Anil, Rohan, Borgeaud, Sebastian, Alayrac, Jean-Baptiste, Yu, Jiahui, Soricut, Radu, Schalkwyk, Johan, Dai, Andrew M., Hauth, Anja, Millican, Katie, Silver, David, Johnson, Melvin, Antonoglou, Ioannis, Schrittwieser, Julian, Glaese, Amelia, Chen, Jilin, Pitler, Emily, Lillicrap, Timothy, Lazaridou, Angeliki, Firat, Orhan, Molloy, James, Isard, Michael, Barham, Paul R., Hennigan, Tom, Lee, Benjamin, Viola, Fabio, Reynolds, Malcolm, Xu, Yuanzhong, Doherty, Ryan, Collins, Eli, Meyer, Clemens, Rutherford, Eliza, Moreira, Erica, Ayoub, Kareem, Goel, Megha, Krawczyk, Jack, Du, Cosmo, Chi, Ed, Cheng, Heng-Tze, Ni, Eric, Shah, Purvi, Kane, Patrick, Chan, Betty, Faruqui, Manaal, Severyn, Aliaksei, Lin, Hanzhao, Li, YaGuang, Cheng, Yong, Ittycheriah, Abe, Mahdieh, Mahdis, Chen, Mia, Sun, Pei, Tran, Dustin, Bagri, Sumit, Lakshminarayanan, Balaji, Liu, Jeremiah, Orban, Andras, Güra, Fabian, Zhou, Hao, Song, Xinying, Boffy, Aurelien, Ganapathy, Harish, Zheng, Steven, Choe, HyunJeong, Weisz, Ágoston, Zhu, Tao, Lu, Yifeng, Gopal, Siddharth, Kahn, Jarrod, Kula, Maciej, Pitman, Jeff, Shah, Rushin, Taropa, Emanuel, Merey, Majd Al, Baeuml, Martin, Chen, Zhifeng, Shafey, Laurent El, Zhang, Yujing, Sercinoglu, Olcan, Tucker, George, Piqueras, Enrique, Krikun, Maxim, Barr, Iain, Savinov, Nikolay, Danihelka, Ivo, Roelofs, Becca, White, Anaïs, Andreassen, Anders, von Glehn, Tamara, Yagati, Lakshman, Kazemi, Mehran, Gonzalez, Lucas, Khalman, Misha, Sygnowski, Jakub, Frechette, Alexandre, Smith, Charlotte, Culp, Laura, Proleev, Lev, Luan, Yi, Chen, Xi, Lottes, James, Schucher, Nathan, Lebron, Federico, Rrustemi, Alban, Clay, Natalie, Crone, Phil, Kocisky, Tomas, Zhao, Jeffrey, Perz, Bartek, Yu, Dian, Howard, Heidi, Bloniarz, Adam, Rae, Jack W., Lu, Han, Sifre, Laurent, Maggioni, Marcello, Alcober, Fred, Garrette, Dan, Barnes, Megan, Thakoor, Shantanu, Austin, Jacob, Barth-Maron, Gabriel, Wong, William, Joshi, Rishabh, Chaabouni, Rahma, Fatiha, Deeni, Ahuja, Arun, Tomar, Gaurav Singh, Senter, Evan, Chadwick, Martin, Kornakov, Ilya, Attaluri, Nithya, Iturrate, Iñaki, Liu, Ruibo, Li, Yunxuan, Cogan, Sarah, Chen, Jeremy, Jia, Chao, Gu, Chenjie, Zhang, Qiao, Grimstad, Jordan, Hartman, Ale Jakse, Garcia, Xavier, Pillai, Thanumalayan Sankaranarayana, Devlin, Jacob, Laskin, Michael, Casas, Diego de Las, Valter, Dasha, Tao, Connie, Blanco, Lorenzo, Badia, Adrià Puigdomènech, Reitter, David, Chen, Mianna, Brennan, Jenny, Rivera, Clara, Brin, Sergey, Iqbal, Shariq, Surita, Gabriela, Labanowski, Jane, Rao, Abhi, Winkler, Stephanie, Parisotto, Emilio, Gu, Yiming, Olszewska, Kate, Addanki, Ravi, Miech, Antoine, Louis, Annie, Teplyashin, Denis, Brown, Geoff, Catt, Elliot, Balaguer, Jan, Xiang, Jackie, Wang, Pidong, Ashwood, Zoe, Briukhov, Anton, Webson, Albert, Ganapathy, Sanjay, Sanghavi, Smit, Kannan, Ajay, Chang, Ming-Wei, Stjerngren, Axel, Djolonga, Josip, Sun, Yuting, Bapna, Ankur, Aitchison, Matthew, Pejman, Pedram, Michalewski, Henryk, Yu, Tianhe, Wang, Cindy, Love, Juliette, Ahn, Junwhan, Bloxwich, Dawn, Han, Kehang, Humphreys, Peter, Sellam, Thibault, Bradbury, James, Godbole, Varun, Samangooei, Sina, Damoc, Bogdan, Kaskasoli, Alex, Arnold, Sébastien M. R., Vasudevan, Vijay, Agrawal, Shubham, Riesa, Jason, Lepikhin, Dmitry, Tanburn, Richard, Srinivasan, Srivatsan, Lim, Hyeontaek, Hodkinson, Sarah, Shyam, Pranav, Ferret, Johan, Hand, Steven, Garg, Ankush, Paine, Tom Le, Li, Jian, Li, Yujia, Giang, Minh, Neitz, Alexander, Abbas, Zaheer, York, Sarah, Reid, Machel, Cole, Elizabeth, Chowdhery, Aakanksha, Das, Dipanjan, Rogozińska, Dominika, Nikolaev, Vitaliy, Sprechmann, Pablo, Nado, Zachary, Zilka, Lukas, Prost, Flavien, He, Luheng, Monteiro, Marianne, Mishra, Gaurav, Welty, Chris, Newlan, Josh, Jia, Dawei, Allamanis, Miltiadis, Hu, Clara Huiyi, de Liedekerke, Raoul, Gilmer, Justin, Saroufim, Carl, Rijhwani, Shruti, Hou, Shaobo, Shrivastava, Disha, Baddepudi, Anirudh, Goldin, Alex, Ozturel, Adnan, Cassirer, Albin, Xu, Yunhan, Sohn, Daniel, Sachan, Devendra, Amplayo, Reinald Kim, Swanson, Craig, Petrova, Dessie, Narayan, Shashi, Guez, Arthur, Brahma, Siddhartha, Landon, Jessica, Patel, Miteyan, Zhao, Ruizhe, Villela, Kevin, Wang, Luyu, Jia, Wenhao, Rahtz, Matthew, Giménez, Mai, Yeung, Legg, Keeling, James, Georgiev, Petko, Mincu, Diana, Wu, Boxi, Haykal, Salem, Saputro, Rachel, Vodrahalli, Kiran, Qin, James, Cankara, Zeynep, Sharma, Abhanshu, Fernando, Nick, Hawkins, Will, Neyshabur, Behnam, Kim, Solomon, Hutter, Adrian, Agrawal, Priyanka, Castro-Ros, Alex, Driessche, George van den, Wang, Tao, Yang, Fan, Chang, Shuo-yiin, Komarek, Paul, McIlroy, Ross, Lučić, Mario, Zhang, Guodong, Farhan, Wael, Sharman, Michael, Natsev, Paul, Michel, Paul, Bansal, Yamini, Qiao, Siyuan, Cao, Kris, Shakeri, Siamak, Butterfield, Christina, Chung, Justin, Rubenstein, Paul Kishan, Agrawal, Shivani, Mensch, Arthur, Soparkar, Kedar, Lenc, Karel, Chung, Timothy, Pope, Aedan, Maggiore, Loren, Kay, Jackie, Jhakra, Priya, Wang, Shibo, Maynez, Joshua, Phuong, Mary, Tobin, Taylor, Tacchetti, Andrea, Trebacz, Maja, Robinson, Kevin, Katariya, Yash, Riedel, Sebastian, Bailey, Paige, Xiao, Kefan, Ghelani, Nimesh, Aroyo, Lora, Slone, Ambrose, Houlsby, Neil, Xiong, Xuehan, Yang, Zhen, Gribovskaya, Elena, Adler, Jonas, Wirth, Mateo, Lee, Lisa, Li, Music, Kagohara, Thais, Pavagadhi, Jay, Bridgers, Sophie, Bortsova, Anna, Ghemawat, Sanjay, Ahmed, Zafarali, Liu, Tianqi, Powell, Richard, Bolina, Vijay, Iinuma, Mariko, Zablotskaia, Polina, Besley, James, Chung, Da-Woon, Dozat, Timothy, Comanescu, Ramona, Si, Xiance, Greer, Jeremy, Su, Guolong, Polacek, Martin, Kaufman, Raphaël Lopez, Tokumine, Simon, Hu, Hexiang, Buchatskaya, Elena, Miao, Yingjie, Elhawaty, Mohamed, Siddhant, Aditya, Tomasev, Nenad, Xing, Jinwei, Greer, Christina, Miller, Helen, Ashraf, Shereen, Roy, Aurko, Zhang, Zizhao, Ma, Ada, Filos, Angelos, Besta, Milos, Blevins, Rory, Klimenko, Ted, Yeh, Chih-Kuan, Changpinyo, Soravit, Mu, Jiaqi, Chang, Oscar, Pajarskas, Mantas, Muir, Carrie, Cohen, Vered, Lan, Charline Le, Haridasan, Krishna, Marathe, Amit, Hansen, Steven, Douglas, Sholto, Samuel, Rajkumar, Wang, Mingqiu, Austin, Sophia, Lan, Chang, Jiang, Jiepu, Chiu, Justin, Lorenzo, Jaime Alonso, Sjösund, Lars Lowe, Cevey, Sébastien, Gleicher, Zach, Avrahami, Thi, Boral, Anudhyan, Srinivasan, Hansa, Selo, Vittorio, May, Rhys, Aisopos, Konstantinos, Hussenot, Léonard, Soares, Livio Baldini, Baumli, Kate, Chang, Michael B., Recasens, Adrià, Caine, Ben, Pritzel, Alexander, Pavetic, Filip, Pardo, Fabio, Gergely, Anita, Frye, Justin, Ramasesh, Vinay, Horgan, Dan, Badola, Kartikeya, Kassner, Nora, Roy, Subhrajit, Dyer, Ethan, Campos, Víctor Campos, Tomala, Alex, Tang, Yunhao, Badawy, Dalia El, White, Elspeth, Mustafa, Basil, Lang, Oran, Jindal, Abhishek, Vikram, Sharad, Gong, Zhitao, Caelles, Sergi, Hemsley, Ross, Thornton, Gregory, Feng, Fangxiaoyu, Stokowiec, Wojciech, Zheng, Ce, Thacker, Phoebe, Ünlü, Çağlar, Zhang, Zhishuai, Saleh, Mohammad, Svensson, James, Bileschi, Max, Patil, Piyush, Anand, Ankesh, Ring, Roman, Tsihlas, Katerina, Vezer, Arpi, Selvi, Marco, Shevlane, Toby, Rodriguez, Mikel, Kwiatkowski, Tom, Daruki, Samira, Rong, Keran, Dafoe, Allan, FitzGerald, Nicholas, Gu-Lemberg, Keren, Khan, Mina, Hendricks, Lisa Anne, Pellat, Marie, Feinberg, Vladimir, Cobon-Kerr, James, Sainath, Tara, Rauh, Maribeth, Hashemi, Sayed Hadi, Ives, Richard, Hasson, Yana, Noland, Eric, Cao, Yuan, Byrd, Nathan, Hou, Le, Wang, Qingze, Sottiaux, Thibault, Paganini, Michela, Lespiau, Jean-Baptiste, Moufarek, Alexandre, Hassan, Samer, Shivakumar, Kaushik, van Amersfoort, Joost, Mandhane, Amol, Joshi, Pratik, Goyal, Anirudh, Tung, Matthew, Brock, Andrew, Sheahan, Hannah, Misra, Vedant, Li, Cheng, Rakićević, Nemanja, Dehghani, Mostafa, Liu, Fangyu, Mittal, Sid, Oh, Junhyuk, Noury, Seb, Sezener, Eren, Huot, Fantine, Lamm, Matthew, De Cao, Nicola, Chen, Charlie, Mudgal, Sidharth, Stella, Romina, Brooks, Kevin, Vasudevan, Gautam, Liu, Chenxi, Chain, Mainak, Melinkeri, Nivedita, Cohen, Aaron, Wang, Venus, Seymore, Kristie, Zubkov, Sergey, Goel, Rahul, Yue, Summer, Krishnakumaran, Sai, Albert, Brian, Hurley, Nate, Sano, Motoki, Mohananey, Anhad, Joughin, Jonah, Filonov, Egor, Kępa, Tomasz, Eldawy, Yomna, Lim, Jiawern, Rishi, Rahul, Badiezadegan, Shirin, Bos, Taylor, Chang, Jerry, Jain, Sanil, Padmanabhan, Sri Gayatri Sundara, Puttagunta, Subha, Krishna, Kalpesh, Baker, Leslie, Kalb, Norbert, Bedapudi, Vamsi, Kurzrok, Adam, Lei, Shuntong, Yu, Anthony, Litvin, Oren, Zhou, Xiang, Wu, Zhichun, Sobell, Sam, Siciliano, Andrea, Papir, Alan, Neale, Robby, Bragagnolo, Jonas, Toor, Tej, Chen, Tina, Anklin, Valentin, Wang, Feiran, Feng, Richie, Gholami, Milad, Ling, Kevin, Liu, Lijuan, Walter, Jules, Moghaddam, Hamid, Kishore, Arun, Adamek, Jakub, Mercado, Tyler, Mallinson, Jonathan, Wandekar, Siddhinita, Cagle, Stephen, Ofek, Eran, Garrido, Guillermo, Lombriser, Clemens, Mukha, Maksim, Sun, Botu, Mohammad, Hafeezul Rahman, Matak, Josip, Qian, Yadi, Peswani, Vikas, Janus, Pawel, Yuan, Quan, Schelin, Leif, David, Oana, Garg, Ankur, He, Yifan, Duzhyi, Oleksii, Älgmyr, Anton, Lottaz, Timothée, Li, Qi, Yadav, Vikas, Xu, Luyao, Chinien, Alex, Shivanna, Rakesh, Chuklin, Aleksandr, Li, Josie, Spadine, Carrie, Wolfe, Travis, Mohamed, Kareem, Das, Subhabrata, Dai, Zihang, He, Kyle, von Dincklage, Daniel, Upadhyay, Shyam, Maurya, Akanksha, Chi, Luyan, Krause, Sebastian, Salama, Khalid, Rabinovitch, Pam G, M, Pavan Kumar Reddy, Selvan, Aarush, Dektiarev, Mikhail, Ghiasi, Golnaz, Guven, Erdem, Gupta, Himanshu, Liu, Boyi, Sharma, Deepak, Shtacher, Idan Heimlich, Paul, Shachi, Akerlund, Oscar, Aubet, François-Xavier, Huang, Terry, Zhu, Chen, Zhu, Eric, Teixeira, Elico, Fritze, Matthew, Bertolini, Francesco, Marinescu, Liana-Eleonora, Bölle, Martin, Paulus, Dominik, Gupta, Khyatti, Latkar, Tejasi, Chang, Max, Sanders, Jason, Wilson, Roopa, Wu, Xuewei, Tan, Yi-Xuan, Thiet, Lam Nguyen, Doshi, Tulsee, Lall, Sid, Mishra, Swaroop, Chen, Wanming, Luong, Thang, Benjamin, Seth, Lee, Jasmine, Andrejczuk, Ewa, Rabiej, Dominik, Ranjan, Vipul, Styrc, Krzysztof, Yin, Pengcheng, Simon, Jon, Harriott, Malcolm Rose, Bansal, Mudit, Robsky, Alexei, Bacon, Geoff, Greene, David, Mirylenka, Daniil, Zhou, Chen, Sarvana, Obaid, Goyal, Abhimanyu, Andermatt, Samuel, Siegler, Patrick, Horn, Ben, Israel, Assaf, Pongetti, Francesco, Chen, Chih-Wei "Louis", Selvatici, Marco, Silva, Pedro, Wang, Kathie, Tolins, Jackson, Guu, Kelvin, Yogev, Roey, Cai, Xiaochen, Agostini, Alessandro, Shah, Maulik, Nguyen, Hung, Donnaile, Noah Ó, Pereira, Sébastien, Friso, Linda, Stambler, Adam, Kuang, Chenkai, Romanikhin, Yan, Geller, Mark, Yan, ZJ, Jang, Kane, Lee, Cheng-Chun, Fica, Wojciech, Malmi, Eric, Tan, Qijun, Banica, Dan, Balle, Daniel, Pham, Ryan, Huang, Yanping, Avram, Diana, Shi, Hongzhi, Singh, Jasjot, Hidey, Chris, Ahuja, Niharika, Saxena, Pranab, Dooley, Dan, Potharaju, Srividya Pranavi, O'Neill, Eileen, Gokulchandran, Anand, Foley, Ryan, Zhao, Kai, Dusenberry, Mike, Liu, Yuan, Mehta, Pulkit, Kotikalapudi, Ragha, Safranek-Shrader, Chalence, Goodman, Andrew, Kessinger, Joshua, Globen, Eran, Kolhar, Prateek, Gorgolewski, Chris, Ibrahim, Ali, Song, Yang, Eichenbaum, Ali, Brovelli, Thomas, Potluri, Sahitya, Lahoti, Preethi, Baetu, Cip, Ghorbani, Ali, Chen, Charles, Crawford, Andy, Pal, Shalini, Sridhar, Mukund, Gurita, Petru, Mujika, Asier, Petrovski, Igor, Cedoz, Pierre-Louis, Li, Chenmei, Chen, Shiyuan, Santo, Niccolò Dal, Goyal, Siddharth, Punjabi, Jitesh, Kappaganthu, Karthik, Kwak, Chester, LV, Pallavi, Velury, Sarmishta, Choudhury, Himadri, Hall, Jamie, Shah, Premal, Figueira, Ricardo, Thomas, Matt, Lu, Minjie, Zhou, Ting, Kumar, Chintu, Jurdi, Thomas, Chikkerur, Sharat, Ma, Yenai, Yu, Adams, Kwak, Soo, Ähdel, Victor, Rajayogam, Sujeevan, Choma, Travis, Liu, Fei, Barua, Aditya, Ji, Colin, Park, Ji Ho, Hellendoorn, Vincent, Bailey, Alex, Bilal, Taylan, Zhou, Huanjie, Khatir, Mehrdad, Sutton, Charles, Rzadkowski, Wojciech, Macintosh, Fiona, Shagin, Konstantin, Medina, Paul, Liang, Chen, Zhou, Jinjing, Shah, Pararth, Bi, Yingying, Dankovics, Attila, Banga, Shipra, Lehmann, Sabine, Bredesen, Marissa, Lin, Zifan, Hoffmann, John Eric, Lai, Jonathan, Chung, Raynald, Yang, Kai, Balani, Nihal, Bražinskas, Arthur, Sozanschi, Andrei, Hayes, Matthew, Alcalde, Héctor Fernández, Makarov, Peter, Chen, Will, Stella, Antonio, Snijders, Liselotte, Mandl, Michael, Kärrman, Ante, Nowak, Paweł, Wu, Xinyi, Dyck, Alex, Vaidyanathan, Krishnan, R, Raghavender, Mallet, Jessica, Rudominer, Mitch, Johnston, Eric, Mittal, Sushil, Udathu, Akhil, Christensen, Janara, Verma, Vishal, Irving, Zach, Santucci, Andreas, Elsayed, Gamaleldin, Davoodi, Elnaz, Georgiev, Marin, Tenney, Ian, Hua, Nan, Cideron, Geoffrey, Leurent, Edouard, Alnahlawi, Mahmoud, Georgescu, Ionut, Wei, Nan, Zheng, Ivy, Scandinaro, Dylan, Jiang, Heinrich, Snoek, Jasper, Sundararajan, Mukund, Wang, Xuezhi, Ontiveros, Zack, Karo, Itay, Cole, Jeremy, Rajashekhar, Vinu, Tumeh, Lara, Ben-David, Eyal, Jain, Rishub, Uesato, Jonathan, Datta, Romina, Bunyan, Oskar, Wu, Shimu, Zhang, John, Stanczyk, Piotr, Zhang, Ye, Steiner, David, Naskar, Subhajit, Azzam, Michael, Johnson, Matthew, Paszke, Adam, Chiu, Chung-Cheng, Elias, Jaume Sanchez, Mohiuddin, Afroz, Muhammad, Faizan, Miao, Jin, Lee, Andrew, Vieillard, Nino, Park, Jane, Zhang, Jiageng, Stanway, Jeff, Garmon, Drew, Karmarkar, Abhijit, Dong, Zhe, Lee, Jong, Kumar, Aviral, Zhou, Luowei, Evens, Jonathan, Isaac, William, Irving, Geoffrey, Loper, Edward, Fink, Michael, Arkatkar, Isha, Chen, Nanxin, Shafran, Izhak, Petrychenko, Ivan, Chen, Zhe, Jia, Johnson, Levskaya, Anselm, Zhu, Zhenkai, Grabowski, Peter, Mao, Yu, Magni, Alberto, Yao, Kaisheng, Snaider, Javier, Casagrande, Norman, Palmer, Evan, Suganthan, Paul, Castaño, Alfonso, Giannoumis, Irene, Kim, Wooyeol, Rybiński, Mikołaj, Sreevatsa, Ashwin, Prendki, Jennifer, Soergel, David, Goedeckemeyer, Adrian, Gierke, Willi, Jafari, Mohsen, Gaba, Meenu, Wiesner, Jeremy, Wright, Diana Gage, Wei, Yawen, Vashisht, Harsha, Kulizhskaya, Yana, Hoover, Jay, Le, Maigo, Li, Lu, Iwuanyanwu, Chimezie, Liu, Lu, Ramirez, Kevin, Khorlin, Andrey, Cui, Albert, LIN, Tian, Wu, Marcus, Aguilar, Ricardo, Pallo, Keith, Chakladar, Abhishek, Perng, Ginger, Abellan, Elena Allica, Zhang, Mingyang, Dasgupta, Ishita, Kushman, Nate, Penchev, Ivo, Repina, Alena, Wu, Xihui, van der Weide, Tom, Ponnapalli, Priya, Kaplan, Caroline, Simsa, Jiri, Li, Shuangfeng, Dousse, Olivier, Piper, Jeff, Ie, Nathan, Pasumarthi, Rama, Lintz, Nathan, Vijayakumar, Anitha, Andor, Daniel, Valenzuela, Pedro, Lui, Minnie, Paduraru, Cosmin, Peng, Daiyi, Lee, Katherine, Zhang, Shuyuan, Greene, Somer, Nguyen, Duc Dung, Kurylowicz, Paula, Hardin, Cassidy, Dixon, Lucas, Janzer, Lili, Choo, Kiam, Feng, Ziqiang, Zhang, Biao, Singhal, Achintya, Du, Dayou, McKinnon, Dan, Antropova, Natasha, Bolukbasi, Tolga, Keller, Orgad, Reid, David, Finchelstein, Daniel, Raad, Maria Abi, Crocker, Remi, Hawkins, Peter, Dadashi, Robert, Gaffney, Colin, Franko, Ken, Bulanova, Anna, Leblond, Rémi, Chung, Shirley, Askham, Harry, Cobo, Luis C., Xu, Kelvin, Fischer, Felix, Xu, Jun, Sorokin, Christina, Alberti, Chris, Lin, Chu-Cheng, Evans, Colin, Dimitriev, Alek, Forbes, Hannah, Banarse, Dylan, Tung, Zora, Omernick, Mark, Bishop, Colton, Sterneck, Rachel, Jain, Rohan, Xia, Jiawei, Amid, Ehsan, Piccinno, Francesco, Wang, Xingyu, Banzal, Praseem, Mankowitz, Daniel J., Polozov, Alex, Krakovna, Victoria, Brown, Sasha, Bateni, MohammadHossein, Duan, Dennis, Firoiu, Vlad, Thotakuri, Meghana, Natan, Tom, Geist, Matthieu, Girgin, Ser tan, Li, Hui, Ye, Jiayu, Roval, Ofir, Tojo, Reiko, Kwong, Michael, Lee-Thorp, James, Yew, Christopher, Sinopalnikov, Danila, Ramos, Sabela, Mellor, John, Sharma, Abhishek, Wu, Kathy, Miller, David, Sonnerat, Nicolas, Vnukov, Denis, Greig, Rory, Beattie, Jennifer, Caveness, Emily, Bai, Libin, Eisenschlos, Julian, Korchemniy, Alex, Tsai, Tomy, Jasarevic, Mimi, Kong, Weize, Dao, Phuong, Zheng, Zeyu, Liu, Frederick, Zhu, Rui, Teh, Tian Huey, Sanmiya, Jason, Gladchenko, Evgeny, Trdin, Nejc, Toyama, Daniel, Rosen, Evan, Tavakkol, Sasan, Xue, Linting, Elkind, Chen, Woodman, Oliver, Carpenter, John, Papamakarios, George, Kemp, Rupert, Kafle, Sushant, Grunina, Tanya, Sinha, Rishika, Talbert, Alice, Wu, Diane, Owusu-Afriyie, Denese, Thornton, Chloe, Pont-Tuset, Jordi, Narayana, Pradyumna, Li, Jing, Fatehi, Saaber, Wieting, John, Ajmeri, Omar, Uria, Benigno, Ko, Yeongil, Knight, Laura, Héliou, Amélie, Niu, Ning, Gu, Shane, Pang, Chenxi, Li, Yeqing, Levine, Nir, Stolovich, Ariel, Santamaria-Fernandez, Rebeca, Goenka, Sonam, Yustalim, Wenny, Strudel, Robin, Elqursh, Ali, Deck, Charlie, Lee, Hyo, Li, Zonglin, Levin, Kyle, Hoffmann, Raphael, Holtmann-Rice, Dan, Bachem, Olivier, Arora, Sho, Koh, Christy, Yeganeh, Soheil Hassas, Põder, Siim, Tariq, Mukarram, Sun, Yanhua, Ionita, Lucian, Seyedhosseini, Mojtaba, Tafti, Pouya, Liu, Zhiyu, Gulati, Anmol, Liu, Jasmine, Ye, Xinyu, Chrzaszcz, Bart, Wang, Lily, Sethi, Nikhil, Li, Tianrun, Brown, Ben, Singh, Shreya, Fan, Wei, Parisi, Aaron, Stanton, Joe, Koverkathu, Vinod, Choquette-Choo, Christopher A., Li, Yunjie, Lu, TJ, Shroff, Prakash, Varadarajan, Mani, Bahargam, Sanaz, Willoughby, Rob, Gaddy, David, Desjardins, Guillaume, Cornero, Marco, Robenek, Brona, Mittal, Bhavishya, Albrecht, Ben, Shenoy, Ashish, Moiseev, Fedor, Jacobsson, Henrik, Ghaffarkhah, Alireza, Rivière, Morgane, Walton, Alanna, Crepy, Clément, Parrish, Alicia, Zhou, Zongwei, Farabet, Clement, Radebaugh, Carey, Srinivasan, Praveen, van der Salm, Claudia, Fidjeland, Andreas, Scellato, Salvatore, Latorre-Chimoto, Eri, Klimczak-Plucińska, Hanna, Bridson, David, de Cesare, Dario, Hudson, Tom, Mendolicchio, Piermaria, Walker, Lexi, Morris, Alex, Mauger, Matthew, Guseynov, Alexey, Reid, Alison, Odoom, Seth, Loher, Lucia, Cotruta, Victor, Yenugula, Madhavi, Grewe, Dominik, Petrushkina, Anastasia, Duerig, Tom, Sanchez, Antonio, Yadlowsky, Steve, Shen, Amy, Globerson, Amir, Webb, Lynette, Dua, Sahil, Li, Dong, Bhupatiraju, Surya, Hurt, Dan, Qureshi, Haroon, Agarwal, Ananth, Shani, Tomer, Eyal, Matan, Khare, Anuj, Belle, Shreyas Rammohan, Wang, Lei, Tekur, Chetan, Kale, Mihir Sanjay, Wei, Jinliang, Sang, Ruoxin, Saeta, Brennan, Liechty, Tyler, Sun, Yi, Zhao, Yao, Lee, Stephan, Nayak, Pandu, Fritz, Doug, Vuyyuru, Manish Reddy, Aslanides, John, Vyas, Nidhi, Wicke, Martin, Ma, Xiao, Eltyshev, Evgenii, Martin, Nina, Cate, Hardie, Manyika, James, Amiri, Keyvan, Kim, Yelin, Xiong, Xi, Kang, Kai, Luisier, Florian, Tripuraneni, Nilesh, Madras, David, Guo, Mandy, Waters, Austin, Wang, Oliver, Ainslie, Joshua, Baldridge, Jason, Zhang, Han, Pruthi, Garima, Bauer, Jakob, Yang, Feng, Mansour, Riham, Gelman, Jason, Xu, Yang, Polovets, George, Liu, Ji, Cai, Honglong, Chen, Warren, Sheng, XiangHai, Xue, Emily, Ozair, Sherjil, Angermueller, Christof, Li, Xiaowei, Sinha, Anoop, Wang, Weiren, Wiesinger, Julia, Koukoumidis, Emmanouil, Tian, Yuan, Iyer, Anand, Gurumurthy, Madhu, Goldenson, Mark, Shah, Parashar, Blake, MK, Yu, Hongkun, Urbanowicz, Anthony, Palomaki, Jennimaria, Fernando, Chrisantha, Durden, Ken, Mehta, Harsh, Momchev, Nikola, Rahimtoroghi, Elahe, Georgaki, Maria, Raul, Amit, Ruder, Sebastian, Redshaw, Morgan, Lee, Jinhyuk, Zhou, Denny, Jalan, Komal, Li, Dinghua, Hechtman, Blake, Schuh, Parker, Nasr, Milad, Milan, Kieran, Mikulik, Vladimir, Franco, Juliana, Green, Tim, Nguyen, Nam, Kelley, Joe, Mahendru, Aroma, Hu, Andrea, Howland, Joshua, Vargas, Ben, Hui, Jeffrey, Bansal, Kshitij, Rao, Vikram, Ghiya, Rakesh, Wang, Emma, Ye, Ke, Sarr, Jean Michel, Preston, Melanie Moranski, Elish, Madeleine, Li, Steve, Kaku, Aakash, Gupta, Jigar, Pasupat, Ice, Juan, Da-Cheng, Someswar, Milan, M., Tejvi, Chen, Xinyun, Amini, Aida, Fabrikant, Alex, Chu, Eric, Dong, Xuanyi, Muthal, Amruta, Buthpitiya, Senaka, Jauhari, Sarthak, Khandelwal, Urvashi, Hitron, Ayal, Ren, Jie, Rinaldi, Larissa, Drath, Shahar, Dabush, Avigail, Jiang, Nan-Jiang, Godhia, Harshal, Sachs, Uli, Chen, Anthony, Fan, Yicheng, Taitelbaum, Hagai, Noga, Hila, Dai, Zhuyun, Wang, James, Hamer, Jenny, Ferng, Chun-Sung, Elkind, Chenel, Atias, Aviel, Lee, Paulina, Listík, Vít, Carlen, Mathias, van de Kerkhof, Jan, Pikus, Marcin, Zaher, Krunoslav, Müller, Paul, Zykova, Sasha, Stefanec, Richard, Gatsko, Vitaly, Hirnschall, Christoph, Sethi, Ashwin, Xu, Xingyu Federico, Ahuja, Chetan, Tsai, Beth, Stefanoiu, Anca, Feng, Bo, Dhandhania, Keshav, Katyal, Manish, Gupta, Akshay, Parulekar, Atharva, Pitta, Divya, Zhao, Jing, Bhatia, Vivaan, Bhavnani, Yashodha, Alhadlaq, Omar, Li, Xiaolin, Danenberg, Peter, Tu, Dennis, Pine, Alex, Filippova, Vera, Ghosh, Abhipso, Limonchik, Ben, Urala, Bhargava, Lanka, Chaitanya Krishna, Clive, Derik, Li, Edward, Wu, Hao, Hongtongsak, Kevin, Li, Ianna, Thakkar, Kalind, Omarov, Kuanysh, Majmundar, Kushal, Alverson, Michael, Kucharski, Michael, Patel, Mohak, Jain, Mudit, Zabelin, Maksim, Pelagatti, Paolo, Kohli, Rohan, Kumar, Saurabh, Kim, Joseph, Sankar, Swetha, Shah, Vineet, Ramachandruni, Lakshmi, Zeng, Xiangkai, Bariach, Ben, Weidinger, Laura, Vu, Tu, Subramanya, Amar, Hsiao, Sissie, Hassabis, Demis, Kavukcuoglu, Koray, Sadovsky, Adam, Le, Quoc, Strohman, Trevor, Wu, Yonghui, Petrov, Slav, Dean, Jeffrey, Vinyals, Oriol, Gemini Team, Anil, Rohan, Borgeaud, Sebastian, Alayrac, Jean-Baptiste, Yu, Jiahui, Soricut, Radu, Schalkwyk, Johan, Dai, Andrew M., Hauth, Anja, Millican, Katie, Silver, David, Johnson, Melvin, Antonoglou, Ioannis, Schrittwieser, Julian, Glaese, Amelia, Chen, Jilin, Pitler, Emily, Lillicrap, Timothy, Lazaridou, Angeliki, Firat, Orhan, Molloy, James, Isard, Michael, Barham, Paul R., Hennigan, Tom, Lee, Benjamin, Viola, Fabio, Reynolds, Malcolm, Xu, Yuanzhong, Doherty, Ryan, Collins, Eli, Meyer, Clemens, Rutherford, Eliza, Moreira, Erica, Ayoub, Kareem, Goel, Megha, Krawczyk, Jack, Du, Cosmo, Chi, Ed, Cheng, Heng-Tze, Ni, Eric, Shah, Purvi, Kane, Patrick, Chan, Betty, Faruqui, Manaal, Severyn, Aliaksei, Lin, Hanzhao, Li, YaGuang, Cheng, Yong, Ittycheriah, Abe, Mahdieh, Mahdis, Chen, Mia, Sun, Pei, Tran, Dustin, Bagri, Sumit, Lakshminarayanan, Balaji, Liu, Jeremiah, Orban, Andras, Güra, Fabian, Zhou, Hao, Song, Xinying, Boffy, Aurelien, Ganapathy, Harish, Zheng, Steven, Choe, HyunJeong, Weisz, Ágoston, Zhu, Tao, Lu, Yifeng, Gopal, Siddharth, Kahn, Jarrod, Kula, Maciej, Pitman, Jeff, Shah, Rushin, Taropa, Emanuel, Merey, Majd Al, Baeuml, Martin, Chen, Zhifeng, Shafey, Laurent El, Zhang, Yujing, Sercinoglu, Olcan, Tucker, George, Piqueras, Enrique, Krikun, Maxim, Barr, Iain, Savinov, Nikolay, Danihelka, Ivo, Roelofs, Becca, White, Anaïs, Andreassen, Anders, von Glehn, Tamara, Yagati, Lakshman, Kazemi, Mehran, Gonzalez, Lucas, Khalman, Misha, Sygnowski, Jakub, Frechette, Alexandre, Smith, Charlotte, Culp, Laura, Proleev, Lev, Luan, Yi, Chen, Xi, Lottes, James, Schucher, Nathan, Lebron, Federico, Rrustemi, Alban, Clay, Natalie, Crone, Phil, Kocisky, Tomas, Zhao, Jeffrey, Perz, Bartek, Yu, Dian, Howard, Heidi, Bloniarz, Adam, Rae, Jack W., Lu, Han, Sifre, Laurent, Maggioni, Marcello, Alcober, Fred, Garrette, Dan, Barnes, Megan, Thakoor, Shantanu, Austin, Jacob, Barth-Maron, Gabriel, Wong, William, Joshi, Rishabh, Chaabouni, Rahma, Fatiha, Deeni, Ahuja, Arun, Tomar, Gaurav Singh, Senter, Evan, Chadwick, Martin, Kornakov, Ilya, Attaluri, Nithya, Iturrate, Iñaki, Liu, Ruibo, Li, Yunxuan, Cogan, Sarah, Chen, Jeremy, Jia, Chao, Gu, Chenjie, Zhang, Qiao, Grimstad, Jordan, Hartman, Ale Jakse, Garcia, Xavier, Pillai, Thanumalayan Sankaranarayana, Devlin, Jacob, Laskin, Michael, Casas, Diego de Las, Valter, Dasha, Tao, Connie, Blanco, Lorenzo, Badia, Adrià Puigdomènech, Reitter, David, Chen, Mianna, Brennan, Jenny, Rivera, Clara, Brin, Sergey, Iqbal, Shariq, Surita, Gabriela, Labanowski, Jane, Rao, Abhi, Winkler, Stephanie, Parisotto, Emilio, Gu, Yiming, Olszewska, Kate, Addanki, Ravi, Miech, Antoine, Louis, Annie, Teplyashin, Denis, Brown, Geoff, Catt, Elliot, Balaguer, Jan, Xiang, Jackie, Wang, Pidong, Ashwood, Zoe, Briukhov, Anton, Webson, Albert, Ganapathy, Sanjay, Sanghavi, Smit, Kannan, Ajay, Chang, Ming-Wei, Stjerngren, Axel, Djolonga, Josip, Sun, Yuting, Bapna, Ankur, Aitchison, Matthew, Pejman, Pedram, Michalewski, Henryk, Yu, Tianhe, Wang, Cindy, Love, Juliette, Ahn, Junwhan, Bloxwich, Dawn, Han, Kehang, Humphreys, Peter, Sellam, Thibault, Bradbury, James, Godbole, Varun, Samangooei, Sina, Damoc, Bogdan, Kaskasoli, Alex, Arnold, Sébastien M. R., Vasudevan, Vijay, Agrawal, Shubham, Riesa, Jason, Lepikhin, Dmitry, Tanburn, Richard, Srinivasan, Srivatsan, Lim, Hyeontaek, Hodkinson, Sarah, Shyam, Pranav, Ferret, Johan, Hand, Steven, Garg, Ankush, Paine, Tom Le, Li, Jian, Li, Yujia, Giang, Minh, Neitz, Alexander, Abbas, Zaheer, York, Sarah, Reid, Machel, Cole, Elizabeth, Chowdhery, Aakanksha, Das, Dipanjan, Rogozińska, Dominika, Nikolaev, Vitaliy, Sprechmann, Pablo, Nado, Zachary, Zilka, Lukas, Prost, Flavien, He, Luheng, Monteiro, Marianne, Mishra, Gaurav, Welty, Chris, Newlan, Josh, Jia, Dawei, Allamanis, Miltiadis, Hu, Clara Huiyi, de Liedekerke, Raoul, Gilmer, Justin, Saroufim, Carl, Rijhwani, Shruti, Hou, Shaobo, Shrivastava, Disha, Baddepudi, Anirudh, Goldin, Alex, Ozturel, Adnan, Cassirer, Albin, Xu, Yunhan, Sohn, Daniel, Sachan, Devendra, Amplayo, Reinald Kim, Swanson, Craig, Petrova, Dessie, Narayan, Shashi, Guez, Arthur, Brahma, Siddhartha, Landon, Jessica, Patel, Miteyan, Zhao, Ruizhe, Villela, Kevin, Wang, Luyu, Jia, Wenhao, Rahtz, Matthew, Giménez, Mai, Yeung, Legg, Keeling, James, Georgiev, Petko, Mincu, Diana, Wu, Boxi, Haykal, Salem, Saputro, Rachel, Vodrahalli, Kiran, Qin, James, Cankara, Zeynep, Sharma, Abhanshu, Fernando, Nick, Hawkins, Will, Neyshabur, Behnam, Kim, Solomon, Hutter, Adrian, Agrawal, Priyanka, Castro-Ros, Alex, Driessche, George van den, Wang, Tao, Yang, Fan, Chang, Shuo-yiin, Komarek, Paul, McIlroy, Ross, Lučić, Mario, Zhang, Guodong, Farhan, Wael, Sharman, Michael, Natsev, Paul, Michel, Paul, Bansal, Yamini, Qiao, Siyuan, Cao, Kris, Shakeri, Siamak, Butterfield, Christina, Chung, Justin, Rubenstein, Paul Kishan, Agrawal, Shivani, Mensch, Arthur, Soparkar, Kedar, Lenc, Karel, Chung, Timothy, Pope, Aedan, Maggiore, Loren, Kay, Jackie, Jhakra, Priya, Wang, Shibo, Maynez, Joshua, Phuong, Mary, Tobin, Taylor, Tacchetti, Andrea, Trebacz, Maja, Robinson, Kevin, Katariya, Yash, Riedel, Sebastian, Bailey, Paige, Xiao, Kefan, Ghelani, Nimesh, Aroyo, Lora, Slone, Ambrose, Houlsby, Neil, Xiong, Xuehan, Yang, Zhen, Gribovskaya, Elena, Adler, Jonas, Wirth, Mateo, Lee, Lisa, Li, Music, Kagohara, Thais, Pavagadhi, Jay, Bridgers, Sophie, Bortsova, Anna, Ghemawat, Sanjay, Ahmed, Zafarali, Liu, Tianqi, Powell, Richard, Bolina, Vijay, Iinuma, Mariko, Zablotskaia, Polina, Besley, James, Chung, Da-Woon, Dozat, Timothy, Comanescu, Ramona, Si, Xiance, Greer, Jeremy, Su, Guolong, Polacek, Martin, Kaufman, Raphaël Lopez, Tokumine, Simon, Hu, Hexiang, Buchatskaya, Elena, Miao, Yingjie, Elhawaty, Mohamed, Siddhant, Aditya, Tomasev, Nenad, Xing, Jinwei, Greer, Christina, Miller, Helen, Ashraf, Shereen, Roy, Aurko, Zhang, Zizhao, Ma, Ada, Filos, Angelos, Besta, Milos, Blevins, Rory, Klimenko, Ted, Yeh, Chih-Kuan, Changpinyo, Soravit, Mu, Jiaqi, Chang, Oscar, Pajarskas, Mantas, Muir, Carrie, Cohen, Vered, Lan, Charline Le, Haridasan, Krishna, Marathe, Amit, Hansen, Steven, Douglas, Sholto, Samuel, Rajkumar, Wang, Mingqiu, Austin, Sophia, Lan, Chang, Jiang, Jiepu, Chiu, Justin, Lorenzo, Jaime Alonso, Sjösund, Lars Lowe, Cevey, Sébastien, Gleicher, Zach, Avrahami, Thi, Boral, Anudhyan, Srinivasan, Hansa, Selo, Vittorio, May, Rhys, Aisopos, Konstantinos, Hussenot, Léonard, Soares, Livio Baldini, Baumli, Kate, Chang, Michael B., Recasens, Adrià, Caine, Ben, Pritzel, Alexander, Pavetic, Filip, Pardo, Fabio, Gergely, Anita, Frye, Justin, Ramasesh, Vinay, Horgan, Dan, Badola, Kartikeya, Kassner, Nora, Roy, Subhrajit, Dyer, Ethan, Campos, Víctor Campos, Tomala, Alex, Tang, Yunhao, Badawy, Dalia El, White, Elspeth, Mustafa, Basil, Lang, Oran, Jindal, Abhishek, Vikram, Sharad, Gong, Zhitao, Caelles, Sergi, Hemsley, Ross, Thornton, Gregory, Feng, Fangxiaoyu, Stokowiec, Wojciech, Zheng, Ce, Thacker, Phoebe, Ünlü, Çağlar, Zhang, Zhishuai, Saleh, Mohammad, Svensson, James, Bileschi, Max, Patil, Piyush, Anand, Ankesh, Ring, Roman, Tsihlas, Katerina, Vezer, Arpi, Selvi, Marco, Shevlane, Toby, Rodriguez, Mikel, Kwiatkowski, Tom, Daruki, Samira, Rong, Keran, Dafoe, Allan, FitzGerald, Nicholas, Gu-Lemberg, Keren, Khan, Mina, Hendricks, Lisa Anne, Pellat, Marie, Feinberg, Vladimir, Cobon-Kerr, James, Sainath, Tara, Rauh, Maribeth, Hashemi, Sayed Hadi, Ives, Richard, Hasson, Yana, Noland, Eric, Cao, Yuan, Byrd, Nathan, Hou, Le, Wang, Qingze, Sottiaux, Thibault, Paganini, Michela, Lespiau, Jean-Baptiste, Moufarek, Alexandre, Hassan, Samer, Shivakumar, Kaushik, van Amersfoort, Joost, Mandhane, Amol, Joshi, Pratik, Goyal, Anirudh, Tung, Matthew, Brock, Andrew, Sheahan, Hannah, Misra, Vedant, Li, Cheng, Rakićević, Nemanja, Dehghani, Mostafa, Liu, Fangyu, Mittal, Sid, Oh, Junhyuk, Noury, Seb, Sezener, Eren, Huot, Fantine, Lamm, Matthew, De Cao, Nicola, Chen, Charlie, Mudgal, Sidharth, Stella, Romina, Brooks, Kevin, Vasudevan, Gautam, Liu, Chenxi, Chain, Mainak, Melinkeri, Nivedita, Cohen, Aaron, Wang, Venus, Seymore, Kristie, Zubkov, Sergey, Goel, Rahul, Yue, Summer, Krishnakumaran, Sai, Albert, Brian, Hurley, Nate, Sano, Motoki, Mohananey, Anhad, Joughin, Jonah, Filonov, Egor, Kępa, Tomasz, Eldawy, Yomna, Lim, Jiawern, Rishi, Rahul, Badiezadegan, Shirin, Bos, Taylor, Chang, Jerry, Jain, Sanil, Padmanabhan, Sri Gayatri Sundara, Puttagunta, Subha, Krishna, Kalpesh, Baker, Leslie, Kalb, Norbert, Bedapudi, Vamsi, Kurzrok, Adam, Lei, Shuntong, Yu, Anthony, Litvin, Oren, Zhou, Xiang, Wu, Zhichun, Sobell, Sam, Siciliano, Andrea, Papir, Alan, Neale, Robby, Bragagnolo, Jonas, Toor, Tej, Chen, Tina, Anklin, Valentin, Wang, Feiran, Feng, Richie, Gholami, Milad, Ling, Kevin, Liu, Lijuan, Walter, Jules, Moghaddam, Hamid, Kishore, Arun, Adamek, Jakub, Mercado, Tyler, Mallinson, Jonathan, Wandekar, Siddhinita, Cagle, Stephen, Ofek, Eran, Garrido, Guillermo, Lombriser, Clemens, Mukha, Maksim, Sun, Botu, Mohammad, Hafeezul Rahman, Matak, Josip, Qian, Yadi, Peswani, Vikas, Janus, Pawel, Yuan, Quan, Schelin, Leif, David, Oana, Garg, Ankur, He, Yifan, Duzhyi, Oleksii, Älgmyr, Anton, Lottaz, Timothée, Li, Qi, Yadav, Vikas, Xu, Luyao, Chinien, Alex, Shivanna, Rakesh, Chuklin, Aleksandr, Li, Josie, Spadine, Carrie, Wolfe, Travis, Mohamed, Kareem, Das, Subhabrata, Dai, Zihang, He, Kyle, von Dincklage, Daniel, Upadhyay, Shyam, Maurya, Akanksha, Chi, Luyan, Krause, Sebastian, Salama, Khalid, Rabinovitch, Pam G, M, Pavan Kumar Reddy, Selvan, Aarush, Dektiarev, Mikhail, Ghiasi, Golnaz, Guven, Erdem, Gupta, Himanshu, Liu, Boyi, Sharma, Deepak, Shtacher, Idan Heimlich, Paul, Shachi, Akerlund, Oscar, Aubet, François-Xavier, Huang, Terry, Zhu, Chen, Zhu, Eric, Teixeira, Elico, Fritze, Matthew, Bertolini, Francesco, Marinescu, Liana-Eleonora, Bölle, Martin, Paulus, Dominik, Gupta, Khyatti, Latkar, Tejasi, Chang, Max, Sanders, Jason, Wilson, Roopa, Wu, Xuewei, Tan, Yi-Xuan, Thiet, Lam Nguyen, Doshi, Tulsee, Lall, Sid, Mishra, Swaroop, Chen, Wanming, Luong, Thang, Benjamin, Seth, Lee, Jasmine, Andrejczuk, Ewa, Rabiej, Dominik, Ranjan, Vipul, Styrc, Krzysztof, Yin, Pengcheng, Simon, Jon, Harriott, Malcolm Rose, Bansal, Mudit, Robsky, Alexei, Bacon, Geoff, Greene, David, Mirylenka, Daniil, Zhou, Chen, Sarvana, Obaid, Goyal, Abhimanyu, Andermatt, Samuel, Siegler, Patrick, Horn, Ben, Israel, Assaf, Pongetti, Francesco, Chen, Chih-Wei "Louis", Selvatici, Marco, Silva, Pedro, Wang, Kathie, Tolins, Jackson, Guu, Kelvin, Yogev, Roey, Cai, Xiaochen, Agostini, Alessandro, Shah, Maulik, Nguyen, Hung, Donnaile, Noah Ó, Pereira, Sébastien, Friso, Linda, Stambler, Adam, Kuang, Chenkai, Romanikhin, Yan, Geller, Mark, Yan, ZJ, Jang, Kane, Lee, Cheng-Chun, Fica, Wojciech, Malmi, Eric, Tan, Qijun, Banica, Dan, Balle, Daniel, Pham, Ryan, Huang, Yanping, Avram, Diana, Shi, Hongzhi, Singh, Jasjot, Hidey, Chris, Ahuja, Niharika, Saxena, Pranab, Dooley, Dan, Potharaju, Srividya Pranavi, O'Neill, Eileen, Gokulchandran, Anand, Foley, Ryan, Zhao, Kai, Dusenberry, Mike, Liu, Yuan, Mehta, Pulkit, Kotikalapudi, Ragha, Safranek-Shrader, Chalence, Goodman, Andrew, Kessinger, Joshua, Globen, Eran, Kolhar, Prateek, Gorgolewski, Chris, Ibrahim, Ali, Song, Yang, Eichenbaum, Ali, Brovelli, Thomas, Potluri, Sahitya, Lahoti, Preethi, Baetu, Cip, Ghorbani, Ali, Chen, Charles, Crawford, Andy, Pal, Shalini, Sridhar, Mukund, Gurita, Petru, Mujika, Asier, Petrovski, Igor, Cedoz, Pierre-Louis, Li, Chenmei, Chen, Shiyuan, Santo, Niccolò Dal, Goyal, Siddharth, Punjabi, Jitesh, Kappaganthu, Karthik, Kwak, Chester, LV, Pallavi, Velury, Sarmishta, Choudhury, Himadri, Hall, Jamie, Shah, Premal, Figueira, Ricardo, Thomas, Matt, Lu, Minjie, Zhou, Ting, Kumar, Chintu, Jurdi, Thomas, Chikkerur, Sharat, Ma, Yenai, Yu, Adams, Kwak, Soo, Ähdel, Victor, Rajayogam, Sujeevan, Choma, Travis, Liu, Fei, Barua, Aditya, Ji, Colin, Park, Ji Ho, Hellendoorn, Vincent, Bailey, Alex, Bilal, Taylan, Zhou, Huanjie, Khatir, Mehrdad, Sutton, Charles, Rzadkowski, Wojciech, Macintosh, Fiona, Shagin, Konstantin, Medina, Paul, Liang, Chen, Zhou, Jinjing, Shah, Pararth, Bi, Yingying, Dankovics, Attila, Banga, Shipra, Lehmann, Sabine, Bredesen, Marissa, Lin, Zifan, Hoffmann, John Eric, Lai, Jonathan, Chung, Raynald, Yang, Kai, Balani, Nihal, Bražinskas, Arthur, Sozanschi, Andrei, Hayes, Matthew, Alcalde, Héctor Fernández, Makarov, Peter, Chen, Will, Stella, Antonio, Snijders, Liselotte, Mandl, Michael, Kärrman, Ante, Nowak, Paweł, Wu, Xinyi, Dyck, Alex, Vaidyanathan, Krishnan, R, Raghavender, Mallet, Jessica, Rudominer, Mitch, Johnston, Eric, Mittal, Sushil, Udathu, Akhil, Christensen, Janara, Verma, Vishal, Irving, Zach, Santucci, Andreas, Elsayed, Gamaleldin, Davoodi, Elnaz, Georgiev, Marin, Tenney, Ian, Hua, Nan, Cideron, Geoffrey, Leurent, Edouard, Alnahlawi, Mahmoud, Georgescu, Ionut, Wei, Nan, Zheng, Ivy, Scandinaro, Dylan, Jiang, Heinrich, Snoek, Jasper, Sundararajan, Mukund, Wang, Xuezhi, Ontiveros, Zack, Karo, Itay, Cole, Jeremy, Rajashekhar, Vinu, Tumeh, Lara, Ben-David, Eyal, Jain, Rishub, Uesato, Jonathan, Datta, Romina, Bunyan, Oskar, Wu, Shimu, Zhang, John, Stanczyk, Piotr, Zhang, Ye, Steiner, David, Naskar, Subhajit, Azzam, Michael, Johnson, Matthew, Paszke, Adam, Chiu, Chung-Cheng, Elias, Jaume Sanchez, Mohiuddin, Afroz, Muhammad, Faizan, Miao, Jin, Lee, Andrew, Vieillard, Nino, Park, Jane, Zhang, Jiageng, Stanway, Jeff, Garmon, Drew, Karmarkar, Abhijit, Dong, Zhe, Lee, Jong, Kumar, Aviral, Zhou, Luowei, Evens, Jonathan, Isaac, William, Irving, Geoffrey, Loper, Edward, Fink, Michael, Arkatkar, Isha, Chen, Nanxin, Shafran, Izhak, Petrychenko, Ivan, Chen, Zhe, Jia, Johnson, Levskaya, Anselm, Zhu, Zhenkai, Grabowski, Peter, Mao, Yu, Magni, Alberto, Yao, Kaisheng, Snaider, Javier, Casagrande, Norman, Palmer, Evan, Suganthan, Paul, Castaño, Alfonso, Giannoumis, Irene, Kim, Wooyeol, Rybiński, Mikołaj, Sreevatsa, Ashwin, Prendki, Jennifer, Soergel, David, Goedeckemeyer, Adrian, Gierke, Willi, Jafari, Mohsen, Gaba, Meenu, Wiesner, Jeremy, Wright, Diana Gage, Wei, Yawen, Vashisht, Harsha, Kulizhskaya, Yana, Hoover, Jay, Le, Maigo, Li, Lu, Iwuanyanwu, Chimezie, Liu, Lu, Ramirez, Kevin, Khorlin, Andrey, Cui, Albert, LIN, Tian, Wu, Marcus, Aguilar, Ricardo, Pallo, Keith, Chakladar, Abhishek, Perng, Ginger, Abellan, Elena Allica, Zhang, Mingyang, Dasgupta, Ishita, Kushman, Nate, Penchev, Ivo, Repina, Alena, Wu, Xihui, van der Weide, Tom, Ponnapalli, Priya, Kaplan, Caroline, Simsa, Jiri, Li, Shuangfeng, Dousse, Olivier, Piper, Jeff, Ie, Nathan, Pasumarthi, Rama, Lintz, Nathan, Vijayakumar, Anitha, Andor, Daniel, Valenzuela, Pedro, Lui, Minnie, Paduraru, Cosmin, Peng, Daiyi, Lee, Katherine, Zhang, Shuyuan, Greene, Somer, Nguyen, Duc Dung, Kurylowicz, Paula, Hardin, Cassidy, Dixon, Lucas, Janzer, Lili, Choo, Kiam, Feng, Ziqiang, Zhang, Biao, Singhal, Achintya, Du, Dayou, McKinnon, Dan, Antropova, Natasha, Bolukbasi, Tolga, Keller, Orgad, Reid, David, Finchelstein, Daniel, Raad, Maria Abi, Crocker, Remi, Hawkins, Peter, Dadashi, Robert, Gaffney, Colin, Franko, Ken, Bulanova, Anna, Leblond, Rémi, Chung, Shirley, Askham, Harry, Cobo, Luis C., Xu, Kelvin, Fischer, Felix, Xu, Jun, Sorokin, Christina, Alberti, Chris, Lin, Chu-Cheng, Evans, Colin, Dimitriev, Alek, Forbes, Hannah, Banarse, Dylan, Tung, Zora, Omernick, Mark, Bishop, Colton, Sterneck, Rachel, Jain, Rohan, Xia, Jiawei, Amid, Ehsan, Piccinno, Francesco, Wang, Xingyu, Banzal, Praseem, Mankowitz, Daniel J., Polozov, Alex, Krakovna, Victoria, Brown, Sasha, Bateni, MohammadHossein, Duan, Dennis, Firoiu, Vlad, Thotakuri, Meghana, Natan, Tom, Geist, Matthieu, Girgin, Ser tan, Li, Hui, Ye, Jiayu, Roval, Ofir, Tojo, Reiko, Kwong, Michael, Lee-Thorp, James, Yew, Christopher, Sinopalnikov, Danila, Ramos, Sabela, Mellor, John, Sharma, Abhishek, Wu, Kathy, Miller, David, Sonnerat, Nicolas, Vnukov, Denis, Greig, Rory, Beattie, Jennifer, Caveness, Emily, Bai, Libin, Eisenschlos, Julian, Korchemniy, Alex, Tsai, Tomy, Jasarevic, Mimi, Kong, Weize, Dao, Phuong, Zheng, Zeyu, Liu, Frederick, Zhu, Rui, Teh, Tian Huey, Sanmiya, Jason, Gladchenko, Evgeny, Trdin, Nejc, Toyama, Daniel, Rosen, Evan, Tavakkol, Sasan, Xue, Linting, Elkind, Chen, Woodman, Oliver, Carpenter, John, Papamakarios, George, Kemp, Rupert, Kafle, Sushant, Grunina, Tanya, Sinha, Rishika, Talbert, Alice, Wu, Diane, Owusu-Afriyie, Denese, Thornton, Chloe, Pont-Tuset, Jordi, Narayana, Pradyumna, Li, Jing, Fatehi, Saaber, Wieting, John, Ajmeri, Omar, Uria, Benigno, Ko, Yeongil, Knight, Laura, Héliou, Amélie, Niu, Ning, Gu, Shane, Pang, Chenxi, Li, Yeqing, Levine, Nir, Stolovich, Ariel, Santamaria-Fernandez, Rebeca, Goenka, Sonam, Yustalim, Wenny, Strudel, Robin, Elqursh, Ali, Deck, Charlie, Lee, Hyo, Li, Zonglin, Levin, Kyle, Hoffmann, Raphael, Holtmann-Rice, Dan, Bachem, Olivier, Arora, Sho, Koh, Christy, Yeganeh, Soheil Hassas, Põder, Siim, Tariq, Mukarram, Sun, Yanhua, Ionita, Lucian, Seyedhosseini, Mojtaba, Tafti, Pouya, Liu, Zhiyu, Gulati, Anmol, Liu, Jasmine, Ye, Xinyu, Chrzaszcz, Bart, Wang, Lily, Sethi, Nikhil, Li, Tianrun, Brown, Ben, Singh, Shreya, Fan, Wei, Parisi, Aaron, Stanton, Joe, Koverkathu, Vinod, Choquette-Choo, Christopher A., Li, Yunjie, Lu, TJ, Shroff, Prakash, Varadarajan, Mani, Bahargam, Sanaz, Willoughby, Rob, Gaddy, David, Desjardins, Guillaume, Cornero, Marco, Robenek, Brona, Mittal, Bhavishya, Albrecht, Ben, Shenoy, Ashish, Moiseev, Fedor, Jacobsson, Henrik, Ghaffarkhah, Alireza, Rivière, Morgane, Walton, Alanna, Crepy, Clément, Parrish, Alicia, Zhou, Zongwei, Farabet, Clement, Radebaugh, Carey, Srinivasan, Praveen, van der Salm, Claudia, Fidjeland, Andreas, Scellato, Salvatore, Latorre-Chimoto, Eri, Klimczak-Plucińska, Hanna, Bridson, David, de Cesare, Dario, Hudson, Tom, Mendolicchio, Piermaria, Walker, Lexi, Morris, Alex, Mauger, Matthew, Guseynov, Alexey, Reid, Alison, Odoom, Seth, Loher, Lucia, Cotruta, Victor, Yenugula, Madhavi, Grewe, Dominik, Petrushkina, Anastasia, Duerig, Tom, Sanchez, Antonio, Yadlowsky, Steve, Shen, Amy, Globerson, Amir, Webb, Lynette, Dua, Sahil, Li, Dong, Bhupatiraju, Surya, Hurt, Dan, Qureshi, Haroon, Agarwal, Ananth, Shani, Tomer, Eyal, Matan, Khare, Anuj, Belle, Shreyas Rammohan, Wang, Lei, Tekur, Chetan, Kale, Mihir Sanjay, Wei, Jinliang, Sang, Ruoxin, Saeta, Brennan, Liechty, Tyler, Sun, Yi, Zhao, Yao, Lee, Stephan, Nayak, Pandu, Fritz, Doug, Vuyyuru, Manish Reddy, Aslanides, John, Vyas, Nidhi, Wicke, Martin, Ma, Xiao, Eltyshev, Evgenii, Martin, Nina, Cate, Hardie, Manyika, James, Amiri, Keyvan, Kim, Yelin, Xiong, Xi, Kang, Kai, Luisier, Florian, Tripuraneni, Nilesh, Madras, David, Guo, Mandy, Waters, Austin, Wang, Oliver, Ainslie, Joshua, Baldridge, Jason, Zhang, Han, Pruthi, Garima, Bauer, Jakob, Yang, Feng, Mansour, Riham, Gelman, Jason, Xu, Yang, Polovets, George, Liu, Ji, Cai, Honglong, Chen, Warren, Sheng, XiangHai, Xue, Emily, Ozair, Sherjil, Angermueller, Christof, Li, Xiaowei, Sinha, Anoop, Wang, Weiren, Wiesinger, Julia, Koukoumidis, Emmanouil, Tian, Yuan, Iyer, Anand, Gurumurthy, Madhu, Goldenson, Mark, Shah, Parashar, Blake, MK, Yu, Hongkun, Urbanowicz, Anthony, Palomaki, Jennimaria, Fernando, Chrisantha, Durden, Ken, Mehta, Harsh, Momchev, Nikola, Rahimtoroghi, Elahe, Georgaki, Maria, Raul, Amit, Ruder, Sebastian, Redshaw, Morgan, Lee, Jinhyuk, Zhou, Denny, Jalan, Komal, Li, Dinghua, Hechtman, Blake, Schuh, Parker, Nasr, Milad, Milan, Kieran, Mikulik, Vladimir, Franco, Juliana, Green, Tim, Nguyen, Nam, Kelley, Joe, Mahendru, Aroma, Hu, Andrea, Howland, Joshua, Vargas, Ben, Hui, Jeffrey, Bansal, Kshitij, Rao, Vikram, Ghiya, Rakesh, Wang, Emma, Ye, Ke, Sarr, Jean Michel, Preston, Melanie Moranski, Elish, Madeleine, Li, Steve, Kaku, Aakash, Gupta, Jigar, Pasupat, Ice, Juan, Da-Cheng, Someswar, Milan, M., Tejvi, Chen, Xinyun, Amini, Aida, Fabrikant, Alex, Chu, Eric, Dong, Xuanyi, Muthal, Amruta, Buthpitiya, Senaka, Jauhari, Sarthak, Khandelwal, Urvashi, Hitron, Ayal, Ren, Jie, Rinaldi, Larissa, Drath, Shahar, Dabush, Avigail, Jiang, Nan-Jiang, Godhia, Harshal, Sachs, Uli, Chen, Anthony, Fan, Yicheng, Taitelbaum, Hagai, Noga, Hila, Dai, Zhuyun, Wang, James, Hamer, Jenny, Ferng, Chun-Sung, Elkind, Chenel, Atias, Aviel, Lee, Paulina, Listík, Vít, Carlen, Mathias, van de Kerkhof, Jan, Pikus, Marcin, Zaher, Krunoslav, Müller, Paul, Zykova, Sasha, Stefanec, Richard, Gatsko, Vitaly, Hirnschall, Christoph, Sethi, Ashwin, Xu, Xingyu Federico, Ahuja, Chetan, Tsai, Beth, Stefanoiu, Anca, Feng, Bo, Dhandhania, Keshav, Katyal, Manish, Gupta, Akshay, Parulekar, Atharva, Pitta, Divya, Zhao, Jing, Bhatia, Vivaan, Bhavnani, Yashodha, Alhadlaq, Omar, Li, Xiaolin, Danenberg, Peter, Tu, Dennis, Pine, Alex, Filippova, Vera, Ghosh, Abhipso, Limonchik, Ben, Urala, Bhargava, Lanka, Chaitanya Krishna, Clive, Derik, Li, Edward, Wu, Hao, Hongtongsak, Kevin, Li, Ianna, Thakkar, Kalind, Omarov, Kuanysh, Majmundar, Kushal, Alverson, Michael, Kucharski, Michael, Patel, Mohak, Jain, Mudit, Zabelin, Maksim, Pelagatti, Paolo, Kohli, Rohan, Kumar, Saurabh, Kim, Joseph, Sankar, Swetha, Shah, Vineet, Ramachandruni, Lakshmi, Zeng, Xiangkai, Bariach, Ben, Weidinger, Laura, Vu, Tu, Subramanya, Amar, Hsiao, Sissie, Hassabis, Demis, Kavukcuoglu, Koray, Sadovsky, Adam, Le, Quoc, Strohman, Trevor, Wu, Yonghui, Petrov, Slav, Dean, Jeffrey, and Vinyals, Oriol
Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI.
Published: 2023

10. Thermoelectric transport properties of gapless pinned charge density waves

Author: Andrade, Tomas, Krikun, Alexander, Andrade, Tomas, and Krikun, Alexander
Abstract: Quantum strongly correlated matter exhibits properties which are not easily explainable in the conventional framework of Fermi liquids. Universal effective field theory tools are applicable in these cases regardless of the microscopic details of the quantum system, since they are based on symmetries. It is necessary, however, to construct these effective tools in full generality, avoiding restrictions coming from particular microscopic descriptions which may inadequately constrain the coefficients that enter in the effective theory. In this work we demonstrate on explicit examples how the novel hydrodynamic coefficients which have been recently reinstated in the effective theory of pinned charge density waves (CDW) can affect the phenomenology of the thermo-electric transport in strongly correlated quantum matter. Our examples, based on two classes of holographic models with pinned CDW, have microscopics which are conceptually different from Fermi liquids. Therefore, the above novel transport coefficients are nonzero, contrary to the conventional approach. We show how these coefficients allow to take into account the change of sign of the Seebeck coefficient and the low resistivity of the CDW phase of the cuprate high temperature superconductors, without referring to the effects of Fermi surface reconstruction., Comment: 6 pages + supplementary material (v2: published version)
Published: 2022
Full Text: View/download PDF

11. Thermoelectric transport properties of gapless pinned charge density waves

Author: Andrade, Tomas, Krikun, Alexander, Andrade, Tomas, and Krikun, Alexander
Abstract: Quantum strongly correlated matter exhibits properties which are not easily explainable in the conventional framework of Fermi liquids. Universal effective field theory tools are applicable in these cases regardless of the microscopic details of the quantum system, since they are based on symmetries. It is necessary, however, to construct these effective tools in full generality, avoiding restrictions coming from particular microscopic descriptions which may inadequately constrain the coefficients that enter in the effective theory. In this work we demonstrate with explicit examples how the hydrodynamic coefficients, which have been recently reinstated in the effective theory of pinned charge density waves (CDWs), can affect the phenomenology of the thermoelectric transport in strongly correlated quantum matter. Our examples, based on two classes of holographic models with pinned CDW, have microscopics which are conceptually different from Fermi liquids. Therefore, the above transport coefficients are nonzero, contrary to the conventional approach. We show how these coefficients allow one to take into account the change of sign of the Seebeck coefficient and the low resistivity of the CDW phase of the cuprate high temperature superconductors, without referring to the effects of Fermi surface reconstruction.
Published: 2022
Full Text: View/download PDF

12. Thermoelectric transport properties of gapless pinned charge density waves

Author: Andrade, Tomas, Krikun, Alexander, Andrade, Tomas, and Krikun, Alexander
Abstract: Quantum strongly correlated matter exhibits properties which are not easily explainable in the conventional framework of Fermi liquids. Universal effective field theory tools are applicable in these cases regardless of the microscopic details of the quantum system, since they are based on symmetries. It is necessary, however, to construct these effective tools in full generality, avoiding restrictions coming from particular microscopic descriptions which may inadequately constrain the coefficients that enter in the effective theory. In this work we demonstrate on explicit examples how the novel hydrodynamic coefficients which have been recently reinstated in the effective theory of pinned charge density waves (CDW) can affect the phenomenology of the thermo-electric transport in strongly correlated quantum matter. Our examples, based on two classes of holographic models with pinned CDW, have microscopics which are conceptually different from Fermi liquids. Therefore, the above novel transport coefficients are nonzero, contrary to the conventional approach. We show how these coefficients allow to take into account the change of sign of the Seebeck coefficient and the low resistivity of the CDW phase of the cuprate high temperature superconductors, without referring to the effects of Fermi surface reconstruction., Comment: 6 pages + supplementary material (v2: published version)
Published: 2022
Full Text: View/download PDF

13. Nodal-antinodal dichotomy from anisotropic quantum critical continua in holographic models

Author: Rodgers, Ronnie, Ghosh, Jewel Kumar, Krikun, Alexander, Rodgers, Ronnie, Ghosh, Jewel Kumar, and Krikun, Alexander
Abstract: We demonstrate that the absence of stable quasiparticle excitations on parts of the Fermi surface, similar to the "nodal-antinodal dichotomy" in underdoped cuprate superconductors, can be reproduced in models of strongly correlated electrons defined via a holographic dual. We show analytically that the anisotropy of the quantum critical continuum, which is a feature of these models, may lead to washing out the quasiparticle peak in one direction while leaving it intact in the perpendicular one. The effect relies on the qualitatively different scaling of the self-energy in different directions. Using the explicit example of the anisotropic Q-lattice model, we demonstrate how this effect emerges due to specific features of the near horizon geometry of the black hole in the dual description., Comment: 13 pages + appendices. 22 figure files. v2 with expanded references. v3 with minor revisions
Published: 2022
Full Text: View/download PDF

14. Thermoelectric transport properties of gapless pinned charge density waves

Author: Andrade, Tomas, Krikun, Alexander, Andrade, Tomas, and Krikun, Alexander
Abstract: Quantum strongly correlated matter exhibits properties which are not easily explainable in the conventional framework of Fermi liquids. Universal effective field theory tools are applicable in these cases regardless of the microscopic details of the quantum system, since they are based on symmetries. It is necessary, however, to construct these effective tools in full generality, avoiding restrictions coming from particular microscopic descriptions which may inadequately constrain the coefficients that enter in the effective theory. In this work we demonstrate with explicit examples how the hydrodynamic coefficients, which have been recently reinstated in the effective theory of pinned charge density waves (CDWs), can affect the phenomenology of the thermoelectric transport in strongly correlated quantum matter. Our examples, based on two classes of holographic models with pinned CDW, have microscopics which are conceptually different from Fermi liquids. Therefore, the above transport coefficients are nonzero, contrary to the conventional approach. We show how these coefficients allow one to take into account the change of sign of the Seebeck coefficient and the low resistivity of the CDW phase of the cuprate high temperature superconductors, without referring to the effects of Fermi surface reconstruction., QC 20220818
Published: 2022
Full Text: View/download PDF

15. Building Machine Translation Systems for the Next Thousand Languages

Author: Bapna, Ankur, Caswell, Isaac, Kreutzer, Julia, Firat, Orhan, van Esch, Daan, Siddhant, Aditya, Niu, Mengmeng, Baljekar, Pallavi, Garcia, Xavier, Macherey, Wolfgang, Breiner, Theresa, Axelrod, Vera, Riesa, Jason, Cao, Yuan, Chen, Mia Xu, Macherey, Klaus, Krikun, Maxim, Wang, Pidong, Gutkin, Alexander, Shah, Apurva, Huang, Yanping, Chen, Zhifeng, Wu, Yonghui, Hughes, Macduff, Bapna, Ankur, Caswell, Isaac, Kreutzer, Julia, Firat, Orhan, van Esch, Daan, Siddhant, Aditya, Niu, Mengmeng, Baljekar, Pallavi, Garcia, Xavier, Macherey, Wolfgang, Breiner, Theresa, Axelrod, Vera, Riesa, Jason, Cao, Yuan, Chen, Mia Xu, Macherey, Klaus, Krikun, Maxim, Wang, Pidong, Gutkin, Alexander, Shah, Apurva, Huang, Yanping, Chen, Zhifeng, Wu, Yonghui, and Hughes, Macduff
Abstract: In this paper we share findings from our effort to build practical machine translation (MT) systems capable of translating across over one thousand languages. We describe results in three research domains: (i) Building clean, web-mined datasets for 1500+ languages by leveraging semi-supervised pre-training for language identification and developing data-driven filtering techniques; (ii) Developing practical MT models for under-served languages by leveraging massively multilingual models trained with supervised parallel data for over 100 high-resource languages and monolingual datasets for an additional 1000+ languages; and (iii) Studying the limitations of evaluation metrics for these languages and conducting qualitative analysis of the outputs from our MT models, highlighting several frequent error modes of these types of models. We hope that our work provides useful insights to practitioners working towards building MT systems for currently understudied languages, and highlights research directions that can complement the weaknesses of massively multilingual models in data-sparse settings., Comment: V2: updated with some details from 24-language Google Translate launch in May 2022 V3: spelling corrections, additional acknowledgements
Published: 2022

16. Data Scaling Laws in NMT: The Effect of Noise and Architecture

Author: Bansal, Yamini, Ghorbani, Behrooz, Garg, Ankush, Zhang, Biao, Krikun, Maxim, Cherry, Colin, Neyshabur, Behnam, Firat, Orhan, Bansal, Yamini, Ghorbani, Behrooz, Garg, Ankush, Zhang, Biao, Krikun, Maxim, Cherry, Colin, Neyshabur, Behnam, and Firat, Orhan
Abstract: In this work, we study the effect of varying the architecture and training data quality on the data scaling properties of Neural Machine Translation (NMT). First, we establish that the test loss of encoder-decoder transformer models scales as a power law in the number of training samples, with a dependence on the model size. Then, we systematically vary aspects of the training setup to understand how they impact the data scaling laws. In particular, we change the following (1) Architecture and task setup: We compare to a transformer-LSTM hybrid, and a decoder-only transformer with a language modeling loss (2) Noise level in the training distribution: We experiment with filtering, and adding iid synthetic noise. In all the above cases, we find that the data scaling exponents are minimally impacted, suggesting that marginally worse architectures or training data can be compensated for by adding more data. Lastly, we find that using back-translated data instead of parallel data, can significantly degrade the scaling exponent.
Published: 2022

17. LaMDA: Language Models for Dialog Applications

Author: Thoppilan, Romal, De Freitas, Daniel, Hall, Jamie, Shazeer, Noam, Kulshreshtha, Apoorv, Cheng, Heng-Tze, Jin, Alicia, Bos, Taylor, Baker, Leslie, Du, Yu, Li, YaGuang, Lee, Hongrae, Zheng, Huaixiu Steven, Ghafouri, Amin, Menegali, Marcelo, Huang, Yanping, Krikun, Maxim, Lepikhin, Dmitry, Qin, James, Chen, Dehao, Xu, Yuanzhong, Chen, Zhifeng, Roberts, Adam, Bosma, Maarten, Zhao, Vincent, Zhou, Yanqi, Chang, Chung-Ching, Krivokon, Igor, Rusch, Will, Pickett, Marc, Srinivasan, Pranesh, Man, Laichee, Meier-Hellstern, Kathleen, Morris, Meredith Ringel, Doshi, Tulsee, Santos, Renelito Delos, Duke, Toju, Soraker, Johnny, Zevenbergen, Ben, Prabhakaran, Vinodkumar, Diaz, Mark, Hutchinson, Ben, Olson, Kristen, Molina, Alejandra, Hoffman-John, Erin, Lee, Josh, Aroyo, Lora, Rajakumar, Ravi, Butryna, Alena, Lamm, Matthew, Kuzmina, Viktoriya, Fenton, Joe, Cohen, Aaron, Bernstein, Rachel, Kurzweil, Ray, Aguera-Arcas, Blaise, Cui, Claire, Croak, Marian, Chi, Ed, Le, Quoc, Thoppilan, Romal, De Freitas, Daniel, Hall, Jamie, Shazeer, Noam, Kulshreshtha, Apoorv, Cheng, Heng-Tze, Jin, Alicia, Bos, Taylor, Baker, Leslie, Du, Yu, Li, YaGuang, Lee, Hongrae, Zheng, Huaixiu Steven, Ghafouri, Amin, Menegali, Marcelo, Huang, Yanping, Krikun, Maxim, Lepikhin, Dmitry, Qin, James, Chen, Dehao, Xu, Yuanzhong, Chen, Zhifeng, Roberts, Adam, Bosma, Maarten, Zhao, Vincent, Zhou, Yanqi, Chang, Chung-Ching, Krivokon, Igor, Rusch, Will, Pickett, Marc, Srinivasan, Pranesh, Man, Laichee, Meier-Hellstern, Kathleen, Morris, Meredith Ringel, Doshi, Tulsee, Santos, Renelito Delos, Duke, Toju, Soraker, Johnny, Zevenbergen, Ben, Prabhakaran, Vinodkumar, Diaz, Mark, Hutchinson, Ben, Olson, Kristen, Molina, Alejandra, Hoffman-John, Erin, Lee, Josh, Aroyo, Lora, Rajakumar, Ravi, Butryna, Alena, Lamm, Matthew, Kuzmina, Viktoriya, Fenton, Joe, Cohen, Aaron, Bernstein, Rachel, Kurzweil, Ray, Aguera-Arcas, Blaise, Cui, Claire, Croak, Marian, Chi, Ed, and Le, Quoc
Abstract: We present LaMDA: Language Models for Dialog Applications. LaMDA is a family of Transformer-based neural language models specialized for dialog, which have up to 137B parameters and are pre-trained on 1.56T words of public dialog data and web text. While model scaling alone can improve quality, it shows less improvements on safety and factual grounding. We demonstrate that fine-tuning with annotated data and enabling the model to consult external knowledge sources can lead to significant improvements towards the two key challenges of safety and factual grounding. The first challenge, safety, involves ensuring that the model's responses are consistent with a set of human values, such as preventing harmful suggestions and unfair bias. We quantify safety using a metric based on an illustrative set of human values, and we find that filtering candidate responses using a LaMDA classifier fine-tuned with a small amount of crowdworker-annotated data offers a promising approach to improving model safety. The second challenge, factual grounding, involves enabling the model to consult external knowledge sources, such as an information retrieval system, a language translator, and a calculator. We quantify factuality using a groundedness metric, and we find that our approach enables the model to generate responses grounded in known sources, rather than responses that merely sound plausible. Finally, we explore the use of LaMDA in the domains of education and content recommendations, and analyze their helpfulness and role consistency.
Published: 2022

18. Дидактические возможности сюжетно-ролевых игр и театрализации как средство формирования УУД в урочной и внеурочной деятельности

Author: Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Понеделко Алёна Евгеньевна, Ponedelko Aliona Evgenevna, Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Понеделко Алёна Евгеньевна, and Ponedelko Aliona Evgenevna
Abstract: В статье представлены приемы сюжетно-ролевых игр на разных этапах урока и во внеурочной деятельности, описаны как и какие виды игр влияют на формирование познавательных, регулятивных, коммуникативных и личностных учебных действий, представлены конкретные примеры игр и сферы их применения в начальной школе, раскрывается дидактический потенциал театрализации как разновидности игровой имитационной деятельности.
Published: 2021

19. Эффективные приёмы повышения мотивации к обучению на начальных этапах урока в начальной школе

Author: Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Лосик Надежда Семёновна, Losik Nadezhda Semionovna, Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Лосик Надежда Семёновна, and Losik Nadezhda Semionovna
Abstract: Так как мотивация детей считается одной из центральной проблемой современной школы, в статье представлены основные приемы, мотивирующие детей на учебную деятельность на начальных этапах урока с примерами для некоторых уроков начальной школы.
Published: 2021

20. Эффективные приёмы повышения мотивации к обучению на начальных этапах урока в начальной школе

Author: Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Лосик Надежда Семёновна, Losik Nadezhda Semionovna, Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Лосик Надежда Семёновна, and Losik Nadezhda Semionovna
Abstract: Так как мотивация детей считается одной из центральной проблемой современной школы, в статье представлены основные приемы, мотивирующие детей на учебную деятельность на начальных этапах урока с примерами для некоторых уроков начальной школы.
Published: 2021

21. Дидактические возможности сюжетно-ролевых игр и театрализации как средство формирования УУД в урочной и внеурочной деятельности

Author: Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Понеделко Алёна Евгеньевна, Ponedelko Aliona Evgenevna, Крикун Елена Александровна, МБОУ «СОШ №13», Krikun Elena Aleksandrovna, MBOU "SOSh 13", Понеделко Алёна Евгеньевна, and Ponedelko Aliona Evgenevna
Abstract: В статье представлены приемы сюжетно-ролевых игр на разных этапах урока и во внеурочной деятельности, описаны как и какие виды игр влияют на формирование познавательных, регулятивных, коммуникативных и личностных учебных действий, представлены конкретные примеры игр и сферы их применения в начальной школе, раскрывается дидактический потенциал театрализации как разновидности игровой имитационной деятельности.
Published: 2021

22. Phase relaxation and pattern formation in holographic gapless charge density waves

Author: Andrade, Tomas, Baggioli, Matteo, Krikun, Alexander, Andrade, Tomas, Baggioli, Matteo, and Krikun, Alexander
Abstract: We study the dynamics of spontaneous translation symmetry breaking in holographic models in presence of weak explicit sources. We show that, unlike conventional gapped quantum charge density wave systems, this dynamics is well characterized by the effective time dependent Ginzburg-Landau equation, both above and below the critical temperature, which leads to a "gapless" algebraic pattern of metal-insulator phase transition. In this framework we elucidate the nature of the damped Goldstone mode (the phason), which has earlier been identified in the effective hydrodynamic theory of pinned charge density wave and observed in holographic homogeneous lattice models. We follow the motion of the quasinormal modes across the dynamical phase transition in models with either periodic inhomogeneous or helical homogeneous spatial structures, showing that the phase relaxation rate is continuous at the critical temperature. Moreover, we find that the qualitative low-energy dynamics of the broken phase is universal, insensitive to the precise pattern of translation symmetry breaking, and therefore applies to homogeneous models as well., QC 20210629
Published: 2021
Full Text: View/download PDF

23. Phase relaxation and pattern formation in holographic gapless charge density waves

Author: Andrade, Tomas, Baggioli, Matteo, Krikun, Alexander, Andrade, Tomas, Baggioli, Matteo, and Krikun, Alexander
Abstract: We study the dynamics of spontaneous translation symmetry breaking in holographic models in presence of weak explicit sources. We show that, unlike conventional gapped quantum charge density wave systems, this dynamics is well characterized by the effective time dependent Ginzburg-Landau equation, both above and below the critical temperature, which leads to a gapless algebraic pattern of metal-insulator phase transition. In this framework we elucidate the nature of the damped Goldstone mode (the phason), which has earlier been identified in the effective hydrodynamic theory of pinned charge density wave and observed in holographic homogeneous lattice models. We follow the motion of the quasinormal modes across the dynamical phase transition in models with either periodic inhomogeneous or helical homogeneous spatial structures, showing that the phase relaxation rate is continuous at the critical temperature. Moreover, we find that the qualitative low-energy dynamics of the broken phase is universal, insensitive to the precise pattern of translation symmetry breaking, and therefore applies to homogeneous models as well.
Published: 2021
Full Text: View/download PDF

24. Understanding the family among modern student youth

Author: Vladimirovna, Krikun Elena, Manushak Galustovna, Davityan, Irina Aleksandrovna, Belozerova, Natal'ya Nikolaevna, Nikulina, Nadezhda Vladimirovna, Andreeva, Vladimirovna, Krikun Elena, Manushak Galustovna, Davityan, Irina Aleksandrovna, Belozerova, Natal'ya Nikolaevna, Nikulina, and Nadezhda Vladimirovna, Andreeva
Abstract: The article is devoted to the study of the attitude to the family among the students youth of the XXI century. The authors noted that in the hierarchy of values, the family from year to year occupies a leading place among the life priorities of student youth. The work focuses on the study of the problem of regulation of behavior in the family and the formation of parenting strategies. The authorsstudied the attitude of student youth towards types of families and concluded that the leading type of family relations today is the partner type of family. Among the youth, premarital family relationships are widespread, however, young people do not refuse to formalize marriage, they only postpone the official marriage to a later date. The paper notes that the formation of parenting strategies of the younger generation continues to be influenced by the traditional image of a “good mother,” but the concept of fatherhood differs in a certain way from the fatherly strategies of previous generations. In the student environment, the ideas about the role of the father in the family and his qualitative characteristics, which have changed in society, have clearly manifested themselves.
Published: 2021

25. GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

Author: Du, Nan, Huang, Yanping, Dai, Andrew M., Tong, Simon, Lepikhin, Dmitry, Xu, Yuanzhong, Krikun, Maxim, Zhou, Yanqi, Yu, Adams Wei, Firat, Orhan, Zoph, Barret, Fedus, Liam, Bosma, Maarten, Zhou, Zongwei, Wang, Tao, Wang, Yu Emma, Webster, Kellie, Pellat, Marie, Robinson, Kevin, Meier-Hellstern, Kathleen, Duke, Toju, Dixon, Lucas, Zhang, Kun, Le, Quoc V, Wu, Yonghui, Chen, Zhifeng, Cui, Claire, Du, Nan, Huang, Yanping, Dai, Andrew M., Tong, Simon, Lepikhin, Dmitry, Xu, Yuanzhong, Krikun, Maxim, Zhou, Yanqi, Yu, Adams Wei, Firat, Orhan, Zoph, Barret, Fedus, Liam, Bosma, Maarten, Zhou, Zongwei, Wang, Tao, Wang, Yu Emma, Webster, Kellie, Pellat, Marie, Robinson, Kevin, Meier-Hellstern, Kathleen, Duke, Toju, Dixon, Lucas, Zhang, Kun, Le, Quoc V, Wu, Yonghui, Chen, Zhifeng, and Cui, Claire
Abstract: Scaling language models with more data, compute and parameters has driven significant progress in natural language processing. For example, thanks to scaling, GPT-3 was able to achieve strong results on in-context learning tasks. However, training these large dense models requires significant amounts of computing resources. In this paper, we propose and develop a family of language models named GLaM (Generalist Language Model), which uses a sparsely activated mixture-of-experts architecture to scale the model capacity while also incurring substantially less training cost compared to dense variants. The largest GLaM has 1.2 trillion parameters, which is approximately 7x larger than GPT-3. It consumes only 1/3 of the energy used to train GPT-3 and requires half of the computation flops for inference, while still achieving better overall zero-shot and one-shot performance across 29 NLP tasks., Comment: Accepted to ICML 2022
Published: 2021

26. Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference

Author: Kudugunta, Sneha, Huang, Yanping, Bapna, Ankur, Krikun, Maxim, Lepikhin, Dmitry, Luong, Minh-Thang, Firat, Orhan, Kudugunta, Sneha, Huang, Yanping, Bapna, Ankur, Krikun, Maxim, Lepikhin, Dmitry, Luong, Minh-Thang, and Firat, Orhan
Abstract: Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and practitioners often resort to methods such as distillation for serving. In this work, we investigate routing strategies at different granularity (token, sentence, task) in MoE models to bypass distillation. Experiments on WMT and a web-scale dataset suggest that task-level routing (task-MoE) enables us to extract smaller, ready-to-deploy sub-networks from large sparse models. On WMT, our task-MoE with 32 experts (533M parameters) outperforms the best performing token-level MoE model (token-MoE) by +1.0 BLEU on average across 30 language pairs. The peak inference throughput is also improved by a factor of 1.9x when we route by tasks instead of tokens. While distilling a token-MoE to a smaller dense model preserves only 32% of the BLEU gains, our sub-network task-MoE, by design, preserves all the gains with the same inference cost as the distilled student model. Finally, when scaling up to 200 language pairs, our 128-expert task-MoE (13B parameters) performs competitively with a token-level counterpart, while improving the peak inference throughput by a factor of 2.6x., Comment: EMNLP Findings 2021
Published: 2021

27. Scaling Laws for Neural Machine Translation

Author: Ghorbani, Behrooz, Firat, Orhan, Freitag, Markus, Bapna, Ankur, Krikun, Maxim, Garcia, Xavier, Chelba, Ciprian, Cherry, Colin, Ghorbani, Behrooz, Firat, Orhan, Freitag, Markus, Bapna, Ankur, Krikun, Maxim, Garcia, Xavier, Chelba, Ciprian, and Cherry, Colin
Abstract: We present an empirical study of scaling properties of encoder-decoder Transformer models used in neural machine translation (NMT). We show that cross-entropy loss as a function of model size follows a certain scaling law. Specifically (i) We propose a formula which describes the scaling behavior of cross-entropy loss as a bivariate function of encoder and decoder size, and show that it gives accurate predictions under a variety of scaling approaches and languages; we show that the total number of parameters alone is not sufficient for such purposes. (ii) We observe different power law exponents when scaling the decoder vs scaling the encoder, and provide recommendations for optimal allocation of encoder/decoder capacity based on this observation. (iii) We also report that the scaling behavior of the model is acutely influenced by composition bias of the train/test sets, which we define as any deviation from naturally generated text (either via machine generated or human translated text). We observe that natural text on the target side enjoys scaling, which manifests as successful reduction of the cross-entropy loss. (iv) Finally, we investigate the relationship between the cross-entropy loss and the quality of the generated translations. We find two different behaviors, depending on the nature of the test data. For test sets which were originally translated from target language to source language, both loss and BLEU score improve as model size increases. In contrast, for test sets originally translated from source language to target language, the loss improves, but the BLEU score stops improving after a certain threshold. We release generated text from all models used in this study., Comment: 31 pages, 23 figures
Published: 2021

28. GSPMD: General and Scalable Parallelization for ML Computation Graphs

Author: Xu, Yuanzhong, Lee, HyoukJoong, Chen, Dehao, Hechtman, Blake, Huang, Yanping, Joshi, Rahul, Krikun, Maxim, Lepikhin, Dmitry, Ly, Andy, Maggioni, Marcello, Pang, Ruoming, Shazeer, Noam, Wang, Shibo, Wang, Tao, Wu, Yonghui, Chen, Zhifeng, Xu, Yuanzhong, Lee, HyoukJoong, Chen, Dehao, Hechtman, Blake, Huang, Yanping, Joshi, Rahul, Krikun, Maxim, Lepikhin, Dmitry, Ly, Andy, Maggioni, Marcello, Pang, Ruoming, Shazeer, Noam, Wang, Shibo, Wang, Tao, Wu, Yonghui, and Chen, Zhifeng
Abstract: We present GSPMD, an automatic, compiler-based parallelization system for common machine learning computations. It allows users to write programs in the same way as for a single device, then give hints through a few annotations on how to distribute tensors, based on which GSPMD will parallelize the computation. Its representation of partitioning is simple yet general, allowing it to express different or mixed paradigms of parallelism on a wide variety of models. GSPMD infers the partitioning for every operator based on limited user annotations, making it convenient to scale existing single-device programs. It solves several technical challenges for production usage, allowing GSPMD to achieve 50% to 62% compute utilization on up to 2048 Cloud TPUv3 cores for models with up to one trillion parameters.
Published: 2021

29. Phase relaxation and pattern formation in holographic gapless charge density waves

Author: Andrade, Tomas, Baggioli, Matteo, Krikun, Alexander, Andrade, Tomas, Baggioli, Matteo, and Krikun, Alexander
Abstract: We study the dynamics of spontaneous translation symmetry breaking in holographic models in presence of weak explicit sources. We show that, unlike conventional gapped quantum charge density wave systems, this dynamics is well characterized by the effective time dependent Ginzburg-Landau equation, both above and below the critical temperature, which leads to a "gapless" algebraic pattern of metal-insulator phase transition. In this framework we elucidate the nature of the damped Goldstone mode (the phason), which has earlier been identified in the effective hydrodynamic theory of pinned charge density wave and observed in holographic homogeneous lattice models. We follow the motion of the quasinormal modes across the dynamical phase transition in models with either periodic inhomogeneous or helical homogeneous spatial structures, showing that the phase relaxation rate is continuous at the critical temperature. Moreover, we find that the qualitative low-energy dynamics of the broken phase is universal, insensitive to the precise pattern of translation symmetry breaking, and therefore applies to homogeneous models as well., Comment: 25 pages + appendices, 13 figures
Published: 2020
Full Text: View/download PDF

30. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter.
Published: 2020
Full Text: View/download PDF

31. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter.
Published: 2020
Full Text: View/download PDF

32. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter.
Published: 2020
Full Text: View/download PDF

33. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, A.A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, A.A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: Contains fulltext : 216782.pdf (publisher's version ) (Open Access)
Published: 2020

34. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, A.A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, A.A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: Contains fulltext : 216782.pdf (publisher's version ) (Open Access)
Published: 2020

35. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, A.A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, A.A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: Contains fulltext : 216782.pdf (publisher's version ) (Open Access)
Published: 2020

36. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter.
Published: 2020
Full Text: View/download PDF

37. GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding

Author: Lepikhin, Dmitry, Lee, HyoukJoong, Xu, Yuanzhong, Chen, Dehao, Firat, Orhan, Huang, Yanping, Krikun, Maxim, Shazeer, Noam, Chen, Zhifeng, Lepikhin, Dmitry, Lee, HyoukJoong, Xu, Yuanzhong, Chen, Dehao, Firat, Orhan, Huang, Yanping, Krikun, Maxim, Shazeer, Noam, and Chen, Zhifeng
Abstract: Neural network scaling has been critical for improving the model quality in many real-world machine learning applications with vast amounts of training data and compute. Although this trend of scaling is affirmed to be a sure-fire approach for better model quality, there are challenges on the path such as the computation cost, ease of programming, and efficient implementation on parallel devices. GShard is a module composed of a set of lightweight annotation APIs and an extension to the XLA compiler. It provides an elegant way to express a wide range of parallel computation patterns with minimal changes to the existing model code. GShard enabled us to scale up multilingual neural machine translation Transformer model with Sparsely-Gated Mixture-of-Experts beyond 600 billion parameters using automatic sharding. We demonstrate that such a giant model can efficiently be trained on 2048 TPU v3 accelerators in 4 days to achieve far superior quality for translation from 100 languages to English compared to the prior art.
Published: 2020

38. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter.
Published: 2020
Full Text: View/download PDF

39. Widely distributed breeding populations of Canada warbler (Cardellina canadensis) converge on migration through Central America

Author: Roberto-Charron, A., Kennedy, J., Reitsma, L., Tremblay, J. A., Krikun, R., Hobson, K. A., Ibarzabal, Jacques, Fraser, K. C., Roberto-Charron, A., Kennedy, J., Reitsma, L., Tremblay, J. A., Krikun, R., Hobson, K. A., Ibarzabal, Jacques, and Fraser, K. C.
Abstract: Background To effectively conserve migratory species, the entire range encompassed by their annual life cycle needs to be considered. Most research on Nearctic-Neotropical migratory birds has focused on the breeding grounds resulting in a general lack of knowledge regarding the wintering and migratory periods. The Canada Warbler (Cardellina canadensis) has declined by 71% from 1970 to 2012, at a rate of 2.9% per year, and is listed as Threatened in Canada. As with most Nearctic-Neotropical migrants, conservation efforts outside the breeding range are limited by a poor understanding of migration routes and the connectivity between specific breeding and wintering populations. Results To determine migratory routes of multiple breeding populations of Canada Warblers, we directly-tracked individuals using light-level geolocators deployed at four sites across the breeding range, spanning approximately 43 degrees in longitude (Alberta, Manitoba and Québec, Canada, and New Hampshire, USA). Twenty-five geolocators with usable data were recovered from three sites and were analyzed using FlightR to determine fall migration routes (n = 18) and individual wintering sites (n = 25). Individuals from all breeding populations took a western fall migration route at the Gulf of Mexico; with 77.8% of birds funnelling into a narrow geographic space along the western side of the Gulf of Mexico (97°W-99°W). We found no evidence for population-specific, parallel migration routes. Most individuals (72%) overwintered in Colombia. The remaining individuals overwintered in Venezuela. Conclusions Our results demonstrate convergence of migratory routes around a migration barrier for individuals originating from widely distributed breeding areas. Further, we suggest the potential importance of habitat around the Gulf of Mexico during migration and Andean forest in Colombia as overwintering habitat for this threatened species. Future research should be directed at understanding how these areas are
Published: 2020
Full Text: View/download PDF

40. Isolated zeros destroy Fermi surface in holographic models with a lattice

Author: Balm, Floris, Krikun, Alexander, Romero-Bermúdez, Aurelio, Schalm, Koenraad, Zaanen, Jan, Balm, Floris, Krikun, Alexander, Romero-Bermúdez, Aurelio, Schalm, Koenraad, and Zaanen, Jan
Abstract: We study the fermionic spectral density in a strongly correlated quantum system described by a gravity dual. In the presence of periodically modulated chemical potential, which models the effect of the ionic lattice, we explore the shapes of the corresponding Fermi surfaces, defined by the location of peaks in the spectral density at the Fermi level. We find that at strong lattice potentials sectors of the Fermi surface are unexpectedly destroyed and the Fermi surface becomes an arc-like disconnected manifold. We explain this phenomenon in terms of a collision of the Fermi surface pole with zeros of the fermionic Green's function, which are explicitly computable in the holographic dual., Comment: 24 pages, 10 figures, plus appendices; v2: references added
Published: 2019
Full Text: View/download PDF

41. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter., Comment: 25 pages, 17 figures
Published: 2019
Full Text: View/download PDF

42. Charge density response and fake plasmons in holographic models with strong translation symmetry breaking

Author: Andrade, Tomas, Krikun, Alexander, Romero-Bermúdez, Aurelio, Andrade, Tomas, Krikun, Alexander, and Romero-Bermúdez, Aurelio
Abstract: We study the charge density response in holographic models with explicit translation symmetry breaking which is relevant in IR. In particular, we focus on Q-lattices and the Bianchy VII helix. We show that the hydrodynamic sound mode is removed from the spectrum due to the strong momentum relaxation and therefore, the usual treatment of the plasmon as Coulomb-dressed zero sound does not apply. Furthermore, the dominant coherent modes in the longitudinal channel, which control the neutral density-density correlator, are diffusive. We show these modes are strongly suppressed when the boundary Coulomb interaction is turned on. This renders the low frequency charge density response spectrum completely incoherent and featureless. At intermediate frequencies, we observe a broad feature -- the fake plasmon -- in the dressed correlator, which could be confused with an overdamped plasmon. However, its gap is set by the scale of translation symmetry breaking instead of the plasma frequency. This broad feature originates from the non-hydrodynamic sector of the holographic spectrum, and therefore, its behaviour, typical of strongly correlated quantum critical systems with holographic duals, deviates from the standard Fermi-liquid paradigm., Comment: Published version, fake plasmons in insulating Q-lattice and Helix
Published: 2019
Full Text: View/download PDF

43. Relaxation regimes of the holographic electrons at charge neutrality after a local quench of chemical potential

Author: Krikun, Alexander and Krikun, Alexander
Abstract: In this work we study the relaxation of the system of strongly correlated electrons, at charge neutrality, when the chemical potential undergoes a local change. This setup is a model for for the X-ray absorbtion edge study in the half-filled graphene. We use holographic duality to describe the system as a classical Schwarzschild black hole in curved 4-dimensional AdS spacetime. Assuming the amplitude of the quench is small, we neglect the backreaction on the geometry. We numerically study the two relaxation regimes: the adiabatic relaxation when the quench is slow and the relaxation governed by the quasinormal modes of the system, when the quench is fast. We confirm the expectation that the scale of separation between the slow and fast regimes is set by the characteristic frequency of the quasinormal modes., Comment: 11 pages, 5 figures; v2: references updated, treatment of scales improved; v3: technical mistakes corrected, treatment of QNMs improved; v4: treatment of evolution equation improved, Bessel analysis added, journal accepted version
Published: 2019
Full Text: View/download PDF

44. Anisotropic destruction of the Fermi surface in inhomogeneous holographic lattices

Author: Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., Krikun, Alexander, Iliasov, Askar, Bagrov, Andrey A., Katsnelson, Mikhail I., and Krikun, Alexander
Abstract: We analyze fermionic response of strongly correlated holographic matter in presence of inhomogeneous periodically modulated potential mimicking the crystal lattice. The modulation is sourced by a scalar operator that explicitly breaks the translational symmetry in one direction. We compute the fermion spectral function and show that it either exhibits a well defined Fermi surface with umklapp gaps opening on the Brillouin zone boundary at small lattice wave vector, or, when the wave vector is large, the Fermi surface is anisotropically deformed and the quasiparticles get significantly broadened in the direction of translation symmetry breaking. Making use of the ability of our model to smoothly extrapolate to the homogeneous Q-lattice like setup, we show that this novel effect is not due to the periodic modulation of the potential and Umklapp physics, but rather due to the anisotropic features of the holographic horizon. That means it encodes novel physics of strongly correlated critical systems which may be relevant for phenomenology of exotic states of electron matter., Comment: 25 pages, 17 figures
Published: 2019
Full Text: View/download PDF

45. Charge density response and fake plasmons in holographic models with strong translation symmetry breaking

Author: Andrade, Tomas, Krikun, Alexander, Romero-Bermúdez, Aurelio, Andrade, Tomas, Krikun, Alexander, and Romero-Bermúdez, Aurelio
Abstract: We study the charge density response in holographic models with explicit translation symmetry breaking which is relevant in IR. In particular, we focus on Q-lattices and the Bianchy VII helix. We show that the hydrodynamic sound mode is removed from the spectrum due to the strong momentum relaxation and therefore, the usual treatment of the plasmon as Coulomb-dressed zero sound does not apply. Furthermore, the dominant coherent modes in the longitudinal channel, which control the neutral density-density correlator, are diffusive. We show these modes are strongly suppressed when the boundary Coulomb interaction is turned on. This renders the low frequency charge density response spectrum completely incoherent and featureless. At intermediate frequencies, we observe a broad feature -- the fake plasmon -- in the dressed correlator, which could be confused with an overdamped plasmon. However, its gap is set by the scale of translation symmetry breaking instead of the plasma frequency. This broad feature originates from the non-hydrodynamic sector of the holographic spectrum, and therefore, its behaviour, typical of strongly correlated quantum critical systems with holographic duals, deviates from the standard Fermi-liquid paradigm., Comment: Published version, fake plasmons in insulating Q-lattice and Helix
Published: 2019
Full Text: View/download PDF

46. Isolated zeros destroy Fermi surface in holographic models with a lattice

Author: Balm, Floris, Krikun, Alexander, Romero-Bermúdez, Aurelio, Schalm, Koenraad, Zaanen, Jan, Balm, Floris, Krikun, Alexander, Romero-Bermúdez, Aurelio, Schalm, Koenraad, and Zaanen, Jan
Abstract: We study the fermionic spectral density in a strongly correlated quantum system described by a gravity dual. In the presence of periodically modulated chemical potential, which models the effect of the ionic lattice, we explore the shapes of the corresponding Fermi surfaces, defined by the location of peaks in the spectral density at the Fermi level. We find that at strong lattice potentials sectors of the Fermi surface are unexpectedly destroyed and the Fermi surface becomes an arc-like disconnected manifold. We explain this phenomenon in terms of a collision of the Fermi surface pole with zeros of the fermionic Green's function, which are explicitly computable in the holographic dual., Comment: 24 pages, 10 figures, plus appendices; v2: references added
Published: 2019
Full Text: View/download PDF

47. Relaxation regimes of the holographic electrons at charge neutrality after a local quench of chemical potential

Author: Krikun, Alexander and Krikun, Alexander
Abstract: In this work we study the relaxation of the system of strongly correlated electrons, at charge neutrality, when the chemical potential undergoes a local change. This setup is a model for for the X-ray absorbtion edge study in the half-filled graphene. We use holographic duality to describe the system as a classical Schwarzschild black hole in curved 4-dimensional AdS spacetime. Assuming the amplitude of the quench is small, we neglect the backreaction on the geometry. We numerically study the two relaxation regimes: the adiabatic relaxation when the quench is slow and the relaxation governed by the quasinormal modes of the system, when the quench is fast. We confirm the expectation that the scale of separation between the slow and fast regimes is set by the characteristic frequency of the quasinormal modes., Comment: 11 pages, 5 figures; v2: references updated, treatment of scales improved; v3: technical mistakes corrected, treatment of QNMs improved; v4: treatment of evolution equation improved, Bessel analysis added, journal accepted version
Published: 2019
Full Text: View/download PDF

48. The evolution of corporate culture in the social and economic transformation

Author: Viktorovna Tabunshchikova, Lyudmila, Pavlovna, Ivanova Galina, Vladimirovna, Krikun Elena, Nikolaeva, Natalia, Olegovna Nozdrina, Ekaterina, Viktorovna Tabunshchikova, Lyudmila, Pavlovna, Ivanova Galina, Vladimirovna, Krikun Elena, Nikolaeva, Natalia, and Olegovna Nozdrina, Ekaterina
Published: 2019

49. Postpositivism: Extending the Field of Scientific Rationality

Author: Nikolaevna Shadrina, Elena, Vladimirovna, Krikun Elena, Alekseevna Gvozdeva, Galina, Nikolaevna Shadrina, Elena, Vladimirovna, Krikun Elena, and Alekseevna Gvozdeva, Galina
Published: 2019

50. Spatial-temporal conditionality of the political process in modern Russian Federation

Author: Rinatovna Balynskaya, Natalya, Vladimirovna, Krikun Elena, Vladimirovna Vikulina, Valeriya, Grigor'ievich Pudov, Alexey, Sergeevna Shkurko, Natalya, Yurievich Volkov, Sergey, Anatolyevna Kirillova, Elena, Rinatovna Balynskaya, Natalya, Vladimirovna, Krikun Elena, Vladimirovna Vikulina, Valeriya, Grigor'ievich Pudov, Alexey, Sergeevna Shkurko, Natalya, Yurievich Volkov, Sergey, and Anatolyevna Kirillova, Elena
Published: 2019

Catalog

Books, media, physical & digital resources

See catalog results

Searchworks

Select search scope, currently: Articles Catalog books, media & more in Jio Institute collections Articles journal articles & other e-resources

Search

Search Constraints

Refine your results

Search Limiters

Publication Year Range

Publication Type

Database

Publisher

176 results on '"Krikun, A."'

Search Results

Catalog

Select search scope, currently: Articles

Catalog

books, media & more in Jio Institute collections

Articles

journal articles & other e-resources