Search

Your search keyword '"Blevins A"' showing total 14,715 results
Start Over Author "Blevins A" Publication Year Range Last 50 years
14,715 results on '"Blevins A"'

1. Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models

Author

Gonen, Hila, Blevins, Terra, Liu, Alisa, Zettlemoyer, Luke, and Smith, Noah A.

Subjects
Computer Science - Computation and Language
Abstract

Despite their wide adoption, the biases and unintended behaviors of language models remain poorly understood. In this paper, we identify and characterize a phenomenon never discussed before, which we call semantic leakage, where models leak irrelevant information from the prompt into the generation in unexpected ways. We propose an evaluation setting to detect semantic leakage both by humans and automatically, curate a diverse test suite for diagnosing this behavior, and measure significant semantic leakage in 13 flagship models. We also show that models exhibit semantic leakage in languages besides English and across different settings and generation scenarios. This discovery highlights yet another type of bias in language models that affects their generation patterns and behavior.

Published
2024

2. Leveraging Uniformization and Sparsity for Computation of Continuous Time Dynamic Discrete Choice Games

Author

Blevins, Jason R.

Subjects
Economics - Econometrics
Abstract

Continuous-time formulations of dynamic discrete choice games offer notable computational advantages, particularly in modeling strategic interactions in oligopolistic markets. This paper extends these benefits by addressing computational challenges in order to improve model solution and estimation. We first establish new results on the rates of convergence of the value iteration, policy evaluation, and relative value iteration operators in the model, holding fixed player beliefs. Next, we introduce a new representation of the value function in the model based on uniformization -- a technique used in the analysis of continuous time Markov chains -- which allows us to draw a direct analogy to discrete time models. Furthermore, we show that uniformization also leads to a stable method to compute the matrix exponential, an operator appearing in the model's log likelihood function when only discrete time "snapshot" data are available. We also develop a new algorithm that concurrently computes the matrix exponential and its derivatives with respect to model parameters, enhancing computational efficiency. By leveraging the inherent sparsity of the model's intensity matrix, combined with sparse matrix techniques and precomputed addresses, we show how to significantly speed up computations. These strategies allow researchers to estimate more sophisticated and realistic models of strategic interactions and policy impacts in empirical industrial organization.

Published
2024

3. Targeted Multilingual Adaptation for Low-resource Language Families

Author

Downey, C. M., Blevins, Terra, Serai, Dhwani, Parikh, Dwija, and Steinert-Threlkeld, Shane

Subjects
Computer Science - Computation and Language
Abstract

The "massively-multilingual" training of multilingual models is known to limit their utility in any one language, and they perform particularly poorly on low-resource languages. However, there is evidence that low-resource languages can benefit from targeted multilinguality, where the model is trained on closely related languages. To test this approach more rigorously, we systematically study best practices for adapting a pre-trained model to a language family. Focusing on the Uralic family as a test case, we adapt XLM-R under various configurations to model 15 languages; we then evaluate the performance of each experimental setting on two downstream tasks and 11 evaluation languages. Our adapted models significantly outperform mono- and multilingual baselines. Furthermore, a regression analysis of hyperparameter effects reveals that adapted vocabulary size is relatively unimportant for low-resource languages, and that low-resource languages can be aggressively up-sampled during training at little detriment to performance in high-resource languages. These results introduce new best practices for performing language adaptation in a targeted setting.

Published
2024

4. Affine Transformation-based Perfectly Undetectable False Data Injection Attacks on Remote Manipulator Kinematic Control with Attack Detector

Author

Ueda, Jun and Blevins, Jacob

Subjects
Electrical Engineering and Systems Science - Systems and Control
Abstract

This paper demonstrates the viability of perfectly undetectable affine transformation attacks against robotic manipulators where intelligent attackers can inject multiplicative and additive false data while remaining completely hidden from system users. The attacker can implement these communication line attacks by satisfying three Conditions presented in this work. These claims are experimentally validated on a FANUC 6 degree of freedom manipulator by comparing a nominal (non-attacked) trial and a detectable attack case against three perfectly undetectable trajectory attack Scenarios: scaling, reflection, and shearing. The results show similar observed end effector error for the attack Scenarios and the nominal case, indicating that the perfectly undetectable affine transformation attack method keeps the attacker perfectly hidden while enabling them to attack manipulator trajectories.

Published
2024

5. Advancing Biomedical Applications: Antioxidant and Biocompatible Cerium Oxide Nanoparticle-Integrated Poly-{\epsilon}- caprolactone Fibers

Author

Jahan, Ummay Mowshome, Blevins, Brianna, Minko, Sergiy, and Reukov, Vladimir

Subjects
Quantitative Biology - Cell Behavior
Abstract

Reactive oxygen species (ROS), which are expressed at high levels in many diseases, can be scavenged by cerium oxide nanoparticles (CeO2NPs). CeO2NPs can cause significant cytotoxicity when administered directly to cells, but this cytotoxicity can be reduced if CeO2NPs can be encapsulated in biocompatible polymers. In this study, CeO2NPs were synthesized using a one-stage process, then purified, characterized, and then encapsulated into an electrospun poly-{\epsilon}-caprolactone (PCL) scaffold. The direct administration of CeO2NPs to RAW 264.7 Macrophages resulted in reduced ROS levels but lower cell viability. Conversely, the encapsulation of nanoceria in a PCL scaffold was shown to lower ROS levels and improve cell survival. The study demonstrated an effective technique for encapsulating nanoceria in PCL fiber and confirmed its biocompatibility and efficacy. This system has the potential to be utilized for developing tissue engineering scaffolds, targeted delivery of therapeutic CeO2NPs, wound healing, and other biomedical applications.

Published
2024

6. Colorblind Racial Ideology and Student Expectations and Reactions to a University-Sponsored Diversity Workshop

Author

Jacqueline Yi, Nathan R. Todd, Emily J. Blevins, and Ross A. Wantland

Abstract

Universities often sponsor workshops about diversity and inclusion that students are mandated to attend. Yet, little is known about students' expectations and reactions to such workshops, as well as how such expectations and reactions are associated with students' gender identity, racial-ethnic identification, and race-related attitudes such as power evasion colorblind racial ideology (CBRI). Using a sample of over 1,650 students, in this study, we examined responses to a mandatory diversity workshop occurring at a large Midwestern university for first-year and transfer undergraduate students. We utilized a mixed-methods approach, where we coded open-ended responses using a modified version of consensual qualitative research (Spangler et al., 2012), which resulted in various themes about students' expectations for the workshop (e.g., Developing Skills, Skepticism) and reactions to the workshop (e.g., Developed Awareness, Changed Behavior/Engaged in Action, Gained Nothing). We then conducted a series of logistic regression models to examine how gender identity, racial-ethnic identification, and CBRI predicted endorsement of qualitative themes. We also used linear regression to investigate how these student characteristics predicted quantitative measures of diversity workshop expectations (i.e., positive and negative affect) and reactions (i.e., workshop feedback). Overall, results showed that greater levels of CBRI significantly predicted more negative and less positive expectations and reactions to the workshop, while controlling for students' gender identity and racial-ethnic identification. Our findings highlight ways to better understand college students' attitudes toward and experiences of mandatory diversity education, along with implications for strengthening diversity initiatives in higher education.

Published
2024
Full Text
View/download PDF

7. Characterizing attitudes related to future child-bearing in young women diagnosed with early-stage breast cancer.

Author

Umashankar, Saumya, Li, Moming, Blevins, Kaylee, Kim, Mi-Ok, Majure, Melanie, Huppert, Laura, Melisko, Michelle, Rugo, Hope, Esserman, Laura, Park, John, and Chien, Amy

Subjects
Breast cancer, Endocrine therapy, Family-building in breast cancer, Fertility preservation, Young women, Humans, Female, Adult, Fertility Preservation, Breast Neoplasms, Prospective Studies, Infertility, Female, Fertility
Abstract

PURPOSE: This study characterizes attitudes and decision-making around the desire for future children in young women newly diagnosed with early-stage breast cancer and assesses how clinical factors and perceived risk may impact these attitudes. METHODS: This is a prospective study in women

Published
2024

8. MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling

Author

Limisiewicz, Tomasz, Blevins, Terra, Gonen, Hila, Ahia, Orevaoghene, and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning
Abstract

A major consideration in multilingual language modeling is how to best represent languages with diverse vocabularies and scripts. Although contemporary text encoding methods cover most of the world's writing systems, they exhibit bias towards the high-resource languages of the Global West. As a result, texts of underrepresented languages tend to be segmented into long sequences of linguistically meaningless units. To address the disparities, we introduce a new paradigm that encodes the same information with segments of consistent size across diverse languages. Our encoding convention (MYTE) is based on morphemes, as their inventories are more balanced across languages than characters, which are used in previous methods. We show that MYTE produces shorter encodings for all 99 analyzed languages, with the most notable improvements for non-European languages and non-Latin scripts. This, in turn, improves multilingual LM performance and diminishes the perplexity gap throughout diverse languages.

Published
2024

9. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Author

Gemini Team, Georgiev, Petko, Lei, Ving Ian, Burnell, Ryan, Bai, Libin, Gulati, Anmol, Tanzer, Garrett, Vincent, Damien, Pan, Zhufeng, Wang, Shibo, Mariooryad, Soroosh, Ding, Yifan, Geng, Xinyang, Alcober, Fred, Frostig, Roy, Omernick, Mark, Walker, Lexi, Paduraru, Cosmin, Sorokin, Christina, Tacchetti, Andrea, Gaffney, Colin, Daruki, Samira, Sercinoglu, Olcan, Gleicher, Zach, Love, Juliette, Voigtlaender, Paul, Jain, Rohan, Surita, Gabriela, Mohamed, Kareem, Blevins, Rory, Ahn, Junwhan, Zhu, Tao, Kawintiranon, Kornraphop, Firat, Orhan, Gu, Yiming, Zhang, Yujing, Rahtz, Matthew, Faruqui, Manaal, Clay, Natalie, Gilmer, Justin, Co-Reyes, JD, Penchev, Ivo, Zhu, Rui, Morioka, Nobuyuki, Hui, Kevin, Haridasan, Krishna, Campos, Victor, Mahdieh, Mahdis, Guo, Mandy, Hassan, Samer, Kilgour, Kevin, Vezer, Arpi, Cheng, Heng-Tze, de Liedekerke, Raoul, Goyal, Siddharth, Barham, Paul, Strouse, DJ, Noury, Seb, Adler, Jonas, Sundararajan, Mukund, Vikram, Sharad, Lepikhin, Dmitry, Paganini, Michela, Garcia, Xavier, Yang, Fan, Valter, Dasha, Trebacz, Maja, Vodrahalli, Kiran, Asawaroengchai, Chulayuth, Ring, Roman, Kalb, Norbert, Soares, Livio Baldini, Brahma, Siddhartha, Steiner, David, Yu, Tianhe, Mentzer, Fabian, He, Antoine, Gonzalez, Lucas, Xu, Bibo, Kaufman, Raphael Lopez, Shafey, Laurent El, Oh, Junhyuk, Hennigan, Tom, Driessche, George van den, Odoom, Seth, Lucic, Mario, Roelofs, Becca, Lall, Sid, Marathe, Amit, Chan, Betty, Ontanon, Santiago, He, Luheng, Teplyashin, Denis, Lai, Jonathan, Crone, Phil, Damoc, Bogdan, Ho, Lewis, Riedel, Sebastian, Lenc, Karel, Yeh, Chih-Kuan, Chowdhery, Aakanksha, Xu, Yang, Kazemi, Mehran, Amid, Ehsan, Petrushkina, Anastasia, Swersky, Kevin, Khodaei, Ali, Chen, Gowoon, Larkin, Chris, Pinto, Mario, Yan, Geng, Badia, Adria Puigdomenech, Patil, Piyush, Hansen, Steven, Orr, Dave, Arnold, Sebastien M. R., Grimstad, Jordan, Dai, Andrew, Douglas, Sholto, Sinha, Rishika, Yadav, Vikas, Chen, Xi, Gribovskaya, Elena, Austin, Jacob, Zhao, Jeffrey, Patel, Kaushal, Komarek, Paul, Austin, Sophia, Borgeaud, Sebastian, Friso, Linda, Goyal, Abhimanyu, Caine, Ben, Cao, Kris, Chung, Da-Woon, Lamm, Matthew, Barth-Maron, Gabe, Kagohara, Thais, Olszewska, Kate, Chen, Mia, Shivakumar, Kaushik, Agarwal, Rishabh, Godhia, Harshal, Rajwar, Ravi, Snaider, Javier, Dotiwalla, Xerxes, Liu, Yuan, Barua, Aditya, Ungureanu, Victor, Zhang, Yuan, Batsaikhan, Bat-Orgil, Wirth, Mateo, Qin, James, Danihelka, Ivo, Doshi, Tulsee, Chadwick, Martin, Chen, Jilin, Jain, Sanil, Le, Quoc, Kar, Arjun, Gurumurthy, Madhu, Li, Cheng, Sang, Ruoxin, Liu, Fangyu, Lamprou, Lampros, Munoz, Rich, Lintz, Nathan, Mehta, Harsh, Howard, Heidi, Reynolds, Malcolm, Aroyo, Lora, Wang, Quan, Blanco, Lorenzo, Cassirer, Albin, Griffith, Jordan, Das, Dipanjan, Lee, Stephan, Sygnowski, Jakub, Fisher, Zach, Besley, James, Powell, Richard, Ahmed, Zafarali, Paulus, Dominik, Reitter, David, Borsos, Zalan, Joshi, Rishabh, Pope, Aedan, Hand, Steven, Selo, Vittorio, Jain, Vihan, Sethi, Nikhil, Goel, Megha, Makino, Takaki, May, Rhys, Yang, Zhen, Schalkwyk, Johan, Butterfield, Christina, Hauth, Anja, Goldin, Alex, Hawkins, Will, Senter, Evan, Brin, Sergey, Woodman, Oliver, Ritter, Marvin, Noland, Eric, Giang, Minh, Bolina, Vijay, Lee, Lisa, Blyth, Tim, Mackinnon, Ian, Reid, Machel, Sarvana, Obaid, Silver, David, Chen, Alexander, Wang, Lily, Maggiore, Loren, Chang, Oscar, Attaluri, Nithya, Thornton, Gregory, Chiu, Chung-Cheng, Bunyan, Oskar, Levine, Nir, Chung, Timothy, Eltyshev, Evgenii, Si, Xiance, Lillicrap, Timothy, Brady, Demetra, Aggarwal, Vaibhav, Wu, Boxi, Xu, Yuanzhong, McIlroy, Ross, Badola, Kartikeya, Sandhu, Paramjit, Moreira, Erica, Stokowiec, Wojciech, Hemsley, Ross, Li, Dong, Tudor, Alex, Shyam, Pranav, Rahimtoroghi, Elahe, Haykal, Salem, Sprechmann, Pablo, Zhou, Xiang, Mincu, Diana, Li, Yujia, Addanki, Ravi, Krishna, Kalpesh, Wu, Xiao, Frechette, Alexandre, Eyal, Matan, Dafoe, Allan, Lacey, Dave, Whang, Jay, Avrahami, Thi, Zhang, Ye, Taropa, Emanuel, Lin, Hanzhao, Toyama, Daniel, Rutherford, Eliza, Sano, Motoki, Choe, HyunJeong, Tomala, Alex, Safranek-Shrader, Chalence, Kassner, Nora, Pajarskas, Mantas, Harvey, Matt, Sechrist, Sean, Fortunato, Meire, Lyu, Christina, Elsayed, Gamaleldin, Kuang, Chenkai, Lottes, James, Chu, Eric, Jia, Chao, Chen, Chih-Wei, Humphreys, Peter, Baumli, Kate, Tao, Connie, Samuel, Rajkumar, Santos, Cicero Nogueira dos, Andreassen, Anders, Rakićević, Nemanja, Grewe, Dominik, Kumar, Aviral, Winkler, Stephanie, Caton, Jonathan, Brock, Andrew, Dalmia, Sid, Sheahan, Hannah, Barr, Iain, Miao, Yingjie, Natsev, Paul, Devlin, Jacob, Behbahani, Feryal, Prost, Flavien, Sun, Yanhua, Myaskovsky, Artiom, Pillai, Thanumalayan Sankaranarayana, Hurt, Dan, Lazaridou, Angeliki, Xiong, Xi, Zheng, Ce, Pardo, Fabio, Li, Xiaowei, Horgan, Dan, Stanton, Joe, Ambar, Moran, Xia, Fei, Lince, Alejandro, Wang, Mingqiu, Mustafa, Basil, Webson, Albert, Lee, Hyo, Anil, Rohan, Wicke, Martin, Dozat, Timothy, Sinha, Abhishek, Piqueras, Enrique, Dabir, Elahe, Upadhyay, Shyam, Boral, Anudhyan, Hendricks, Lisa Anne, Fry, Corey, Djolonga, Josip, Su, Yi, Walker, Jake, Labanowski, Jane, Huang, Ronny, Misra, Vedant, Chen, Jeremy, Skerry-Ryan, RJ, Singh, Avi, Rijhwani, Shruti, Yu, Dian, Castro-Ros, Alex, Changpinyo, Beer, Datta, Romina, Bagri, Sumit, Hrafnkelsson, Arnar Mar, Maggioni, Marcello, Zheng, Daniel, Sulsky, Yury, Hou, Shaobo, Paine, Tom Le, Yang, Antoine, Riesa, Jason, Rogozinska, Dominika, Marcus, Dror, Badawy, Dalia El, Zhang, Qiao, Wang, Luyu, Miller, Helen, Greer, Jeremy, Sjos, Lars Lowe, Nova, Azade, Zen, Heiga, Chaabouni, Rahma, Rosca, Mihaela, Jiang, Jiepu, Chen, Charlie, Liu, Ruibo, Sainath, Tara, Krikun, Maxim, Polozov, Alex, Lespiau, Jean-Baptiste, Newlan, Josh, Cankara, Zeyncep, Kwak, Soo, Xu, Yunhan, Chen, Phil, Coenen, Andy, Meyer, Clemens, Tsihlas, Katerina, Ma, Ada, Gottweis, Juraj, Xing, Jinwei, Gu, Chenjie, Miao, Jin, Frank, Christian, Cankara, Zeynep, Ganapathy, Sanjay, Dasgupta, Ishita, Hughes-Fitt, Steph, Chen, Heng, Reid, David, Rong, Keran, Fan, Hongmin, van Amersfoort, Joost, Zhuang, Vincent, Cohen, Aaron, Gu, Shixiang Shane, Mohananey, Anhad, Ilic, Anastasija, Tobin, Taylor, Wieting, John, Bortsova, Anna, Thacker, Phoebe, Wang, Emma, Caveness, Emily, Chiu, Justin, Sezener, Eren, Kaskasoli, Alex, Baker, Steven, Millican, Katie, Elhawaty, Mohamed, Aisopos, Kostas, Lebsack, Carl, Byrd, Nathan, Dai, Hanjun, Jia, Wenhao, Wiethoff, Matthew, Davoodi, Elnaz, Weston, Albert, Yagati, Lakshman, Ahuja, Arun, Gao, Isabel, Pundak, Golan, Zhang, Susan, Azzam, Michael, Sim, Khe Chai, Caelles, Sergi, Keeling, James, Sharma, Abhanshu, Swing, Andy, Li, YaGuang, Liu, Chenxi, Bostock, Carrie Grimes, Bansal, Yamini, Nado, Zachary, Anand, Ankesh, Lipschultz, Josh, Karmarkar, Abhijit, Proleev, Lev, Ittycheriah, Abe, Yeganeh, Soheil Hassas, Polovets, George, Faust, Aleksandra, Sun, Jiao, Rrustemi, Alban, Li, Pen, Shivanna, Rakesh, Liu, Jeremiah, Welty, Chris, Lebron, Federico, Baddepudi, Anirudh, Krause, Sebastian, Parisotto, Emilio, Soricut, Radu, Xu, Zheng, Bloxwich, Dawn, Johnson, Melvin, Neyshabur, Behnam, Mao-Jones, Justin, Wang, Renshen, Ramasesh, Vinay, Abbas, Zaheer, Guez, Arthur, Segal, Constant, Nguyen, Duc Dung, Svensson, James, Hou, Le, York, Sarah, Milan, Kieran, Bridgers, Sophie, Gworek, Wiktor, Tagliasacchi, Marco, Lee-Thorp, James, Chang, Michael, Guseynov, Alexey, Hartman, Ale Jakse, Kwong, Michael, Zhao, Ruizhe, Kashem, Sheleem, Cole, Elizabeth, Miech, Antoine, Tanburn, Richard, Phuong, Mary, Pavetic, Filip, Cevey, Sebastien, Comanescu, Ramona, Ives, Richard, Yang, Sherry, Du, Cosmo, Li, Bo, Zhang, Zizhao, Iinuma, Mariko, Hu, Clara Huiyi, Roy, Aurko, Bijwadia, Shaan, Zhu, Zhenkai, Martins, Danilo, Saputro, Rachel, Gergely, Anita, Zheng, Steven, Jia, Dawei, Antonoglou, Ioannis, Sadovsky, Adam, Gu, Shane, Bi, Yingying, Andreev, Alek, Samangooei, Sina, Khan, Mina, Kocisky, Tomas, Filos, Angelos, Kumar, Chintu, Bishop, Colton, Yu, Adams, Hodkinson, Sarah, Mittal, Sid, Shah, Premal, Moufarek, Alexandre, Cheng, Yong, Bloniarz, Adam, Lee, Jaehoon, Pejman, Pedram, Michel, Paul, Spencer, Stephen, Feinberg, Vladimir, Xiong, Xuehan, Savinov, Nikolay, Smith, Charlotte, Shakeri, Siamak, Tran, Dustin, Chesus, Mary, Bohnet, Bernd, Tucker, George, von Glehn, Tamara, Muir, Carrie, Mao, Yiran, Kazawa, Hideto, Slone, Ambrose, Soparkar, Kedar, Shrivastava, Disha, Cobon-Kerr, James, Sharman, Michael, Pavagadhi, Jay, Araya, Carlos, Misiunas, Karolis, Ghelani, Nimesh, Laskin, Michael, Barker, David, Li, Qiujia, Briukhov, Anton, Houlsby, Neil, Glaese, Mia, Lakshminarayanan, Balaji, Schucher, Nathan, Tang, Yunhao, Collins, Eli, Lim, Hyeontaek, Feng, Fangxiaoyu, Recasens, Adria, Lai, Guangda, Magni, Alberto, De Cao, Nicola, Siddhant, Aditya, Ashwood, Zoe, Orbay, Jordi, Dehghani, Mostafa, Brennan, Jenny, He, Yifan, Xu, Kelvin, Gao, Yang, Saroufim, Carl, Molloy, James, Wu, Xinyi, Arnold, Seb, Chang, Solomon, Schrittwieser, Julian, Buchatskaya, Elena, Radpour, Soroush, Polacek, Martin, Giordano, Skye, Bapna, Ankur, Tokumine, Simon, Hellendoorn, Vincent, Sottiaux, Thibault, Cogan, Sarah, Severyn, Aliaksei, Saleh, Mohammad, Thakoor, Shantanu, Shefey, Laurent, Qiao, Siyuan, Gaba, Meenu, Chang, Shuo-yiin, Swanson, Craig, Zhang, Biao, Lee, Benjamin, Rubenstein, Paul Kishan, Song, Gan, Kwiatkowski, Tom, Koop, Anna, Kannan, Ajay, Kao, David, Schuh, Parker, Stjerngren, Axel, Ghiasi, Golnaz, Gibson, Gena, Vilnis, Luke, Yuan, Ye, Ferreira, Felipe Tiengo, Kamath, Aishwarya, Klimenko, Ted, Franko, Ken, Xiao, Kefan, Bhattacharya, Indro, Patel, Miteyan, Wang, Rui, Morris, Alex, Strudel, Robin, Sharma, Vivek, Choy, Peter, Hashemi, Sayed Hadi, Landon, Jessica, Finkelstein, Mara, Jhakra, Priya, Frye, Justin, Barnes, Megan, Mauger, Matthew, Daun, Dennis, Baatarsukh, Khuslen, Tung, Matthew, Farhan, Wael, Michalewski, Henryk, Viola, Fabio, Quitry, Felix de Chaumont, Lan, Charline Le, Hudson, Tom, Wang, Qingze, Fischer, Felix, Zheng, Ivy, White, Elspeth, Dragan, Anca, Alayrac, Jean-baptiste, Ni, Eric, Pritzel, Alexander, Iwanicki, Adam, Isard, Michael, Bulanova, Anna, Zilka, Lukas, Dyer, Ethan, Sachan, Devendra, Srinivasan, Srivatsan, Muckenhirn, Hannah, Cai, Honglong, Mandhane, Amol, Tariq, Mukarram, Rae, Jack W., Wang, Gary, Ayoub, Kareem, FitzGerald, Nicholas, Zhao, Yao, Han, Woohyun, Alberti, Chris, Garrette, Dan, Krishnakumar, Kashyap, Gimenez, Mai, Levskaya, Anselm, Sohn, Daniel, Matak, Josip, Iturrate, Inaki, Chang, Michael B., Xiang, Jackie, Cao, Yuan, Ranka, Nishant, Brown, Geoff, Hutter, Adrian, Mirrokni, Vahab, Chen, Nanxin, Yao, Kaisheng, Egyed, Zoltan, Galilee, Francois, Liechty, Tyler, Kallakuri, Praveen, Palmer, Evan, Ghemawat, Sanjay, Liu, Jasmine, Tao, David, Thornton, Chloe, Green, Tim, Jasarevic, Mimi, Lin, Sharon, Cotruta, Victor, Tan, Yi-Xuan, Fiedel, Noah, Yu, Hongkun, Chi, Ed, Neitz, Alexander, Heitkaemper, Jens, Sinha, Anu, Zhou, Denny, Sun, Yi, Kaed, Charbel, Hulse, Brice, Mishra, Swaroop, Georgaki, Maria, Kudugunta, Sneha, Farabet, Clement, Shafran, Izhak, Vlasic, Daniel, Tsitsulin, Anton, Ananthanarayanan, Rajagopal, Carin, Alen, Su, Guolong, Sun, Pei, V, Shashank, Carvajal, Gabriel, Broder, Josef, Comsa, Iulia, Repina, Alena, Wong, William, Chen, Warren Weilun, Hawkins, Peter, Filonov, Egor, Loher, Lucia, Hirnschall, Christoph, Wang, Weiyi, Ye, Jingchen, Burns, Andrea, Cate, Hardie, Wright, Diana Gage, Piccinini, Federico, Zhang, Lei, Lin, Chu-Cheng, Gog, Ionel, Kulizhskaya, Yana, Sreevatsa, Ashwin, Song, Shuang, Cobo, Luis C., Iyer, Anand, Tekur, Chetan, Garrido, Guillermo, Xiao, Zhuyun, Kemp, Rupert, Zheng, Huaixiu Steven, Li, Hui, Agarwal, Ananth, Ngani, Christel, Goshvadi, Kati, Santamaria-Fernandez, Rebeca, Fica, Wojciech, Chen, Xinyun, Gorgolewski, Chris, Sun, Sean, Garg, Roopal, Ye, Xinyu, Eslami, S. M. Ali, Hua, Nan, Simon, Jon, Joshi, Pratik, Kim, Yelin, Tenney, Ian, Potluri, Sahitya, Thiet, Lam Nguyen, Yuan, Quan, Luisier, Florian, Chronopoulou, Alexandra, Scellato, Salvatore, Srinivasan, Praveen, Chen, Minmin, Koverkathu, Vinod, Dalibard, Valentin, Xu, Yaming, Saeta, Brennan, Anderson, Keith, Sellam, Thibault, Fernando, Nick, Huot, Fantine, Jung, Junehyuk, Varadarajan, Mani, Quinn, Michael, Raul, Amit, Le, Maigo, Habalov, Ruslan, Clark, Jon, Jalan, Komal, Bullard, Kalesha, Singhal, Achintya, Luong, Thang, Wang, Boyu, Rajayogam, Sujeevan, Eisenschlos, Julian, Jia, Johnson, Finchelstein, Daniel, Yakubovich, Alex, Balle, Daniel, Fink, Michael, Agarwal, Sameer, Li, Jing, Dvijotham, Dj, Pal, Shalini, Kang, Kai, Konzelmann, Jaclyn, Beattie, Jennifer, Dousse, Olivier, Wu, Diane, Crocker, Remi, Elkind, Chen, Jonnalagadda, Siddhartha Reddy, Lee, Jong, Holtmann-Rice, Dan, Kallarackal, Krystal, Liu, Rosanne, Vnukov, Denis, Vats, Neera, Invernizzi, Luca, Jafari, Mohsen, Zhou, Huanjie, Taylor, Lilly, Prendki, Jennifer, Wu, Marcus, Eccles, Tom, Liu, Tianqi, Kopparapu, Kavya, Beaufays, Francoise, Angermueller, Christof, Marzoca, Andreea, Sarcar, Shourya, Dib, Hilal, Stanway, Jeff, Perbet, Frank, Trdin, Nejc, Sterneck, Rachel, Khorlin, Andrey, Li, Dinghua, Wu, Xihui, Goenka, Sonam, Madras, David, Goldshtein, Sasha, Gierke, Willi, Zhou, Tong, Liu, Yaxin, Liang, Yannie, White, Anais, Li, Yunjie, Singh, Shreya, Bahargam, Sanaz, Epstein, Mark, Basu, Sujoy, Lao, Li, Ozturel, Adnan, Crous, Carl, Zhai, Alex, Lu, Han, Tung, Zora, Gaur, Neeraj, Walton, Alanna, Dixon, Lucas, Zhang, Ming, Globerson, Amir, Uy, Grant, Bolt, Andrew, Wiles, Olivia, Nasr, Milad, Shumailov, Ilia, Selvi, Marco, Piccinno, Francesco, Aguilar, Ricardo, McCarthy, Sara, Khalman, Misha, Shukla, Mrinal, Galic, Vlado, Carpenter, John, Villela, Kevin, Zhang, Haibin, Richardson, Harry, Martens, James, Bosnjak, Matko, Belle, Shreyas Rammohan, Seibert, Jeff, Alnahlawi, Mahmoud, McWilliams, Brian, Singh, Sankalp, Louis, Annie, Ding, Wen, Popovici, Dan, Simicich, Lenin, Knight, Laura, Mehta, Pulkit, Gupta, Nishesh, Shi, Chongyang, Fatehi, Saaber, Mitrovic, Jovana, Grills, Alex, Pagadora, Joseph, Petrova, Dessie, Eisenbud, Danielle, Zhang, Zhishuai, Yates, Damion, Mittal, Bhavishya, Tripuraneni, Nilesh, Assael, Yannis, Brovelli, Thomas, Jain, Prateek, Velimirovic, Mihajlo, Akbulut, Canfer, Mu, Jiaqi, Macherey, Wolfgang, Kumar, Ravin, Xu, Jun, Qureshi, Haroon, Comanici, Gheorghe, Wiesner, Jeremy, Gong, Zhitao, Ruddock, Anton, Bauer, Matthias, Felt, Nick, GP, Anirudh, Arnab, Anurag, Zelle, Dustin, Rothfuss, Jonas, Rosgen, Bill, Shenoy, Ashish, Seybold, Bryan, Li, Xinjian, Mudigonda, Jayaram, Erdogan, Goker, Xia, Jiawei, Simsa, Jiri, Michi, Andrea, Yao, Yi, Yew, Christopher, Kan, Steven, Caswell, Isaac, Radebaugh, Carey, Elisseeff, Andre, Valenzuela, Pedro, McKinney, Kay, Paterson, Kim, Cui, Albert, Latorre-Chimoto, Eri, Kim, Solomon, Zeng, William, Durden, Ken, Ponnapalli, Priya, Sosea, Tiberiu, Choquette-Choo, Christopher A., Manyika, James, Robenek, Brona, Vashisht, Harsha, Pereira, Sebastien, Lam, Hoi, Velic, Marko, Owusu-Afriyie, Denese, Lee, Katherine, Bolukbasi, Tolga, Parrish, Alicia, Lu, Shawn, Park, Jane, Venkatraman, Balaji, Talbert, Alice, Rosique, Lambert, Cheng, Yuchung, Sozanschi, Andrei, Paszke, Adam, Kumar, Praveen, Austin, Jessica, Li, Lu, Salama, Khalid, Kim, Wooyeol, Dukkipati, Nandita, Baryshnikov, Anthony, Kaplanis, Christos, Sheng, XiangHai, Chervonyi, Yuri, Unlu, Caglar, Casas, Diego de Las, Askham, Harry, Tunyasuvunakool, Kathryn, Gimeno, Felix, Poder, Siim, Kwak, Chester, Miecnikowski, Matt, Dimitriev, Alek, Parisi, Aaron, Liu, Dangyi, Tsai, Tomy, Shevlane, Toby, Kouridi, Christina, Garmon, Drew, Goedeckemeyer, Adrian, Brown, Adam R., Vijayakumar, Anitha, Elqursh, Ali, Jazayeri, Sadegh, Huang, Jin, Carthy, Sara Mc, Hoover, Jay, Kim, Lucy, Kumar, Sandeep, Chen, Wei, Biles, Courtney, Bingham, Garrett, Rosen, Evan, Wang, Lisa, Tan, Qijun, Engel, David, Pongetti, Francesco, de Cesare, Dario, Hwang, Dongseong, Yu, Lily, Pullman, Jennifer, Narayanan, Srini, Levin, Kyle, Gopal, Siddharth, Li, Megan, Aharoni, Asaf, Trinh, Trieu, Lo, Jessica, Casagrande, Norman, Vij, Roopali, Matthey, Loic, Ramadhana, Bramandia, Matthews, Austin, Carey, CJ, Johnson, Matthew, Goranova, Kremena, Shah, Rohin, Ashraf, Shereen, Dasgupta, Kingshuk, Larsen, Rasmus, Wang, Yicheng, Vuyyuru, Manish Reddy, Jiang, Chong, Ijazi, Joana, Osawa, Kazuki, Smith, Celine, Boppana, Ramya Sree, Bilal, Taylan, Koizumi, Yuma, Xu, Ying, Altun, Yasemin, Shabat, Nir, Bariach, Ben, Korchemniy, Alex, Choo, Kiam, Ronneberger, Olaf, Iwuanyanwu, Chimezie, Zhao, Shubin, Soergel, David, Hsieh, Cho-Jui, Cai, Irene, Iqbal, Shariq, Sundermeyer, Martin, Chen, Zhe, Bursztein, Elie, Malaviya, Chaitanya, Biadsy, Fadi, Shroff, Prakash, Dhillon, Inderjit, Latkar, Tejasi, Dyer, Chris, Forbes, Hannah, Nicosia, Massimo, Nikolaev, Vitaly, Greene, Somer, Georgiev, Marin, Wang, Pidong, Martin, Nina, Sedghi, Hanie, Zhang, John, Banzal, Praseem, Fritz, Doug, Rao, Vikram, Wang, Xuezhi, Zhang, Jiageng, Patraucean, Viorica, Du, Dayou, Mordatch, Igor, Jurin, Ivan, Liu, Lewis, Dubey, Ayush, Mohan, Abhi, Nowakowski, Janek, Ion, Vlad-Doru, Wei, Nan, Tojo, Reiko, Raad, Maria Abi, Hudson, Drew A., Keshava, Vaishakh, Agrawal, Shubham, Ramirez, Kevin, Wu, Zhichun, Nguyen, Hoang, Liu, Ji, Sewak, Madhavi, Petrini, Bryce, Choi, DongHyun, Philips, Ivan, Wang, Ziyue, Bica, Ioana, Garg, Ankush, Wilkiewicz, Jarek, Agrawal, Priyanka, Guo, Danhao, Xue, Emily, Shaik, Naseer, Leach, Andrew, Khan, Sadh MNM, Wiesinger, Julia, Jerome, Sammy, Chakladar, Abhishek, Wang, Alek Wenjiao, Ornduff, Tina, Abu, Folake, Ghaffarkhah, Alireza, Wainwright, Marcus, Cortes, Mario, Liu, Frederick, Maynez, Joshua, Terzis, Andreas, Samangouei, Pouya, Mansour, Riham, Kępa, Tomasz, Aubet, François-Xavier, Algymr, Anton, Banica, Dan, Weisz, Agoston, Orban, Andras, Senges, Alexandre, Andrejczuk, Ewa, Geller, Mark, Santo, Niccolo Dal, Anklin, Valentin, Merey, Majd Al, Baeuml, Martin, Strohman, Trevor, Bai, Junwen, Petrov, Slav, Wu, Yonghui, Hassabis, Demis, Kavukcuoglu, Koray, Dean, Jeffrey, and Vinyals, Oriol

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February version on the great majority of capabilities and benchmarks; (2) Gemini 1.5 Flash, a more lightweight variant designed for efficiency with minimal regression in quality. Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5's long-context ability, we find continued improvement in next-token prediction and near-perfect retrieval (>99%) up to at least 10M tokens, a generational leap over existing models such as Claude 3.0 (200k) and GPT-4 Turbo (128k). Finally, we highlight real-world use cases, such as Gemini 1.5 collaborating with professionals on completing their tasks achieving 26 to 75% time savings across 10 different job categories, as well as surprising new capabilities of large language models at the frontier; when given a grammar manual for Kalamang, a language with fewer than 200 speakers worldwide, the model learns to translate English to Kalamang at a similar level to a person who learned from the same content.

Published
2024

10. Comparing Hallucination Detection Metrics for Multilingual Generation

Author

Kang, Haoqiang, Blevins, Terra, and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

While many hallucination detection techniques have been evaluated on English text, their effectiveness in multilingual contexts remains unknown. This paper assesses how well various factual hallucination detection metrics (lexical metrics like ROUGE and Named Entity Overlap, and Natural Language Inference (NLI)-based metrics) identify hallucinations in generated biographical summaries across languages. We compare how well automatic metrics correlate to each other and whether they agree with human judgments of factuality. Our analysis reveals that while the lexical metrics are ineffective, NLI-based metrics perform well, correlating with human annotations in many settings and often outperforming supervised models. However, NLI metrics are still limited, as they do not detect single-fact hallucinations well and fail for lower-resource languages. Therefore, our findings highlight the gaps in exisiting hallucination detection methods for non-English languages and motivate future research to develop more robust multilingual detection methods for LLM hallucinations.

Published
2024

11. Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models

Author

Blevins, Terra, Limisiewicz, Tomasz, Gururangan, Suchin, Li, Margaret, Gonen, Hila, Smith, Noah A., and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language
Abstract

Despite their popularity in non-English NLP, multilingual language models often underperform monolingual ones due to inter-language competition for model parameters. We propose Cross-lingual Expert Language Models (X-ELM), which mitigate this competition by independently training language models on subsets of the multilingual corpus. This process specializes X-ELMs to different languages while remaining effective as a multilingual ensemble. Our experiments show that when given the same compute budget, X-ELM outperforms jointly trained multilingual models across all considered languages and that these gains transfer to downstream tasks. X-ELM provides additional benefits over performance improvements: new experts can be iteratively added, adapting X-ELM to new languages without catastrophic forgetting. Furthermore, training is asynchronous, reducing the hardware requirements for multilingual training and democratizing multilingual modeling.

Published
2024

13. STEM Outreach to Underresourced Schools: A Model for Inclusive Student Engagement

Author

Kaggwa, Ruth J., Blevins, Allison, Wester, Emma, Arango-Caro, Sandra, Woodford-Thomas, Terry, and Callis-Duehl, Kristine

Abstract

Diverse backgrounds, viewpoints and experiences in science, technology, engineering and math (STEM) are vital for innovation and creativity in STEM; and yet, racially minoritized groups, such as African Americans and Hispanics, remain underrepresented in the STEM K-12 and career pipeline. Studies show that exposure and access to STEM experiences in the early years are especially effective for increasing interest in STEM careers and intentions to major in STEM. However, these opportunities are often unavailable and inaccessible to underrepresented racialized minority students, particularly those from majority minority schools in low income communities. We describe a model for accessible and inclusive exposure to STEM experiences, enabled by a partnership between elementary schools from low income under resourced, predominantly racialized minority K-5 schools in North St. Louis County, Missouri, and scientists at a non-profit plant science research institution, to provide STEM activities for all students over the course of a single day. The goal was to stimulate students' interest in STEM and related careers, and enrich students and teachers' STEM knowledge. Five "STEM Days" were held at four elementary schools from 2017 to 2019. Feedback from teachers and students revealed positive outcomes, including increased excitement and knowledge gains. Students showed increased STEM interest, and teachers indicated that the new approaches to classroom STEM instruction, despite the brief exposure, were beneficial. Unexpectedly, participating scientists also noted numerous benefits. We share lessons learned and suggest recommendations for practitioners in STEM.

Published
2023

14. Transposition of HOPPLA in siRNA-deficient plants suggests a limited effect of the environment on retrotransposon mobility in Brachypodium distachyon

Author

Thieme, Michael, Minadakis, Nikolaos, Himber, Christophe, Keller, Bettina, Xu, Wenbo, Rutowicz, Kinga, Matteoli, Calvin, Böhrer, Marcel, Rymen, Bart, Laudencia-Chingcuanco, Debbie, Vogel, John P, Sibout, Richard, Stritt, Christoph, Blevins, Todd, and Roulin, Anne C

Subjects
Plant Biology, Biological Sciences, Ecology, Genetics, Biotechnology, Human Genome, 2.1 Biological and endogenous factors, Aetiology, Retroelements, Genome, Plant, Brachypodium, RNA, Small Interfering, DNA Copy Number Variations, Terminal Repeat Sequences, Phylogeny, Evolution, Molecular, Developmental Biology
Abstract

Long terminal repeat retrotransposons (LTR-RTs) are powerful mutagens regarded as a major source of genetic novelty and important drivers of evolution. Yet, the uncontrolled and potentially selfish proliferation of LTR-RTs can lead to deleterious mutations and genome instability, with large fitness costs for their host. While population genomics data suggest that an ongoing LTR-RT mobility is common in many species, the understanding of their dual role in evolution is limited. Here, we harness the genetic diversity of 320 sequenced natural accessions of the Mediterranean grass Brachypodium distachyon to characterize how genetic and environmental factors influence plant LTR-RT dynamics in the wild. When combining a coverage-based approach to estimate global LTR-RT copy number variations with mobilome-sequencing of nine accessions exposed to eight different stresses, we find little evidence for a major role of environmental factors in LTR-RT accumulations in B. distachyon natural accessions. Instead, we show that loss of RNA polymerase IV (Pol IV), which mediates RNA-directed DNA methylation in plants, results in high transcriptional and transpositional activities of RLC_BdisC024 (HOPPLA) LTR-RT family elements, and that these effects are not stress-specific. This work supports findings indicating an ongoing mobility in B. distachyon and reveals that host RNA-directed DNA methylation rather than environmental factors controls their mobility in this wild grass model.

Published
2024

15. Sympathetic innervation of interscapular brown adipose tissue is not a predominant mediator of oxytocin-elicited reductions of body weight and adiposity in male diet-induced obese mice

Author

Edwards, Melise M, Nguyen, Ha K, Dodson, Andrew D, Herbertson, Adam J, Wolden-Hanson, Tami, Wietecha, Tomasz A, Honeycutt, Mackenzie K, Slattery, Jared D, O’Brien, Kevin D, Graham, James L, Havel, Peter J, Mundinger, Thomas O, Sikkema, Carl L, Peskind, Elaine R, Ryu, Vitaly, Taborsky, Gerald J, and Blevins, James E

Subjects
Medical Physiology, Biomedical and Clinical Sciences, Obesity, Neurosciences, Nutrition, Metabolic and endocrine, Animals, Oxytocin, Adipose Tissue, Brown, Male, Mice, Sympathetic Nervous System, Diet, High-Fat, Adiposity, Mice, Inbred C57BL, Body Weight, Weight Loss, Mice, Obese, Energy Metabolism, Norepinephrine, obesity, brown adipose tissue, white adipose tissue, oxytocin, food intake, Clinical Sciences, Nutrition and Dietetics, Clinical sciences
Abstract

Previous studies indicate that CNS administration of oxytocin (OT) reduces body weight in high fat diet-induced obese (DIO) rodents by reducing food intake and increasing energy expenditure (EE). We recently demonstrated that hindbrain (fourth ventricular [4V]) administration of OT elicits weight loss and elevates interscapular brown adipose tissue temperature (TIBAT, a surrogate measure of increased EE) in DIO mice. What remains unclear is whether OT-elicited weight loss requires increased sympathetic nervous system (SNS) outflow to IBAT. We hypothesized that OT-induced stimulation of SNS outflow to IBAT contributes to its ability to activate BAT and elicit weight loss in DIO mice. To test this hypothesis, we determined the effect of disrupting SNS activation of IBAT on the ability of 4V OT administration to increase TIBAT and elicit weight loss in DIO mice. We first determined whether bilateral surgical SNS denervation to IBAT was successful as noted by ≥ 60% reduction in IBAT norepinephrine (NE) content in DIO mice. NE content was selectively reduced in IBAT at 1-, 6- and 7-weeks post-denervation by 95.9 ± 2.0, 77.4 ± 12.7 and 93.6 ± 4.6% (P

Published
2024

16. Gemini: A Family of Highly Capable Multimodal Models

Author

Gemini Team, Anil, Rohan, Borgeaud, Sebastian, Alayrac, Jean-Baptiste, Yu, Jiahui, Soricut, Radu, Schalkwyk, Johan, Dai, Andrew M., Hauth, Anja, Millican, Katie, Silver, David, Johnson, Melvin, Antonoglou, Ioannis, Schrittwieser, Julian, Glaese, Amelia, Chen, Jilin, Pitler, Emily, Lillicrap, Timothy, Lazaridou, Angeliki, Firat, Orhan, Molloy, James, Isard, Michael, Barham, Paul R., Hennigan, Tom, Lee, Benjamin, Viola, Fabio, Reynolds, Malcolm, Xu, Yuanzhong, Doherty, Ryan, Collins, Eli, Meyer, Clemens, Rutherford, Eliza, Moreira, Erica, Ayoub, Kareem, Goel, Megha, Krawczyk, Jack, Du, Cosmo, Chi, Ed, Cheng, Heng-Tze, Ni, Eric, Shah, Purvi, Kane, Patrick, Chan, Betty, Faruqui, Manaal, Severyn, Aliaksei, Lin, Hanzhao, Li, YaGuang, Cheng, Yong, Ittycheriah, Abe, Mahdieh, Mahdis, Chen, Mia, Sun, Pei, Tran, Dustin, Bagri, Sumit, Lakshminarayanan, Balaji, Liu, Jeremiah, Orban, Andras, Güra, Fabian, Zhou, Hao, Song, Xinying, Boffy, Aurelien, Ganapathy, Harish, Zheng, Steven, Choe, HyunJeong, Weisz, Ágoston, Zhu, Tao, Lu, Yifeng, Gopal, Siddharth, Kahn, Jarrod, Kula, Maciej, Pitman, Jeff, Shah, Rushin, Taropa, Emanuel, Merey, Majd Al, Baeuml, Martin, Chen, Zhifeng, Shafey, Laurent El, Zhang, Yujing, Sercinoglu, Olcan, Tucker, George, Piqueras, Enrique, Krikun, Maxim, Barr, Iain, Savinov, Nikolay, Danihelka, Ivo, Roelofs, Becca, White, Anaïs, Andreassen, Anders, von Glehn, Tamara, Yagati, Lakshman, Kazemi, Mehran, Gonzalez, Lucas, Khalman, Misha, Sygnowski, Jakub, Frechette, Alexandre, Smith, Charlotte, Culp, Laura, Proleev, Lev, Luan, Yi, Chen, Xi, Lottes, James, Schucher, Nathan, Lebron, Federico, Rrustemi, Alban, Clay, Natalie, Crone, Phil, Kocisky, Tomas, Zhao, Jeffrey, Perz, Bartek, Yu, Dian, Howard, Heidi, Bloniarz, Adam, Rae, Jack W., Lu, Han, Sifre, Laurent, Maggioni, Marcello, Alcober, Fred, Garrette, Dan, Barnes, Megan, Thakoor, Shantanu, Austin, Jacob, Barth-Maron, Gabriel, Wong, William, Joshi, Rishabh, Chaabouni, Rahma, Fatiha, Deeni, Ahuja, Arun, Tomar, Gaurav Singh, Senter, Evan, Chadwick, Martin, Kornakov, Ilya, Attaluri, Nithya, Iturrate, Iñaki, Liu, Ruibo, Li, Yunxuan, Cogan, Sarah, Chen, Jeremy, Jia, Chao, Gu, Chenjie, Zhang, Qiao, Grimstad, Jordan, Hartman, Ale Jakse, Garcia, Xavier, Pillai, Thanumalayan Sankaranarayana, Devlin, Jacob, Laskin, Michael, Casas, Diego de Las, Valter, Dasha, Tao, Connie, Blanco, Lorenzo, Badia, Adrià Puigdomènech, Reitter, David, Chen, Mianna, Brennan, Jenny, Rivera, Clara, Brin, Sergey, Iqbal, Shariq, Surita, Gabriela, Labanowski, Jane, Rao, Abhi, Winkler, Stephanie, Parisotto, Emilio, Gu, Yiming, Olszewska, Kate, Addanki, Ravi, Miech, Antoine, Louis, Annie, Teplyashin, Denis, Brown, Geoff, Catt, Elliot, Balaguer, Jan, Xiang, Jackie, Wang, Pidong, Ashwood, Zoe, Briukhov, Anton, Webson, Albert, Ganapathy, Sanjay, Sanghavi, Smit, Kannan, Ajay, Chang, Ming-Wei, Stjerngren, Axel, Djolonga, Josip, Sun, Yuting, Bapna, Ankur, Aitchison, Matthew, Pejman, Pedram, Michalewski, Henryk, Yu, Tianhe, Wang, Cindy, Love, Juliette, Ahn, Junwhan, Bloxwich, Dawn, Han, Kehang, Humphreys, Peter, Sellam, Thibault, Bradbury, James, Godbole, Varun, Samangooei, Sina, Damoc, Bogdan, Kaskasoli, Alex, Arnold, Sébastien M. R., Vasudevan, Vijay, Agrawal, Shubham, Riesa, Jason, Lepikhin, Dmitry, Tanburn, Richard, Srinivasan, Srivatsan, Lim, Hyeontaek, Hodkinson, Sarah, Shyam, Pranav, Ferret, Johan, Hand, Steven, Garg, Ankush, Paine, Tom Le, Li, Jian, Li, Yujia, Giang, Minh, Neitz, Alexander, Abbas, Zaheer, York, Sarah, Reid, Machel, Cole, Elizabeth, Chowdhery, Aakanksha, Das, Dipanjan, Rogozińska, Dominika, Nikolaev, Vitaliy, Sprechmann, Pablo, Nado, Zachary, Zilka, Lukas, Prost, Flavien, He, Luheng, Monteiro, Marianne, Mishra, Gaurav, Welty, Chris, Newlan, Josh, Jia, Dawei, Allamanis, Miltiadis, Hu, Clara Huiyi, de Liedekerke, Raoul, Gilmer, Justin, Saroufim, Carl, Rijhwani, Shruti, Hou, Shaobo, Shrivastava, Disha, Baddepudi, Anirudh, Goldin, Alex, Ozturel, Adnan, Cassirer, Albin, Xu, Yunhan, Sohn, Daniel, Sachan, Devendra, Amplayo, Reinald Kim, Swanson, Craig, Petrova, Dessie, Narayan, Shashi, Guez, Arthur, Brahma, Siddhartha, Landon, Jessica, Patel, Miteyan, Zhao, Ruizhe, Villela, Kevin, Wang, Luyu, Jia, Wenhao, Rahtz, Matthew, Giménez, Mai, Yeung, Legg, Keeling, James, Georgiev, Petko, Mincu, Diana, Wu, Boxi, Haykal, Salem, Saputro, Rachel, Vodrahalli, Kiran, Qin, James, Cankara, Zeynep, Sharma, Abhanshu, Fernando, Nick, Hawkins, Will, Neyshabur, Behnam, Kim, Solomon, Hutter, Adrian, Agrawal, Priyanka, Castro-Ros, Alex, Driessche, George van den, Wang, Tao, Yang, Fan, Chang, Shuo-yiin, Komarek, Paul, McIlroy, Ross, Lučić, Mario, Zhang, Guodong, Farhan, Wael, Sharman, Michael, Natsev, Paul, Michel, Paul, Bansal, Yamini, Qiao, Siyuan, Cao, Kris, Shakeri, Siamak, Butterfield, Christina, Chung, Justin, Rubenstein, Paul Kishan, Agrawal, Shivani, Mensch, Arthur, Soparkar, Kedar, Lenc, Karel, Chung, Timothy, Pope, Aedan, Maggiore, Loren, Kay, Jackie, Jhakra, Priya, Wang, Shibo, Maynez, Joshua, Phuong, Mary, Tobin, Taylor, Tacchetti, Andrea, Trebacz, Maja, Robinson, Kevin, Katariya, Yash, Riedel, Sebastian, Bailey, Paige, Xiao, Kefan, Ghelani, Nimesh, Aroyo, Lora, Slone, Ambrose, Houlsby, Neil, Xiong, Xuehan, Yang, Zhen, Gribovskaya, Elena, Adler, Jonas, Wirth, Mateo, Lee, Lisa, Li, Music, Kagohara, Thais, Pavagadhi, Jay, Bridgers, Sophie, Bortsova, Anna, Ghemawat, Sanjay, Ahmed, Zafarali, Liu, Tianqi, Powell, Richard, Bolina, Vijay, Iinuma, Mariko, Zablotskaia, Polina, Besley, James, Chung, Da-Woon, Dozat, Timothy, Comanescu, Ramona, Si, Xiance, Greer, Jeremy, Su, Guolong, Polacek, Martin, Kaufman, Raphaël Lopez, Tokumine, Simon, Hu, Hexiang, Buchatskaya, Elena, Miao, Yingjie, Elhawaty, Mohamed, Siddhant, Aditya, Tomasev, Nenad, Xing, Jinwei, Greer, Christina, Miller, Helen, Ashraf, Shereen, Roy, Aurko, Zhang, Zizhao, Ma, Ada, Filos, Angelos, Besta, Milos, Blevins, Rory, Klimenko, Ted, Yeh, Chih-Kuan, Changpinyo, Soravit, Mu, Jiaqi, Chang, Oscar, Pajarskas, Mantas, Muir, Carrie, Cohen, Vered, Lan, Charline Le, Haridasan, Krishna, Marathe, Amit, Hansen, Steven, Douglas, Sholto, Samuel, Rajkumar, Wang, Mingqiu, Austin, Sophia, Lan, Chang, Jiang, Jiepu, Chiu, Justin, Lorenzo, Jaime Alonso, Sjösund, Lars Lowe, Cevey, Sébastien, Gleicher, Zach, Avrahami, Thi, Boral, Anudhyan, Srinivasan, Hansa, Selo, Vittorio, May, Rhys, Aisopos, Konstantinos, Hussenot, Léonard, Soares, Livio Baldini, Baumli, Kate, Chang, Michael B., Recasens, Adrià, Caine, Ben, Pritzel, Alexander, Pavetic, Filip, Pardo, Fabio, Gergely, Anita, Frye, Justin, Ramasesh, Vinay, Horgan, Dan, Badola, Kartikeya, Kassner, Nora, Roy, Subhrajit, Dyer, Ethan, Campos, Víctor Campos, Tomala, Alex, Tang, Yunhao, Badawy, Dalia El, White, Elspeth, Mustafa, Basil, Lang, Oran, Jindal, Abhishek, Vikram, Sharad, Gong, Zhitao, Caelles, Sergi, Hemsley, Ross, Thornton, Gregory, Feng, Fangxiaoyu, Stokowiec, Wojciech, Zheng, Ce, Thacker, Phoebe, Ünlü, Çağlar, Zhang, Zhishuai, Saleh, Mohammad, Svensson, James, Bileschi, Max, Patil, Piyush, Anand, Ankesh, Ring, Roman, Tsihlas, Katerina, Vezer, Arpi, Selvi, Marco, Shevlane, Toby, Rodriguez, Mikel, Kwiatkowski, Tom, Daruki, Samira, Rong, Keran, Dafoe, Allan, FitzGerald, Nicholas, Gu-Lemberg, Keren, Khan, Mina, Hendricks, Lisa Anne, Pellat, Marie, Feinberg, Vladimir, Cobon-Kerr, James, Sainath, Tara, Rauh, Maribeth, Hashemi, Sayed Hadi, Ives, Richard, Hasson, Yana, Noland, Eric, Cao, Yuan, Byrd, Nathan, Hou, Le, Wang, Qingze, Sottiaux, Thibault, Paganini, Michela, Lespiau, Jean-Baptiste, Moufarek, Alexandre, Hassan, Samer, Shivakumar, Kaushik, van Amersfoort, Joost, Mandhane, Amol, Joshi, Pratik, Goyal, Anirudh, Tung, Matthew, Brock, Andrew, Sheahan, Hannah, Misra, Vedant, Li, Cheng, Rakićević, Nemanja, Dehghani, Mostafa, Liu, Fangyu, Mittal, Sid, Oh, Junhyuk, Noury, Seb, Sezener, Eren, Huot, Fantine, Lamm, Matthew, De Cao, Nicola, Chen, Charlie, Mudgal, Sidharth, Stella, Romina, Brooks, Kevin, Vasudevan, Gautam, Liu, Chenxi, Chain, Mainak, Melinkeri, Nivedita, Cohen, Aaron, Wang, Venus, Seymore, Kristie, Zubkov, Sergey, Goel, Rahul, Yue, Summer, Krishnakumaran, Sai, Albert, Brian, Hurley, Nate, Sano, Motoki, Mohananey, Anhad, Joughin, Jonah, Filonov, Egor, Kępa, Tomasz, Eldawy, Yomna, Lim, Jiawern, Rishi, Rahul, Badiezadegan, Shirin, Bos, Taylor, Chang, Jerry, Jain, Sanil, Padmanabhan, Sri Gayatri Sundara, Puttagunta, Subha, Krishna, Kalpesh, Baker, Leslie, Kalb, Norbert, Bedapudi, Vamsi, Kurzrok, Adam, Lei, Shuntong, Yu, Anthony, Litvin, Oren, Zhou, Xiang, Wu, Zhichun, Sobell, Sam, Siciliano, Andrea, Papir, Alan, Neale, Robby, Bragagnolo, Jonas, Toor, Tej, Chen, Tina, Anklin, Valentin, Wang, Feiran, Feng, Richie, Gholami, Milad, Ling, Kevin, Liu, Lijuan, Walter, Jules, Moghaddam, Hamid, Kishore, Arun, Adamek, Jakub, Mercado, Tyler, Mallinson, Jonathan, Wandekar, Siddhinita, Cagle, Stephen, Ofek, Eran, Garrido, Guillermo, Lombriser, Clemens, Mukha, Maksim, Sun, Botu, Mohammad, Hafeezul Rahman, Matak, Josip, Qian, Yadi, Peswani, Vikas, Janus, Pawel, Yuan, Quan, Schelin, Leif, David, Oana, Garg, Ankur, He, Yifan, Duzhyi, Oleksii, Älgmyr, Anton, Lottaz, Timothée, Li, Qi, Yadav, Vikas, Xu, Luyao, Chinien, Alex, Shivanna, Rakesh, Chuklin, Aleksandr, Li, Josie, Spadine, Carrie, Wolfe, Travis, Mohamed, Kareem, Das, Subhabrata, Dai, Zihang, He, Kyle, von Dincklage, Daniel, Upadhyay, Shyam, Maurya, Akanksha, Chi, Luyan, Krause, Sebastian, Salama, Khalid, Rabinovitch, Pam G, M, Pavan Kumar Reddy, Selvan, Aarush, Dektiarev, Mikhail, Ghiasi, Golnaz, Guven, Erdem, Gupta, Himanshu, Liu, Boyi, Sharma, Deepak, Shtacher, Idan Heimlich, Paul, Shachi, Akerlund, Oscar, Aubet, François-Xavier, Huang, Terry, Zhu, Chen, Zhu, Eric, Teixeira, Elico, Fritze, Matthew, Bertolini, Francesco, Marinescu, Liana-Eleonora, Bölle, Martin, Paulus, Dominik, Gupta, Khyatti, Latkar, Tejasi, Chang, Max, Sanders, Jason, Wilson, Roopa, Wu, Xuewei, Tan, Yi-Xuan, Thiet, Lam Nguyen, Doshi, Tulsee, Lall, Sid, Mishra, Swaroop, Chen, Wanming, Luong, Thang, Benjamin, Seth, Lee, Jasmine, Andrejczuk, Ewa, Rabiej, Dominik, Ranjan, Vipul, Styrc, Krzysztof, Yin, Pengcheng, Simon, Jon, Harriott, Malcolm Rose, Bansal, Mudit, Robsky, Alexei, Bacon, Geoff, Greene, David, Mirylenka, Daniil, Zhou, Chen, Sarvana, Obaid, Goyal, Abhimanyu, Andermatt, Samuel, Siegler, Patrick, Horn, Ben, Israel, Assaf, Pongetti, Francesco, Chen, Chih-Wei "Louis", Selvatici, Marco, Silva, Pedro, Wang, Kathie, Tolins, Jackson, Guu, Kelvin, Yogev, Roey, Cai, Xiaochen, Agostini, Alessandro, Shah, Maulik, Nguyen, Hung, Donnaile, Noah Ó, Pereira, Sébastien, Friso, Linda, Stambler, Adam, Kuang, Chenkai, Romanikhin, Yan, Geller, Mark, Yan, ZJ, Jang, Kane, Lee, Cheng-Chun, Fica, Wojciech, Malmi, Eric, Tan, Qijun, Banica, Dan, Balle, Daniel, Pham, Ryan, Huang, Yanping, Avram, Diana, Shi, Hongzhi, Singh, Jasjot, Hidey, Chris, Ahuja, Niharika, Saxena, Pranab, Dooley, Dan, Potharaju, Srividya Pranavi, O'Neill, Eileen, Gokulchandran, Anand, Foley, Ryan, Zhao, Kai, Dusenberry, Mike, Liu, Yuan, Mehta, Pulkit, Kotikalapudi, Ragha, Safranek-Shrader, Chalence, Goodman, Andrew, Kessinger, Joshua, Globen, Eran, Kolhar, Prateek, Gorgolewski, Chris, Ibrahim, Ali, Song, Yang, Eichenbaum, Ali, Brovelli, Thomas, Potluri, Sahitya, Lahoti, Preethi, Baetu, Cip, Ghorbani, Ali, Chen, Charles, Crawford, Andy, Pal, Shalini, Sridhar, Mukund, Gurita, Petru, Mujika, Asier, Petrovski, Igor, Cedoz, Pierre-Louis, Li, Chenmei, Chen, Shiyuan, Santo, Niccolò Dal, Goyal, Siddharth, Punjabi, Jitesh, Kappaganthu, Karthik, Kwak, Chester, LV, Pallavi, Velury, Sarmishta, Choudhury, Himadri, Hall, Jamie, Shah, Premal, Figueira, Ricardo, Thomas, Matt, Lu, Minjie, Zhou, Ting, Kumar, Chintu, Jurdi, Thomas, Chikkerur, Sharat, Ma, Yenai, Yu, Adams, Kwak, Soo, Ähdel, Victor, Rajayogam, Sujeevan, Choma, Travis, Liu, Fei, Barua, Aditya, Ji, Colin, Park, Ji Ho, Hellendoorn, Vincent, Bailey, Alex, Bilal, Taylan, Zhou, Huanjie, Khatir, Mehrdad, Sutton, Charles, Rzadkowski, Wojciech, Macintosh, Fiona, Shagin, Konstantin, Medina, Paul, Liang, Chen, Zhou, Jinjing, Shah, Pararth, Bi, Yingying, Dankovics, Attila, Banga, Shipra, Lehmann, Sabine, Bredesen, Marissa, Lin, Zifan, Hoffmann, John Eric, Lai, Jonathan, Chung, Raynald, Yang, Kai, Balani, Nihal, Bražinskas, Arthur, Sozanschi, Andrei, Hayes, Matthew, Alcalde, Héctor Fernández, Makarov, Peter, Chen, Will, Stella, Antonio, Snijders, Liselotte, Mandl, Michael, Kärrman, Ante, Nowak, Paweł, Wu, Xinyi, Dyck, Alex, Vaidyanathan, Krishnan, R, Raghavender, Mallet, Jessica, Rudominer, Mitch, Johnston, Eric, Mittal, Sushil, Udathu, Akhil, Christensen, Janara, Verma, Vishal, Irving, Zach, Santucci, Andreas, Elsayed, Gamaleldin, Davoodi, Elnaz, Georgiev, Marin, Tenney, Ian, Hua, Nan, Cideron, Geoffrey, Leurent, Edouard, Alnahlawi, Mahmoud, Georgescu, Ionut, Wei, Nan, Zheng, Ivy, Scandinaro, Dylan, Jiang, Heinrich, Snoek, Jasper, Sundararajan, Mukund, Wang, Xuezhi, Ontiveros, Zack, Karo, Itay, Cole, Jeremy, Rajashekhar, Vinu, Tumeh, Lara, Ben-David, Eyal, Jain, Rishub, Uesato, Jonathan, Datta, Romina, Bunyan, Oskar, Wu, Shimu, Zhang, John, Stanczyk, Piotr, Zhang, Ye, Steiner, David, Naskar, Subhajit, Azzam, Michael, Johnson, Matthew, Paszke, Adam, Chiu, Chung-Cheng, Elias, Jaume Sanchez, Mohiuddin, Afroz, Muhammad, Faizan, Miao, Jin, Lee, Andrew, Vieillard, Nino, Park, Jane, Zhang, Jiageng, Stanway, Jeff, Garmon, Drew, Karmarkar, Abhijit, Dong, Zhe, Lee, Jong, Kumar, Aviral, Zhou, Luowei, Evens, Jonathan, Isaac, William, Irving, Geoffrey, Loper, Edward, Fink, Michael, Arkatkar, Isha, Chen, Nanxin, Shafran, Izhak, Petrychenko, Ivan, Chen, Zhe, Jia, Johnson, Levskaya, Anselm, Zhu, Zhenkai, Grabowski, Peter, Mao, Yu, Magni, Alberto, Yao, Kaisheng, Snaider, Javier, Casagrande, Norman, Palmer, Evan, Suganthan, Paul, Castaño, Alfonso, Giannoumis, Irene, Kim, Wooyeol, Rybiński, Mikołaj, Sreevatsa, Ashwin, Prendki, Jennifer, Soergel, David, Goedeckemeyer, Adrian, Gierke, Willi, Jafari, Mohsen, Gaba, Meenu, Wiesner, Jeremy, Wright, Diana Gage, Wei, Yawen, Vashisht, Harsha, Kulizhskaya, Yana, Hoover, Jay, Le, Maigo, Li, Lu, Iwuanyanwu, Chimezie, Liu, Lu, Ramirez, Kevin, Khorlin, Andrey, Cui, Albert, LIN, Tian, Wu, Marcus, Aguilar, Ricardo, Pallo, Keith, Chakladar, Abhishek, Perng, Ginger, Abellan, Elena Allica, Zhang, Mingyang, Dasgupta, Ishita, Kushman, Nate, Penchev, Ivo, Repina, Alena, Wu, Xihui, van der Weide, Tom, Ponnapalli, Priya, Kaplan, Caroline, Simsa, Jiri, Li, Shuangfeng, Dousse, Olivier, Piper, Jeff, Ie, Nathan, Pasumarthi, Rama, Lintz, Nathan, Vijayakumar, Anitha, Andor, Daniel, Valenzuela, Pedro, Lui, Minnie, Paduraru, Cosmin, Peng, Daiyi, Lee, Katherine, Zhang, Shuyuan, Greene, Somer, Nguyen, Duc Dung, Kurylowicz, Paula, Hardin, Cassidy, Dixon, Lucas, Janzer, Lili, Choo, Kiam, Feng, Ziqiang, Zhang, Biao, Singhal, Achintya, Du, Dayou, McKinnon, Dan, Antropova, Natasha, Bolukbasi, Tolga, Keller, Orgad, Reid, David, Finchelstein, Daniel, Raad, Maria Abi, Crocker, Remi, Hawkins, Peter, Dadashi, Robert, Gaffney, Colin, Franko, Ken, Bulanova, Anna, Leblond, Rémi, Chung, Shirley, Askham, Harry, Cobo, Luis C., Xu, Kelvin, Fischer, Felix, Xu, Jun, Sorokin, Christina, Alberti, Chris, Lin, Chu-Cheng, Evans, Colin, Dimitriev, Alek, Forbes, Hannah, Banarse, Dylan, Tung, Zora, Omernick, Mark, Bishop, Colton, Sterneck, Rachel, Jain, Rohan, Xia, Jiawei, Amid, Ehsan, Piccinno, Francesco, Wang, Xingyu, Banzal, Praseem, Mankowitz, Daniel J., Polozov, Alex, Krakovna, Victoria, Brown, Sasha, Bateni, MohammadHossein, Duan, Dennis, Firoiu, Vlad, Thotakuri, Meghana, Natan, Tom, Geist, Matthieu, Girgin, Ser tan, Li, Hui, Ye, Jiayu, Roval, Ofir, Tojo, Reiko, Kwong, Michael, Lee-Thorp, James, Yew, Christopher, Sinopalnikov, Danila, Ramos, Sabela, Mellor, John, Sharma, Abhishek, Wu, Kathy, Miller, David, Sonnerat, Nicolas, Vnukov, Denis, Greig, Rory, Beattie, Jennifer, Caveness, Emily, Bai, Libin, Eisenschlos, Julian, Korchemniy, Alex, Tsai, Tomy, Jasarevic, Mimi, Kong, Weize, Dao, Phuong, Zheng, Zeyu, Liu, Frederick, Zhu, Rui, Teh, Tian Huey, Sanmiya, Jason, Gladchenko, Evgeny, Trdin, Nejc, Toyama, Daniel, Rosen, Evan, Tavakkol, Sasan, Xue, Linting, Elkind, Chen, Woodman, Oliver, Carpenter, John, Papamakarios, George, Kemp, Rupert, Kafle, Sushant, Grunina, Tanya, Sinha, Rishika, Talbert, Alice, Wu, Diane, Owusu-Afriyie, Denese, Thornton, Chloe, Pont-Tuset, Jordi, Narayana, Pradyumna, Li, Jing, Fatehi, Saaber, Wieting, John, Ajmeri, Omar, Uria, Benigno, Ko, Yeongil, Knight, Laura, Héliou, Amélie, Niu, Ning, Gu, Shane, Pang, Chenxi, Li, Yeqing, Levine, Nir, Stolovich, Ariel, Santamaria-Fernandez, Rebeca, Goenka, Sonam, Yustalim, Wenny, Strudel, Robin, Elqursh, Ali, Deck, Charlie, Lee, Hyo, Li, Zonglin, Levin, Kyle, Hoffmann, Raphael, Holtmann-Rice, Dan, Bachem, Olivier, Arora, Sho, Koh, Christy, Yeganeh, Soheil Hassas, Põder, Siim, Tariq, Mukarram, Sun, Yanhua, Ionita, Lucian, Seyedhosseini, Mojtaba, Tafti, Pouya, Liu, Zhiyu, Gulati, Anmol, Liu, Jasmine, Ye, Xinyu, Chrzaszcz, Bart, Wang, Lily, Sethi, Nikhil, Li, Tianrun, Brown, Ben, Singh, Shreya, Fan, Wei, Parisi, Aaron, Stanton, Joe, Koverkathu, Vinod, Choquette-Choo, Christopher A., Li, Yunjie, Lu, TJ, Shroff, Prakash, Varadarajan, Mani, Bahargam, Sanaz, Willoughby, Rob, Gaddy, David, Desjardins, Guillaume, Cornero, Marco, Robenek, Brona, Mittal, Bhavishya, Albrecht, Ben, Shenoy, Ashish, Moiseev, Fedor, Jacobsson, Henrik, Ghaffarkhah, Alireza, Rivière, Morgane, Walton, Alanna, Crepy, Clément, Parrish, Alicia, Zhou, Zongwei, Farabet, Clement, Radebaugh, Carey, Srinivasan, Praveen, van der Salm, Claudia, Fidjeland, Andreas, Scellato, Salvatore, Latorre-Chimoto, Eri, Klimczak-Plucińska, Hanna, Bridson, David, de Cesare, Dario, Hudson, Tom, Mendolicchio, Piermaria, Walker, Lexi, Morris, Alex, Mauger, Matthew, Guseynov, Alexey, Reid, Alison, Odoom, Seth, Loher, Lucia, Cotruta, Victor, Yenugula, Madhavi, Grewe, Dominik, Petrushkina, Anastasia, Duerig, Tom, Sanchez, Antonio, Yadlowsky, Steve, Shen, Amy, Globerson, Amir, Webb, Lynette, Dua, Sahil, Li, Dong, Bhupatiraju, Surya, Hurt, Dan, Qureshi, Haroon, Agarwal, Ananth, Shani, Tomer, Eyal, Matan, Khare, Anuj, Belle, Shreyas Rammohan, Wang, Lei, Tekur, Chetan, Kale, Mihir Sanjay, Wei, Jinliang, Sang, Ruoxin, Saeta, Brennan, Liechty, Tyler, Sun, Yi, Zhao, Yao, Lee, Stephan, Nayak, Pandu, Fritz, Doug, Vuyyuru, Manish Reddy, Aslanides, John, Vyas, Nidhi, Wicke, Martin, Ma, Xiao, Eltyshev, Evgenii, Martin, Nina, Cate, Hardie, Manyika, James, Amiri, Keyvan, Kim, Yelin, Xiong, Xi, Kang, Kai, Luisier, Florian, Tripuraneni, Nilesh, Madras, David, Guo, Mandy, Waters, Austin, Wang, Oliver, Ainslie, Joshua, Baldridge, Jason, Zhang, Han, Pruthi, Garima, Bauer, Jakob, Yang, Feng, Mansour, Riham, Gelman, Jason, Xu, Yang, Polovets, George, Liu, Ji, Cai, Honglong, Chen, Warren, Sheng, XiangHai, Xue, Emily, Ozair, Sherjil, Angermueller, Christof, Li, Xiaowei, Sinha, Anoop, Wang, Weiren, Wiesinger, Julia, Koukoumidis, Emmanouil, Tian, Yuan, Iyer, Anand, Gurumurthy, Madhu, Goldenson, Mark, Shah, Parashar, Blake, MK, Yu, Hongkun, Urbanowicz, Anthony, Palomaki, Jennimaria, Fernando, Chrisantha, Durden, Ken, Mehta, Harsh, Momchev, Nikola, Rahimtoroghi, Elahe, Georgaki, Maria, Raul, Amit, Ruder, Sebastian, Redshaw, Morgan, Lee, Jinhyuk, Zhou, Denny, Jalan, Komal, Li, Dinghua, Hechtman, Blake, Schuh, Parker, Nasr, Milad, Milan, Kieran, Mikulik, Vladimir, Franco, Juliana, Green, Tim, Nguyen, Nam, Kelley, Joe, Mahendru, Aroma, Hu, Andrea, Howland, Joshua, Vargas, Ben, Hui, Jeffrey, Bansal, Kshitij, Rao, Vikram, Ghiya, Rakesh, Wang, Emma, Ye, Ke, Sarr, Jean Michel, Preston, Melanie Moranski, Elish, Madeleine, Li, Steve, Kaku, Aakash, Gupta, Jigar, Pasupat, Ice, Juan, Da-Cheng, Someswar, Milan, M., Tejvi, Chen, Xinyun, Amini, Aida, Fabrikant, Alex, Chu, Eric, Dong, Xuanyi, Muthal, Amruta, Buthpitiya, Senaka, Jauhari, Sarthak, Khandelwal, Urvashi, Hitron, Ayal, Ren, Jie, Rinaldi, Larissa, Drath, Shahar, Dabush, Avigail, Jiang, Nan-Jiang, Godhia, Harshal, Sachs, Uli, Chen, Anthony, Fan, Yicheng, Taitelbaum, Hagai, Noga, Hila, Dai, Zhuyun, Wang, James, Hamer, Jenny, Ferng, Chun-Sung, Elkind, Chenel, Atias, Aviel, Lee, Paulina, Listík, Vít, Carlen, Mathias, van de Kerkhof, Jan, Pikus, Marcin, Zaher, Krunoslav, Müller, Paul, Zykova, Sasha, Stefanec, Richard, Gatsko, Vitaly, Hirnschall, Christoph, Sethi, Ashwin, Xu, Xingyu Federico, Ahuja, Chetan, Tsai, Beth, Stefanoiu, Anca, Feng, Bo, Dhandhania, Keshav, Katyal, Manish, Gupta, Akshay, Parulekar, Atharva, Pitta, Divya, Zhao, Jing, Bhatia, Vivaan, Bhavnani, Yashodha, Alhadlaq, Omar, Li, Xiaolin, Danenberg, Peter, Tu, Dennis, Pine, Alex, Filippova, Vera, Ghosh, Abhipso, Limonchik, Ben, Urala, Bhargava, Lanka, Chaitanya Krishna, Clive, Derik, Li, Edward, Wu, Hao, Hongtongsak, Kevin, Li, Ianna, Thakkar, Kalind, Omarov, Kuanysh, Majmundar, Kushal, Alverson, Michael, Kucharski, Michael, Patel, Mohak, Jain, Mudit, Zabelin, Maksim, Pelagatti, Paolo, Kohli, Rohan, Kumar, Saurabh, Kim, Joseph, Sankar, Swetha, Shah, Vineet, Ramachandruni, Lakshmi, Zeng, Xiangkai, Bariach, Ben, Weidinger, Laura, Vu, Tu, Andreev, Alek, He, Antoine, Hui, Kevin, Kashem, Sheleem, Subramanya, Amar, Hsiao, Sissie, Hassabis, Demis, Kavukcuoglu, Koray, Sadovsky, Adam, Le, Quoc, Strohman, Trevor, Wu, Yonghui, Petrov, Slav, Dean, Jeffrey, and Vinyals, Oriol

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition
Abstract

This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI.

Published
2023

17. Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark

Author

Mayhew, Stephen, Blevins, Terra, Liu, Shuheng, Šuppa, Marek, Gonen, Hila, Imperial, Joseph Marvin, Karlsson, Börje F., Lin, Peiqin, Ljubešić, Nikola, Miranda, LJ, Plank, Barbara, Riabi, Arij, and Pinter, Yuval

Subjects
Computer Science - Computation and Language
Abstract

We introduce Universal NER (UNER), an open, community-driven project to develop gold-standard NER benchmarks in many languages. The overarching goal of UNER is to provide high-quality, cross-lingually consistent annotations to facilitate and standardize multilingual NER research. UNER v1 contains 18 datasets annotated with named entities in a cross-lingual consistent schema across 12 diverse languages. In this paper, we detail the dataset creation and composition of UNER; we also provide initial modeling baselines on both in-language and cross-lingual learning settings. We release the data, code, and fitted models to the public., Comment: NAACL 2024 Camera-ready

Published
2023

18. Detecting Pretraining Data from Large Language Models

Author

Shi, Weijia, Ajith, Anirudh, Xia, Mengzhou, Huang, Yangsibo, Liu, Daogao, Blevins, Terra, Chen, Danqi, and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language, Computer Science - Cryptography and Security, Computer Science - Machine Learning
Abstract

Although large language models (LLMs) are widely deployed, the data used to train them is rarely disclosed. Given the incredible scale of this data, up to trillions of tokens, it is all but certain that it includes potentially problematic text such as copyrighted materials, personally identifiable information, and test data for widely reported reference benchmarks. However, we currently have no way to know which data of these types is included or in what proportions. In this paper, we study the pretraining data detection problem: given a piece of text and black-box access to an LLM without knowing the pretraining data, can we determine if the model was trained on the provided text? To facilitate this study, we introduce a dynamic benchmark WIKIMIA that uses data created before and after model training to support gold truth detection. We also introduce a new detection method Min-K% Prob based on a simple hypothesis: an unseen example is likely to contain a few outlier words with low probabilities under the LLM, while a seen example is less likely to have words with such low probabilities. Min-K% Prob can be applied without any knowledge about the pretraining corpus or any additional training, departing from previous detection methods that require training a reference model on data that is similar to the pretraining data. Moreover, our experiments demonstrate that Min-K% Prob achieves a 7.4% improvement on WIKIMIA over these previous methods. We apply Min-K% Prob to three real-world scenarios, copyrighted book detection, contaminated downstream example detection and privacy auditing of machine unlearning, and find it a consistently effective solution.

Published
2023

19. Plasmon Fizeau drag in 3D Dirac and Weyl semimetals

Author

Blevins, Morgan G. and Boriskina, Svetlana V.

Subjects
Condensed Matter - Mesoscale and Nanoscale Physics, Physics - Optics
Abstract

There is a need for compact, dynamically tunable nonreciprocal optical elements to enable on-chip-compatible optical isolators and more efficient radiative energy transfer systems. Plasmon Fizeau drag, the drag of electrical current on propagating surface plasmon polaritons, has been proposed to induce nonreciprocal surface modes to enable one-way energy transport. However, relativistic electron drift velocities are required to induce appreciable contrast between the dispersion characteristics of co-propagating and counter-propagating surface plasmon modes. The high electron drift velocity of graphene previously allowed for the experimental demonstration of current-induced nonreciprocity in a two-dimensional (2D) Dirac material. The high electron drift and Fermi velocities in three-dimensional (3D) Dirac materials make them ideal candidates for the effect, however, both the theory of the Fizeau drag effect and its experimental demonstrations in 3D Dirac materials are missing. Here we develop a comprehensive theory of Fizeau drag in DC-biased 3D Weyl semimetals (WSM) or Dirac semimetals (DSM), both under local and non-local approximation and with dissipative losses. We predict that under practical assumptions for loss, Fizeau drag in the DSM Cd$_3$As$_2$ opens windows of pseudo-unidirectional transport. We additionally introduce new figures of merit to rank nonreciprocal plasmonic systems by their potential for directional SPP transport. Further, we propose a new approach for achieving appreciable plasmonic Fizeau drag via optically pumping bulk inversion symmetry breaking WSMs or DSMs.

Published
2023
Full Text
View/download PDF

20. Differentiating Phonics Instruction for Maximum Impact: How to Scaffold Whole-Group Instruction so All Students Can Access Grade-Level Content. Corwin Literacy

Author

Wiley Blevins and Wiley Blevins

Abstract

Author Wiley Blevins is renowned for changing the way educators think about teaching children to read, helping thousands of teachers implement effective phonics instruction. Now, Blevins gets us to think in powerful new ways about differentiating whole-class phonics lessons, so students at every skill level can engage. With Blevins' trademark clarity, "Differentiating Phonics Instruction for Maximum Impact" provides: (1) High-impact routines that focus on the skills known to develop students' literacy best; (2) Differentiated application of these routines--with fun multi-modal games and variations--for students working on- below-, and above grade-level expectations, and for multilingual learners; (3) Guidelines for creating skills-based small groups for more intensive work; (4) "Look-fors" for teachers and supervisors, to know when instruction is working or needs to be adjusted; and (5) Several reproducible phonics and spelling assessments for placement, progress monitoring, and formative assessments to keep every learner growing as readers and writers. Differentiation needs to be in the DNA of every instructional plan--so all students' skills progress every day. That's a tall order, but with this resource, teachers discover that over time, doing the routines gives them a nimble, global sense of their learners and makes teaching more impactful and learning to read more joyful.

Published
2024

21. The Importance of Civic Culture: Toward Intellectual Solidarity and Community Agency

Author

Kevin Russel Magill, Nate Scholten, Brooke Blevins, and Victoria Davis Smith

Abstract

In this critical case study, we examined the ways civic culture developed at an action civics summer camp and provided implications for civics teaching and learning. Findings highlight how the camp context produced and simultaneously failed to yield a culturally participatory inclusive civic culture. Specifically, we found the emphasis on dialogue, inquiry, and attention to place during the camp experience supported actors in developing positive civic culture exchanges. However, the civic culture that emerged at the camp also included white hetero-normative cultural practices and ideologies which discouraged participation among some students with non-dominant identities. Further, students of all identities did little to engage in civic experiences beyond the camp. We suggest that these shortcomings might be overcome by intentionally designing learning experiences to address these concerns, supporting counselors to understand how to mediate sensitive projects, and demonstrating to students how to perpetually engage with civic concerns.

Published
2024
Full Text
View/download PDF

24. Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages

Author

Downey, C. M., Blevins, Terra, Goldfine, Nora, and Steinert-Threlkeld, Shane

Subjects
Computer Science - Computation and Language
Abstract

Pre-trained multilingual language models underpin a large portion of modern NLP tools outside of English. A strong baseline for specializing these models for specific languages is Language-Adaptive Pre-Training (LAPT). However, retaining a large cross-lingual vocabulary and embedding matrix comes at considerable excess computational cost during adaptation. In this study, we propose several simple techniques to replace a cross-lingual vocabulary with a compact, language-specific one. Namely, we address strategies for re-initializing the token embedding matrix after vocabulary specialization. We then provide a systematic experimental comparison of our techniques, in addition to the recently-proposed Focus method. We demonstrate that: 1) Embedding-replacement techniques in the monolingual transfer literature are inadequate for adapting multilingual models. 2) Replacing cross-lingual vocabularies with smaller specialized ones provides an efficient method to improve performance in low-resource languages. 3) Simple embedding re-initialization techniques based on script-wise sub-distributions rival techniques such as Focus, which rely on similarity scores obtained from an auxiliary model., Comment: Camera-ready for Proceedings of the 3rd Workshop on Multilingual Representation Learning

Published
2023

26. Chronic obstructive lung disease and posttraumatic stress disorder: current perspectives

Author

Abrams TE, Blevins A, and Vander Weg MW

Subjects
Diseases of the respiratory system, RC705-779
Abstract

Thad E Abrams,1,2 Amy Blevins,1,3 Mark W Vander Weg1,2,4 1Department of Internal Medicine, University of Iowa, 2Center for Comprehensive Access and Delivery Research and Evaluation, Iowa City VA Health Care System, 3Hardin Health Sciences Library, 4Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA Background: Several studies have reported on the co-occurrence of chronic obstructive pulmonary disease (COPD) and psychiatric conditions, with the most robust evidence base demonstrating an impact of comorbid anxiety and depression on COPD-related outcomes. In recent years, research has sought to determine if there is a co-occurrence between COPD and posttraumatic stress disorder (PTSD) as well as for associations between PTSD and COPD-related outcomes. To date, there have been no published reviews summarizing this emerging literature.Objectives: The primary objective of this review was to determine if there is adequate evidence to support a co-occurrence between PTSD and COPD. Secondary objectives were to: 1) determine if there are important clinical considerations regarding the impact of PTSD on COPD management, and 2) identify targeted areas for further research.Methods: A structured review was performed using a systematic search strategy limited to studies in English, addressing adults, and to articles that examined: 1) the co-occurrence of COPD and PTSD and 2) the impact of PTSD on COPD-related outcomes. To be included, articles must have addressed some type of nonreversible obstructive lung pathology.Results: A total of 598 articles were identified for initial review. Upon applying the inclusion and exclusion criteria, n=19 articles or abstracts addressed our stated objectives. Overall, there is inconclusive evidence to support the co-occurrence between PTSD and COPD. Studies finding a significant co-occurrence generally had inferior methods of identifying COPD; in contrast, studies that utilized more robust COPD measures (such as a physician exam) generally failed to find a relationship. Among studies that examined the impact of PTSD on COPD-related outcomes, there was more consistent evidence that PTSD affects the perception of respiratory symptom burden and management. In addition, methods for measuring an important confounder (smoking) were generally lacking.Conclusion: There is inconclusive evidence to support the co-occurrence of COPD and PTSD. There was stronger evidence implicating PTSD as an important comorbidity impacting COPD management. Further research is needed to: 1) determine whether or not COPD and PTSD are likely to be comorbid, and 2) further elucidate the mechanisms connecting PTSD and COPD-related outcomes. Keywords: chronic lung disease, nonproductive cough, WTC cough syndrome, posttraumatic stress disorder, Veterans

Published
2015

27. BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer

Author

Asai, Akari, Kudugunta, Sneha, Yu, Xinyan Velocity, Blevins, Terra, Gonen, Hila, Reid, Machel, Tsvetkov, Yulia, Ruder, Sebastian, and Hajishirzi, Hannaneh

Subjects
Computer Science - Computation and Language
Abstract

Despite remarkable advancements in few-shot generalization in natural language processing, most models are developed and evaluated primarily in English. To facilitate research on few-shot cross-lingual transfer, we introduce a new benchmark, called BUFFET, which unifies 15 diverse tasks across 54 languages in a sequence-to-sequence format and provides a fixed set of few-shot examples and instructions. BUFFET is designed to establish a rigorous and equitable evaluation framework for few-shot cross-lingual transfer across a broad range of tasks and languages. Using BUFFET, we perform thorough evaluations of state-of-the-art multilingual large language models with different transfer methods, namely in-context learning and fine-tuning. Our findings reveal significant room for improvement in few-shot in-context cross-lingual transfer. In particular, ChatGPT with in-context learning often performs worse than much smaller mT5-base models fine-tuned on English task data and few-shot in-language examples. Our analysis suggests various avenues for future research in few-shot cross-lingual transfer, such as improved pretraining, understanding, and future evaluations., Comment: The data and code is available at https://buffetfs.github.io/

Published
2023

28. Coronal Heating as Determined by the Solar Flare Frequency Distribution Obtained by Aggregating Case Studies

Author

Mason, James Paul, Werth, Alexandra, West, Colin G., Youngblood, Allison A., Woodraska, Donald L., Peck, Courtney, Lacjak, Kevin, Frick, Florian G., Gabir, Moutamen, Alsinan, Reema A., Jacobsen, Thomas, Alrubaie, Mohammad, Chizmar, Kayla M., Lau, Benjamin P., Dominguez, Lizbeth Montoya, Price, David, Butler, Dylan R., Biron, Connor J., Feoktistov, Nikita, Dewey, Kai, Loomis, N. E., Bodzianowski, Michal, Kuybus, Connor, Dietrick, Henry, Wolfe, Aubrey M., Guerrero, Matt, Vinson, Jessica, Starbuck, Peter, Litton, Shelby D, Beck, M. G., Fisch, Jean-Paul, West, Ayana, Muniz, Alexis A., Chavez, Luis, Upthegrove, Zachary T., Runyon, Brenton M., Salazar, J., Kritzberg, Jake E., Murrel, Tyler, Ho, Ella, LaFemina, Quintin Y., Elbashir, Sara I., Chang, Ethan C., Hudson, Zachary A., Nussbaum, Rosemary O., Kennedy, Kellen, Kim, Kevin, Arango, Camila Villamil, Albakr, Mohammed A., Rotter, Michael, Garscadden, A. J., Salcido-Alcontar JR, Antonio, Pearl, Harrison M., Stepaniak, Tyler, Marquez, Josie A., Marsh, Lauren, Andringa, Jesse C, Osogwin, Austin, Shields, Amanda M., Brookins, Sarah, Hach, Grace K., Clausi, Alexis R., Millican, Emily B., Jaimes, Alan A, Graham, Alaina S., Burritt, John J., Perez, J. S., Ramirez, Nathaniel, Suri, Rohan, Myer, Michael S., Kresek, Zoe M., Goldsberry, C. A., Payne, Genevieve K., Jourabchi, Tara, Hu, J., Lucca, Jeffrey, Feng, Zitian, Gilpatrick, Connor B., Khan, Ibraheem A., Warble, Keenan, Sweeney, Joshua D., Dorricott, Philip, Meyer, Ethan, Kothamdi, Yash S., Sohail, Arman S., Grell, Kristyn, Floyd, Aidan, Bard, Titus, Mathieson, Randi M., Reed, Joseph, Cisneros, Alexis, Payne, Matthew P., Jarriel, J. R., Mora, Jacqueline Rodriguez, Sundell, M. E., Patel, Kajal, Alesmail, Mohammad, Alnasrallah, Yousef A, Abdullah, Jumana T., Molina-Saenz, Luis, Tayman, K. E., Brown, Gabriel T., Kerr-Layton, Liana, Berriman-Rozen, Zachary D., Hiatt, Quinn, Kalra, Etash, Ong, Jason, Vadayar, Shreenija, Shannahan, Callie D., Benke, Evan, zhang, Jinhua, Geisman, Jane, Martyr, Cara, Ameijenda, Federico, Akruwala, Ushmi H., Nehring, Molly, Kissner, Natalie, Rule, Ian C., Learned, Tyler, Smith, Alexandra N., Mazzotta, Liam, Rounsefell, Tyndall, Eyeson, Elizabeth A., Shelby, Arlee K., Moll, Tyler S, Menke, Riley, Shahba, Hannan, House Jr., Tony A., Clark, David B., Burns, Annemarie C., de La Beaujardiere, Tristan, Trautwein, Emily D., Plantz, Will, Reeves, Justin, Faber, Ian, Buxton, B. W., Highhouse, Nigel, Landrey, Kalin, Hansen, Connor M, Chen, Kevin, Hales, Ryder Buchanan, Borgerding, Luke R., Guo, Mutian, Crow, Christian J., Whittall, Lloyd C., Simmons, Conor, Folarin, Adeduni, Parkinson, Evan J., Rahn, Anna L., Blevins, Olivia, Morelock, Annalise M., Kelly, Nicholas, Parker, Nathan L., Smith, Kelly, Plzak, Audrey E., Saeb, David, Hares, Cameron T., Parker, Sasha R., McCoy, Andrew, Pham, Alexander V., Lauzon, Megan, Kennedy, Cayla J., Reyna, Andrea B., Acosta, Daniela M. Meza, Cool, Destiny J., Steinbarth, Sheen L., Mendoza-Anselmi, Patricia, Plutt, Kaitlyn E., Kipp, Isabel M, Rakhmonova, M., Brown, Cameron L., Van Anne, Gabreece, Moss, Alexander P., Golden, Olivia, Kirkpatrick, Hunter B., Colleran, Jake R., Sullivan, Brandon J, Tran, Kevin, Carpender, Michael Andrew, Mundy, Aria T., Koenig, Greta, Oudakker, Jessica, Engelhardt, Rasce, Ales, Nolan, Wexler, Ethan Benjamin, Beato, Quinn I, Chen, Lily, Cochran, Brooke, Hill, Paula, Hamilton, Sean R., Hashiro, Kyle, Khan, Usman, Martinez, Alexa M., Brockman, Jennifer L., Mallory, Macguire, Reed, Charlie, Terrile, Richard, Singh, Savi, Watson, James Adam, Creany, Joshua B., Price, Nicholas K., Miften, Aya M., Tran, Bryn, Kamenetskiy, Margaret, Martinez, Jose R., Opp, Elena N., Huang, Jianyang, Fails, Avery M., Belei, Brennan J., Slocum, Ryan, Astalos, Justin, East, Andrew, Nguyen, Lena P., Pherigo, Callie C, East, Andrew N., Li, David Y., Nelson, Maya LI, Taylor, Nicole, Odbayar, Anand, Rives, Anna Linnea, Mathur, Kabir P., Billingsley, Jacob, Polikoff, Hyden, Driscoll, Michael, Wilson, Orion K., Lahmers, Kyle, Toon, Nathaniel J., Lippincott, Sam, Musgrave, Andrew J., Gregory, Alannah H., Pitsuean-Meier, Sedique, Jesse, Trevor, Smith, Corey, Miles, Ethan J., Kainz, Sabrina J. H. T., Ji, Soo Yeun, Nguyen, Lena, Aryan, Maryam, Dinser, Alexis M., Shortman, Jadon, Bastias, Catalina S, Umbricht, Thomas D, Cage, Breonna, Randolph, Parker, Pollard, Matthew, Simone, Dylan M., Aramians, Andrew, Brecl, Ariana E., Robert, Amanda M., Zenner, Thomas, Saldi, Maxwell, Morales, Gavin, Mendez, Citlali, Syed, Konner, Vogel, Connor Maklain, Cone, Rebecca A., Berhanu, Naomi, Carpenter, Emily, Leoni, Cecilia, Bryan, Samuel, Ramachandra, Nidhi, Shaw, Timothy, Lee, E. C., Monyek, Eli, Wegner, Aidan B., Sharma, Shajesh, Lister, Barrett, White, Jamison R., Willard, John S., Sulaiman, S. A, Blandon, Guillermo, Narayan, Anoothi, Ruger, Ryan, Kelley, Morgan A., Moreno, Angel J., Balcer, Leo M, Ward-Chene, N. R. D., Shelby, Emma, Reagan, Brian D., Marsh, Toni, Sarkar, Sucheta, Kelley, Michael P., Fell, Kevin, Balaji, Sahana, Hildebrand, Annalise K., Shoha, Dominick, Nandu, Kshmya, Tucker, Julia, Cancio, Alejandro R., Wang, Jiawei, Rapaport, Sarah Grace, Maravi, Aimee S., Mayer, Victoria A., Miller, Andrew, Bence, Caden, Koke, Emily, Fauntleroy, John T, Doermer, Timothy, Al-Ghazwi, Adel, Morgan, Remy, Alahmed, Mohammed S., Mathavan, Adam Izz Khan Mohd Reduan, Silvester, H. K., Weiner, Amanda M., Liu, Nianzi, Iovan, Taro, Jensen, Alexander V., AlHarbi, Yazeed A., Jiang, Yufan, Zhang, Jiaqi, Jones, Olivia M., Huang, Chenqi, Reh, Eileen N., Alhamli, Dania, Pettine, Joshua, Zhou, Chongrui, Kriegman, Dylan, Yang, Jianing, Ash, Kevin, Savage, Carl, Kaiser, Emily, Augenstein, Dakota N., Padilla, Jacqueline, Stark, Ethan K., Hansen, Joshua A., Kokes, Thomas, Huynh, Leslie, Sanchez-Sanchez, Gustavo, Jeseritz, Luke A., Carillion, Emma L., Vepa, Aditya V., Khanal, Sapriya, Behr, Braden, Martin, Logan S., McMullan, Jesse J., Zhao, Tianwei, Williams, Abigail K., Alqabani, Emeen, Prinster, Gale H., Horne, Linda, Ruggles-Delgado, Kendall, Otto, Grant, Gomez, Angel R., Nguyen, Leonardo, Brumley, Preston J., Venegas, Nancy Ortiz, Varela, Ilian, Brownlow, Jordi, Cruz, Avril, Leiker, Linzhi, Batra, Jasleen, Hutabarat, Abigail P., Nunes-Valdes, Dario, Jameson, Connor, Naqi, Abdulaziz, Adams, Dante Q., Biediger, Blaine B., Borelli, William T, Cisne, Nicholas A., Collins, Nathaniel A., Curnow, Tyler L., Gopalakrishnan, Sean, Griffin, Nicholas F., Herrera, Emanuel, McGarvey, Meaghan V., Mellett, Sarah, Overchuk, Igor, Shaver, Nathan, Stratmeyer, Cooper N., Vess, Marcus T., Juels, Parker, Alyami, Saleh A., Gale, Skylar, Wallace, Steven P., Hunter, Samuel C, Lonergan, Mia C., Stewart, Trey, Maksimuk, Tiffany E., Lam, Antonia, Tressler, Judah, Napoletano, Elena R., Miller, Joshua B., Roy, Marc G., Chanders, Jasey, Fischer, Emmalee, Croteau, A. J., Kuiper, Nicolas A., Hoffman, Alex, DeBarros, Elyse, Curry, Riley T., Brzostowicz, A., Courtney, Jonas, Zhao, Tiannie, Szabo, Emi, Ghaith, Bandar Abu, Slyne, Colin, Beck, Lily, Quinonez, Oliver, Collins, Sarah, Madonna, Claire A., Morency, Cora, Palizzi, Mallory, Herwig, Tim, Beauprez, Jacob N., Ghiassi, Dorsa, Doran, Caroline R., Yang, Zhanchao, Padgette, Hannah M., Dicken, Cyrus A., Austin, Bryce W., Phalen, Ethan J., Xiao, Catherine, Palos, Adler, Gerhardstein, Phillip, Altenbern, Ava L., Orbidan, Dan, Dorr, Jackson A., Rivas, Guillermo A., Ewing, Calvin A, Giebner, B. C., McEntee, Kelleen, Kite, Emily R., Crocker, K. A., Haley, Mark S., Lezak, Adrienne R., McQuaid, Ella, Jeong, Jacob, Albaum, Jonathan, Hrudka, E. M., Mulcahy, Owen T., Tanguma, Nolan C., Oishi-Holder, Sean, White, Zachary, Coe, Ryan W., Boyer, Christine, Chapman, Mitchell G., Fortino, Elise, Salgado, Jose A., Hellweg, Tim, Martinez, Hazelia K., Mitchell, Alexander J., Schubert, Stephanie H., Schumacher, Grace K, Tesdahl, Corey D, Uphoff, C. H., Vassilyev, Alexandr, Witkoff, Briahn, Wolle, Jackson R., Dice, Kenzie A., Behrer, Timothy A., Bowen, Troy, Campbell, Andrew J, Clarkson, Peter C, Duong, Tien Q., Hawat, Elijah, Lopez, Christian, Olson, Nathaniel P., Osborn, Matthew, Peou, Munisettha E., Vaver, Nicholas J., Husted, Troy, Kallemeyn, Nicolas Ian, Spangler, Ava A, Mccurry, Kyle, Schultze, Courtney, Troisi, Thomas, Thomas, Daniel, Ort, Althea E., Singh, Maya A., Soon, Caitlin, Patton, Catherine, Billman, Jayce A., Jarvis, Sam, Hitt, Travis, Masri, Mirna, Albalushi, Yusef J., Schofer, Matthew J, Linnane, Katherine B., Knott, Philip Whiting, Valencia, Whitney, Arias-Robles, Brian A., Ryder, Diana, Simone, Anna, Abrams, Jonathan M., Belknap, Annelene L., Rouse, Charlotte, Reynolds, Alexander, Petric, Romeo S. L., Gomez, Angel A., Meiselman-Ashen, Jonah B., Carey, Luke, Dias, John S., Fischer-White, Jules, Forbes, Aidan E., Galarraga, Gabriela, Kennedy, Forrest, Lawlor, Rian, Murphy, Maxwell J., Norris, Cooper, Quarderer, Josh, Waller, Caroline, Weber, Robert J., Gunderson, Nicole, Boyne, Tom, Gregory, Joshua A., Propper, Henry Austin, von Peccoz, Charles B. Beck, Branch, Donovan, Clarke, Evelyn, Cutler, Libby, Dabberdt, Frederick M., Das, Swagatam, Figueirinhas, John Alfred D., Fougere, Benjamin L., Roy, Zoe A., Zhao, Noah Y., Cox, Corben L., Barnhart, Logan D. W., Craig, Wilmsen B., Moll, Hayden, Pohle, Kyle, Mueller, Alexander, Smith, Elena K., Spicer, Benjamin C., Aycock, Matthew C., Bat-Ulzii, Batchimeg, Murphy, Madalyn C., Altokhais, Abdullah, Thornally, Noah R., Kleinhaus, Olivia R., Sarfaraz, Darian, Barnes, Grant M., Beard, Sara, Banda, David J, Davis, Emma A. B., Huebsch, Tyler J., Wagoner, Michaela, Griego, Justus, Hale, Jack J. Mc, Porter, Trevor J., Abrashoff, Riley, Phan, Denise M., Smith, Samantha M., Srivastava, Ashish, Schlenker, Jared A. W., Madsen, Kasey O., Hirschmann, Anna E., Rankin, Frederick C, Akbar, Zainab A., Blouin, Ethan, Coleman-Plante, Aislinn, Hintsa, Evan, Lookhoff, Emily, Amer, Hamzi, Deng, Tianyue, Dvorak, Peter, Minimo, Josh, Plummer, William C., Ton, Kelly, Solt, Lincoln, AlAbbas, Batool H., AlAwadhi, Areej A., Cooper, Nicholas M., Corbitt, Jessica S, Dunlap, Christian, Johnson, Owen, Malone, Ryan A., Tellez, Yesica, Wallace, Logan, Ta, Michael-Tan D., Wheeler, Nicola H., Ramirez, Ariana C., Huang, Shancheng, Mehidic, Amar, Christiansen, Katherine E, Desai, Om, Domke, Emerson N., Howell, Noah H., Allsbrook, Martin, Alnaji, Teeb, England, Colin, Siles, Nathan, Burton, Nicholas David, Cruse, Zoe, Gilmartin, Dalton, Kim, Brian T., Hattendorf, Elsie, Buhamad, Maryam, Gayou, Lily, Seglem, Kasper, Alkhezzi, Tameem, Hicks, Imari R., Fife, Ryann, Pelster, Lily M., Fix, Alexander, Sur, Sohan N., Truong, Joshua K., Kubiak, Bartlomiej, Bondar, Matthew, Shi, Kyle Z., Johnston, Julia, Acevedo, Andres B., Lee, Junwon, Solorio, William J., Johnston, Braedon Y., McCormick, Tyler, Olguin, Nicholas, Pastor, Paige J., Wilson, Evan M., Trunko, Benjamin L., Sjoroos, Chris, Adams, Kalvyn N, Bell, Aislyn, Brumage-Heller, Grant, Canales, Braden P., Chiles, Bradyn, Driscoll, Kailer H., Hill, Hallie, Isert, Samuel A., Ketterer, Marilyn, Kim, Matthew M., Mewhirter, William J., Phillips, Lance, Phommatha, Krista, Quinn, Megan S., Reddy, Brooklyn J., Rippel, Matthew, Russell, Bowman, Williams, Sajan, Pixley, Andrew M., Gapin, Keala C., Peterson, B., Ruprecht, Collin, Hardie, Isabelle, Li, Isaac, Erickson, Abbey, Gersabeck, Clint, Gopalani, Mariam, Allanqawi, Nasser, Burton, Taylor, Cahn, Jackson R., Conti, Reese, White, Oliver S., Rojec, Stewart, Hogen, Blake A., Swartz, Jason R., Dick, R., Battist, Lexi, Dunn, Gabrielle M., Gasser, Rachel, Logan, Timothy W., Sinkovic, Madeline, Schaller, Marcus T., Heintz, Danielle A., Enrich, Andrew, Sanchez, Ethan S., Perez, Freddy, Flores, Fernando, Kapla, Shaun D., Shockley, Michael C., Phillips, Justin, Rumley, Madigan, Daboub, Johnston, Karsh, Brennan J., Linders, Bridget, Chen, Sam, Do, Helen C., Avula, Abhinav, French, James M., Bertuccio, Chrisanna, Hand, Tyler, Lee, Adrianna J., Neeland, Brenna K, Salazar, Violeta, Andrew, Carter, Barmore, Abby, Beatty, Thomas, Alonzi, Nicholas, Brown, Ryan, Chandler, Olivia M., Collier, Curran, Current, Hayden, Delasantos, Megan E., Bonilla, Alberto Espinosa de los Monteros, Fowler, Alexandra A., Geneser, Julianne R., Gentry, Eleanor, Gustavsson, E. R., Hansson, Jonathan, Hao, Tony Yunfei, Herrington, Robert N., Kelly, James, Kelly, Teagan, Kennedy, Abigail, Marquez, Mathew J., Meillon, Stella, Palmgren, Madeleine L., Pesce, Anneliese, Ranjan, Anurag, Robertson, Samuel M., Smith, Percy, Smith, Trevor J, Soby, Daniel A., Stratton, Grant L., Thielmann, Quinn N., Toups, Malena C., Veta, Jenna S., Young, Trenton J., Maly, Blake, Manzanares, Xander R., Beijer, Joshua, George, Jacob D., Mills, Dylan P., Ziebold, Josh J, Chambers, Paige, Montoya, Michael, Cheang, Nathan M., Anderson, Hunter J., Duncan, Sheridan J., Ehrlich, Lauren, Hudson, Nathan C., Kiechlin, Jack L., Koch, Will, Lee, Justin, Menassa, Dominic, Oakes, S. H., Petersen, Audrey J., Bunsow, J. R. Ramirez, Bay, Joshua, Ramirez, Sacha, Fenwick, Logan D., Boyle, Aidan P., Hibbard, Lea Pearl, Haubrich, Calder, Sherry, Daniel P., Jenkins, Josh, Furney, Sebastian, Velamala, Anjali A., Krueger, Davis J., Thompson, William N., Chhetri, Jenisha, Lee, Alexis Ying-Shan, Ray, Mia G. V., Recchia, John C., Lengerich, Dylan, Taulman, Kyle, Romero, Andres C., Steward, Ellie N., Russell, Sloan, Hardwick, Dillon F., Wootten, Katelynn, Nguyen, Valerie A., Quispe, Devon, Ragsdale, Cameron, Young, Isabel, Atchley-Rivers, N. S., Stribling, Jordin L., Gentile, Julia G, Boeyink, Taylor A., Kwiatkowski, Daniel, Dupeyron, Tomi Oshima, Crews, Anastasia, Shuttleworth, Mitchell, Dresdner, Danielle C., Flackett, Lydia, Haratsaris, Nicholas, Linger, Morgan I, Misener, Jay H., Patti, Samuel, Pine, Tawanchai P., Marikar, Nasreen, Matessi, Giorgio, Routledge, Allie C., Alkaabi, Suhail, Bartman, Jessica L., Bisacca, Gabrielle E., Busch, Celeste, Edwards, Bree, Staudenmier, Caitlyn, Starling, Travis, McVey, Caden, Montano, Maximus, Contizano, Charles J., Taylor, Eleanor, McIntyre, James K., Victory, Andrew, McCammon, Glen S., Kimlicko, Aspen, Sheldrake, Tucker, Shelchuk, Grace, Von Reich, Ferin J., Hicks, Andrew J., O'neill, Ian, Rossman, Beth, Taylor, Liam C., MacDonald, William, Becker, Simone E., Han, Soonhee, O'Sullivan, Cian, Wilcove, Isaac, Brennan, David J., Hanley, Luke C., Hull, Owen, Wilson, Timothy R., Kalmus, Madison H., Berv, Owen A., Harris, Logan Swous, Doan, Chris H, Londres, Nathan, Parulekar, Anish, Adam, Megan M., Angwin, Abigail, Cabbage, Carter C., Colleran, Zachary, Pietras, Alex, Seux, Octave, Oros, Ryan, Wilkinson, Blake C., Nguyen, Khoa D, Trank-Greene, Maedee, Barone, Kevin M., Snyder, G. L., Biehle, Samuel J, Billig, Brennen, Almquist, Justin Thomas, Dixon, Alyssa M., Erickson, Benjamin, Evans, Nathan, Genne, SL, Kelly, Christopher M, Marcus, Serafima M., Ogle, Caleb, Patel, Akhil, Vendetti, Evan, Courtney, Olivia, Deel, Sean, Del Foco, Leonardo, Gjini, Michael, Haines, Jessica, Hoff, Isabelle J., Jones, M. R., Killian, Dominic, Kuehl, Kirsten, Kuester, Chrisanne, Lantz, Maxwell B., Lee, Christian J, Mauer, Graham, McKemey, Finbar K., Millican, Sarah J., Rosasco, Ryan, Stewart, T. C., VanEtten, Eleanor, Derwin, Zachary, Serio, Lauren, Sickler, Molly G., Blake, Cassidy A., Patel, Neil S., Fox, Margaret, Gray, Michael J, Ziegler, Lucas J., Kumar, Aman Priyadarshi, Polly, Madelyn, Mesgina, Sarah, McMorris, Zane, Griffin, Kyle J., Haile, L. N., Bassel, Claire, Dixon, Thomas J., Beattie, Ryan, Houck, Timothy J, Rodgers, Maeve, Trofino, Tyson R., Lukianow, Dax, Smart, Korben, Hall, Jacqueline L., Bone, Lauren, Baldwin, James O., Doane, Connor, Almohsen, Yousef A., Stamos, Emily, Acha, Iker, Kim, Jake, Samour II, Antonio E., Chavali, S., Kanokthippayakun, Jeerakit, Gotlib, Nicholas, Murphy, Ryan C., Archibald, Jack. W., Brimhall, Alexander J, Boyer, Aidan, Chapman, Logan T., Chadda, Shivank, Sibrell, Lisa, Vallery, Mia M., Conroy, Thomas C., Pan, Luke J., Balajonda, Brian, Fuhrman, Bethany E. S., Alkubaisi, Mohamed, Engelstad, Jacob, Dodrill, Joshua, Fuchs, Calvin R., Bullard-Connor, Gigi, Alhuseini, Isehaq, Zygmunt, James C., Sipowicz, Leo, Hayrynen, Griffin A., McGill, Riley M., Keating, Caden J., Hart, Omer, Cyr, Aidan St., Steinsberger, Christopher H., Thoman, Gerig, Wood, Travis M., Ingram, Julia A., Dominguez, J., Georgiades, Nathaniel James, Johnson, Matthew, Johnson, Sawyer, Pedersen, Alexander J., Ralapanawe, Anoush K, Thomas, Jeffrey J., Sato, Ginn A., Reynolds, Hope, Nasser, Liebe, Mizzi, Alexander Z., Damgaard, Olivia, Baflah, Abdulrahman A., Liu, Steven Y., Salindeho, Adam D., Norden, Kelso, Gearhart, Emily E., Krajnak, Zack, Szeremeta, Philip, Amos, Meggan, Shin, Kyungeun, Muckenthaler, Brandon A., Medialdea, Melissa, Beach, Simone, Wilson, Connor B., Adams, Elena R, Aldhamen, Ahmed, Harris, Coyle M., Hesse, Troy M., Golding, Nathan T., Larter, Zachary, Hernandez, Angel, Morales, Genaro, Traxler, Robert B., Alosaimi, Meshal, Fitton, Aidan F., Aaron, James Holland, Lee, Nathaniel F., Liao, Ryan Z., Chen, Judy, French, Katherine V., Loring, Justin, Colter, Aurora, McConvey, Rowan, Colozzi, Michael, Vann, John D., Scheck, Benjamin T., Weigand, Anthony A, Alhabeeb, Abdulelah, Idoine, Yolande, Woodard, Aiden L., Medellin, Mateo M., Ratajczyk, Nicholas O, Tobin, Darien P., Collins, Jack C., Horning, Thomas M., Pellatz, Nick, Pitten, John, Lordi, Noah, Patterson, Alyx, Hoang, Thi D, Zimmermann, Ingrid H, Wang, Hongda, Steckhahn, Daniel, Aradhya, Arvind J., Oliver, Kristin A., Cai, Yijian, Wang, Chaoran, Yegovtsev, Nikolay, Wu, Mengyu, Ganesan, Koushik, Osborne, Andrew, Wickenden, Evan, Meyer, Josephine C., Chaparro, David, Visal, Aseem, Liu, Haixin, Menon, Thanmay S., Jin, Yan, Wilson, John, Erikson, James W., Luo, Zheng, Shitara, Nanako, Nelson, Emma E, Geerdts, T. R., Ortiz, Jorge L Ramirez, and Lewandowski, H. J.

Subjects
Astrophysics - Solar and Stellar Astrophysics
Abstract

Flare frequency distributions represent a key approach to addressing one of the largest problems in solar and stellar physics: determining the mechanism that counter-intuitively heats coronae to temperatures that are orders of magnitude hotter than the corresponding photospheres. It is widely accepted that the magnetic field is responsible for the heating, but there are two competing mechanisms that could explain it: nanoflares or Alfv\'en waves. To date, neither can be directly observed. Nanoflares are, by definition, extremely small, but their aggregate energy release could represent a substantial heating mechanism, presuming they are sufficiently abundant. One way to test this presumption is via the flare frequency distribution, which describes how often flares of various energies occur. If the slope of the power law fitting the flare frequency distribution is above a critical threshold, $\alpha=2$ as established in prior literature, then there should be a sufficient abundance of nanoflares to explain coronal heating. We performed $>$600 case studies of solar flares, made possible by an unprecedented number of data analysts via three semesters of an undergraduate physics laboratory course. This allowed us to include two crucial, but nontrivial, analysis methods: pre-flare baseline subtraction and computation of the flare energy, which requires determining flare start and stop times. We aggregated the results of these analyses into a statistical study to determine that $\alpha = 1.63 \pm 0.03$. This is below the critical threshold, suggesting that Alfv\'en waves are an important driver of coronal heating., Comment: 1,002 authors, 14 pages, 4 figures, 3 tables, published by The Astrophysical Journal on 2023-05-09, volume 948, page 71

Published
2023
Full Text
View/download PDF

29. Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Models

Author

Kang, Haoqiang, Blevins, Terra, and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language
Abstract

Pretrained Language Models (PLMs) learn rich cross-lingual knowledge and can be finetuned to perform well on diverse tasks such as translation and multilingual word sense disambiguation (WSD). However, they often struggle at disambiguating word sense in a zero-shot setting. To better understand this contrast, we present a new study investigating how well PLMs capture cross-lingual word sense with Contextual Word-Level Translation (C-WLT), an extension of word-level translation that prompts the model to translate a given word in context. We find that as the model size increases, PLMs encode more cross-lingual word sense knowledge and better use context to improve WLT performance. Building on C-WLT, we introduce a zero-shot approach for WSD, tested on 18 languages from the XL-WSD dataset. Our method outperforms fully supervised baselines on recall for many evaluation languages without additional training or finetuning. This study presents a first step towards understanding how to best leverage the cross-lingual knowledge inside PLMs for robust zero-shot reasoning in any language.

Published
2023

30. A Glycemia Risk Index (GRI) of Hypoglycemia and Hyperglycemia for Continuous Glucose Monitoring Validated by Clinician Ratings

Author

Klonoff, David C, Wang, Jing, Rodbard, David, Kohn, Michael A, Li, Chengdong, Liepmann, Dorian, Kerr, David, Ahn, David, Peters, Anne L, Umpierrez, Guillermo E, Seley, Jane Jeffrie, Xu, Nicole Y, Nguyen, Kevin T, Simonson, Gregg, Agus, Michael SD, Al-Sofiani, Mohammed E, Armaiz-Pena, Gustavo, Bailey, Timothy S, Basu, Ananda, Battelino, Tadej, Bekele, Sewagegn Yeshiwas, Benhamou, Pierre-Yves, Bequette, B Wayne, Blevins, Thomas, Breton, Marc D, Castle, Jessica R, Chase, James Geoffrey, Chen, Kong Y, Choudhary, Pratik, Clements, Mark A, Close, Kelly L, Cook, Curtiss B, Danne, Thomas, Doyle, Francis J, Drincic, Angela, Dungan, Kathleen M, Edelman, Steven V, Ejskjaer, Niels, Espinoza, Juan C, Fleming, G Alexander, Forlenza, Gregory P, Freckmann, Guido, Galindo, Rodolfo J, Gomez, Ana Maria, Gutow, Hanna A, Heinemann, Lutz, Hirsch, Irl B, Hoang, Thanh D, Hovorka, Roman, Jendle, Johan H, Ji, Linong, Joshi, Shashank R, Joubert, Michael, Koliwad, Suneil K, Lal, Rayhan A, Lansang, M Cecilia, Lee, Wei-An, Leelarathna, Lalantha, Leiter, Lawrence A, Lind, Marcus, Litchman, Michelle L, Mader, Julia K, Mahoney, Katherine M, Mankovsky, Boris, Masharani, Umesh, Mathioudakis, Nestoras N, Mayorov, Alexander, Messler, Jordan, Miller, Joshua D, Mohan, Viswanathan, Nichols, James H, Nørgaard, Kirsten, O’Neal, David N, Pasquel, Francisco J, Philis-Tsimikas, Athena, Pieber, Thomas, Phillip, Moshe, Polonsky, William H, Pop-Busui, Rodica, Rayman, Gerry, Rhee, Eun-Jung, Russell, Steven J, Shah, Viral N, Sherr, Jennifer L, Sode, Koji, Spanakis, Elias K, Wake, Deborah J, Waki, Kayo, Wallia, Amisha, Weinberg, Melissa E, Wolpert, Howard, Wright, Eugene E, Zilbermint, Mihail, and Kovatchev, Boris

Subjects
Biomedical and Clinical Sciences, Nutrition and Dietetics, Diabetes, Adult, Humans, Blood Glucose, Blood Glucose Self-Monitoring, Hypoglycemia, Hyperglycemia, Glucose, ambulatory glucose profile, composite metric, continuous glucose monitor, diabetes, glycemia risk index, hyperglycemia, hypoglycemia, time in range, Nutrition and dietetics
Abstract

BackgroundA composite metric for the quality of glycemia from continuous glucose monitor (CGM) tracings could be useful for assisting with basic clinical interpretation of CGM data.MethodsWe assembled a data set of 14-day CGM tracings from 225 insulin-treated adults with diabetes. Using a balanced incomplete block design, 330 clinicians who were highly experienced with CGM analysis and interpretation ranked the CGM tracings from best to worst quality of glycemia. We used principal component analysis and multiple regressions to develop a model to predict the clinician ranking based on seven standard metrics in an Ambulatory Glucose Profile: very low-glucose and low-glucose hypoglycemia; very high-glucose and high-glucose hyperglycemia; time in range; mean glucose; and coefficient of variation.ResultsThe analysis showed that clinician rankings depend on two components, one related to hypoglycemia that gives more weight to very low-glucose than to low-glucose and the other related to hyperglycemia that likewise gives greater weight to very high-glucose than to high-glucose. These two components should be calculated and displayed separately, but they can also be combined into a single Glycemia Risk Index (GRI) that corresponds closely to the clinician rankings of the overall quality of glycemia (r = 0.95). The GRI can be displayed graphically on a GRI Grid with the hypoglycemia component on the horizontal axis and the hyperglycemia component on the vertical axis. Diagonal lines divide the graph into five zones (quintiles) corresponding to the best (0th to 20th percentile) to worst (81st to 100th percentile) overall quality of glycemia. The GRI Grid enables users to track sequential changes within an individual over time and compare groups of individuals.ConclusionThe GRI is a single-number summary of the quality of glycemia. Its hypoglycemia and hyperglycemia components provide actionable scores and a graphical display (the GRI Grid) that can be used by clinicians and researchers to determine the glycemic effects of prescribed and investigational treatments.

Published
2023

37. Reframing the Problem of Practice: Transitions in Baylor University's Ed.D. in Learning and Organizational Change Program

Author

Blevins, Brooke E., Cooper, Sandi, Papadakis, Lacy K. Crocker, Earl, Julia, Howell, Leanne, Lively, Cece, Meehan, Jessica, Murray, Elizabeth Anne, Pratt, Sarah, Sanguras, Laila, Talbert, Sandra, Talbert, Tony L., and Werse, Nicholas R.

Abstract

This article reports on the program changes that emerged from the Baylor University Ed.D. in Learning and Organizational Change program development team as we engaged as a community of practice in the organizational change process to reframe our conceptualization of the Problem of Practice dissertation. This process led to logical implications for the program course offerings and student support systems. The following article, therefore, traces these changes as they emanate out from the Problem of Practice dissertation reconfiguration, into the course sequence, and finally the student support systems. This article concludes by offering the perspective gained about this work as we engaged in the same organizational change process through which we guide our students.

Published
2022

38. Single-cell transcriptomic atlas reveals increased regeneration in diseased human inner ear balance organs

Author

Tian Wang, Angela H. Ling, Sara E. Billings, Davood K. Hosseini, Yona Vaisbuch, Grace S. Kim, Patrick J. Atkinson, Zahra N. Sayyid, Ksenia A. Aaron, Dhananjay Wagh, Nicole Pham, Mirko Scheibinger, Ruiqi Zhou, Akira Ishiyama, Lindsay S. Moore, Peter Santa Maria, Nikolas H. Blevins, Robert K. Jackler, Jennifer C. Alyono, John Kveton, Dhasakumar Navaratnam, Stefan Heller, Ivan A. Lopez, Nicolas Grillet, Taha A. Jan, and Alan G. Cheng

Subjects
Science
Abstract

Abstract Mammalian inner ear hair cell loss leads to permanent hearing and balance dysfunction. In contrast to the cochlea, vestibular hair cells of the murine utricle have some regenerative capacity. Whether human utricular hair cells regenerate in vivo remains unknown. Here we procured live, mature utricles from organ donors and vestibular schwannoma patients, and present a validated single-cell transcriptomic atlas at unprecedented resolution. We describe markers of 13 sensory and non-sensory cell types, with partial overlap and correlation between transcriptomes of human and mouse hair cells and supporting cells. We further uncover transcriptomes unique to hair cell precursors, which are unexpectedly 14-fold more abundant in vestibular schwannoma utricles, demonstrating the existence of ongoing regeneration in humans. Lastly, supporting cell-to-hair cell trajectory analysis revealed 5 distinct patterns of dynamic gene expression and associated pathways, including Wnt and IGF-1 signaling. Our dataset constitutes a foundational resource, accessible via a web-based interface, serving to advance knowledge of the normal and diseased human inner ear.

Published
2024
Full Text
View/download PDF

39. Report of the first seven agents in the I-SPY COVID trial: a phase 2, open label, adaptive platform randomised controlled trial

Author

Consortium, The I-SPY COVID, Files, D Clark, Aggarwal, Neil, Albertson, Timothy, Auld, Sara, Beitler, Jeremy R, Berger, Paul, Burnham, Ellen L, Calfee, Carolyn S, Cobb, Nathan, Crippa, Alessio, Discacciati, Andrea, Eklund, Martin, Esserman, Laura, Friedman, Eliot, Gandotra, Sheetal, Khan, Kashif, Koff, Jonathan, Kumar, Santhi, Liu, Kathleen D, Martin, Thomas R, Matthay, Michael A, Meyer, Nuala J, Obermiller, Timothy, Robinson, Philip, Russell, Derek, Thomas, Karl, Wong, Fum, Wunderink, Richard G, Wurfel, Mark M, Yen, Albert, Youssef, Fady A, Darmanian, Anita, Dzierba, Amy L, Garcia, Ivan, Gosek, Katarzyna, Madahar, Purnema, Mittel, Aaron M, Muir, Justin, Rosen, Amanda, Schicchi, John, Serra, Alexis L, Wahab, Romina, Gibbs, Kevin W, Landreth, Leigha, LaRose, Mary, Parks, Lisa, Wynn, Adina, Ittner, Caroline AG, Mangalmurti, Nilman S, Reilly, John P, Harris, Donna, Methukupally, Abhishek, Patel, Siddharth, Boerger, Lindsie, Kazianis, John, Higgins, Carrie, McKeehan, Jeff, Daniel, Brian, Fields, Scott, Hurst-Hopf, James, Jauregui, Alejandra, Swigart, Lamorna Brown, Blevins, Daniel, Nguyen, Catherine, Suarez, Alexis, Tanios, Maged A, Sarafian, Farjad, Shah, Usman, Adelman, Max, Creel-Bulos, Christina, Detelich, Joshua, Harris, Gavin, Nugent, Katherine, Spainhour, Christina, Yang, Philip, Haczku, Angela, Hardy, Erin, Harper, Richart, Morrissey, Brian, Sandrock, Christian, Budinger, GR Scott, Donnelly, Helen K, Singer, Benjamin D, Moskowitz, Ari, Coleman, Melissa, Levitt, Joseph, Lu, Ruixiao, Henderson, Paul, Asare, Adam, Dunn, Imogene, and Barragan, Alejandro Botello

Subjects
Health Services, Clinical Trials and Supportive Activities, Clinical Research, Good Health and Well Being, I-SPY COVID Consortium, Acute lung injury, Clinical trial, Respiratory insufficiency, SARS-CoV-2
Abstract

BackgroundAn urgent need exists to rapidly screen potential therapeutics for severe COVID-19 or other emerging pathogens associated with high morbidity and mortality.MethodsUsing an adaptive platform design created to rapidly evaluate investigational agents, hospitalised patients with severe COVID-19 requiring ≥6 L/min oxygen were randomised to either a backbone regimen of dexamethasone and remdesivir alone (controls) or backbone plus one open-label investigational agent. Patients were enrolled to the arms described between July 30, 2020 and June 11, 2021 in 20 medical centres in the United States. The platform contained up to four potentially available investigational agents and controls available for randomisation during a single time-period. The two primary endpoints were time-to-recovery (

Published
2023

42. List of Contributors

Author

Agrawal, Pankaj B., primary, Akhtar, Yasmin, additional, Alallah, Jubara, additional, Alhassen, Ziad, additional, Altit, Gabriel, additional, AlZubaidi, Abbas, additional, Amlani, Lahin M., additional, Antelo, Martin, additional, Athalye-Jape, Gayatri, additional, Badarch, Jargalsaikhan, additional, Baer, Gerri, additional, Bagga, Nitasha, additional, Bahr, Timothy M., additional, Bar-Cohen, Yaniv, additional, M. Barr, Stephanie, additional, Bauer, Andrew J., additional, Bearer, Cynthia F., additional, Beckman, Ross M., additional, Beltempo, Marc, additional, Bembea, Melania M., additional, Berlin, Sheila, additional, Berry, Shandeigh N., additional, Bhandari, Vineet, additional, Bhatia, Shaifali, additional, Bhombal, Shazia, additional, Bigelow, Elaine O., additional, Blevins, Carley, additional, Boppana, Suresh, additional, Boss, Renee, additional, Brooks, Sandra, additional, Buonocore, Giuseppe, additional, Burnsed, Jennifer, additional, Calabria, Andrew C., additional, Carrasco, Melisa, additional, Carter, Brian S., additional, Chandrasekharan, Praveen, additional, Chavez-Valdez, Raul, additional, Choleva, Lauryn, additional, Christensen, Robert D., additional, Chung, Wendy K., additional, Coggins, Sarah A., additional, Cooke, David W., additional, Cummings, Laura, additional, Currie, Erin R., additional, Davidson, Joanne O., additional, Davis, Jonathan M., additional, Day-Richardson, Colby L., additional, De Leon, Diva D., additional, Dedhia, Kavita, additional, Dendi, Alvaro, additional, Deshpande, Anita, additional, Dionne, Janis M., additional, Donda, Keyur, additional, Donohue, Lee, additional, Doyle, Jefferson J., additional, Dulkerian, Susan J., additional, Dumpa, Vikramaditya, additional, Duncan, Andrea F., additional, Dunham, Alexandra M., additional, Ecret, DiAnn, additional, Ellis, Kelstan, additional, El-Metwally, Dina, additional, Etchill, Eric W., additional, Ethawi, Yahya, additional, Everett, Allen D., additional, Fabres, Jorge, additional, Felling, Ryan J., additional, Fenton, Tanis R., additional, Flannery, Dustin D., additional, Flynn, Joseph T., additional, Fredenburg, Michaelene, additional, Fuqua, John, additional, Garcia, Alejandro V., additional, Garzon, Steven, additional, Gauda, Estelle B., additional, Thompson, Marisa Gilstrop, additional, Goldenberg, Barton, additional, Salazar, Andres J. Gonzalez, additional, Goodwin, Julie E., additional, Goudy, Steven L., additional, Graham, Ernest, additional, Grauerholz, Kathryn, additional, Groves, Mari L., additional, Guillot, Mireille, additional, Gunn, Alistair J., additional, Gupta, Arjun, additional, Hackam, David J., additional, Hidalgo, Joaquin, additional, Honcharuk, Erin, additional, Htun, Zeyar, additional, Hudak, Mark L., additional, Driscoll, Colleen A. Hughes, additional, Huisman, Thierry A.G.M., additional, Jabroun, Mireille, additional, Jackson, Eric M., additional, Jain, Naveen, additional, Jain, Rajesh, additional, Jelin, Angie, additional, Jelin, Eric, additional, Juul, Sandra E., additional, Kaufman, David A., additional, BMBS, Alison Kent,, additional, Khuder, Sundos, additional, Kovler, Mark L., additional, Kraus, Courtney L., additional, Krishnamurthy, Ganga, additional, Kukora, Stephanie K., additional, Kumar, Ashok, additional, Kunisaki, Shaun M., additional, Kuper-Sassé, Margaret, additional, Kwiatkowski, David M., additional, Lakshminrusimha, Satyan, additional, Laventhal, Naomi T., additional, Lawrence, Shelley M., additional, Lee-Winn, Angela E., additional, Leuthner, Steven, additional, Lewallen, Laura, additional, Lewis, Tamorah R., additional, Liken, Hillary B., additional, Liubšys, Arūnas, additional, Lui, Kei, additional, Maheshwari, Akhil, additional, Maitre, Nathalie L., additional, Makker, Kartikeya, additional, Mammen, Cherry, additional, J. Martin, Richard, additional, Mattos Castellano, María, additional, Maxwell, Jessie R., additional, McFarlane, Renske, additional, McLemore, Gabrielle, additional, McNelis, Kera M., additional, McPherson, Christopher, additional, Mietzsch, Ulrike, additional, Milante, Rachel R., additional, Miller, Jena L., additional, Mukhopadhyay, Sagori, additional, Mynak, Mimi L., additional, Nasr, Isam W., additional, Natarajan, Niranjana, additional, Navaneethan, Hema, additional, Nees, Shannon N., additional, Nguyen, Mai, additional, Noori, Shahab, additional, Odackal, Namrita J., additional, Ohls, Robin K., additional, Ostrander, Betsy E., additional, Pammi, Mohan, additional, Parimi, Prabhu S., additional, Park, Albert, additional, Patil, Monika S., additional, Pereira, Elaine M., additional, Premkumar, Muralidhar H., additional, Price-Douglas, Webra, additional, Puopolo, Karen M., additional, Rabe, Heike, additional, M. Rahman, Mohammad, additional, Reber, Kristina, additional, Kallem, Venkat Reddy, additional, Repka, Michael X., additional, Rhee, Daniel S., additional, Ringle, Megan L., additional, Rohrer, Allison, additional, Romero, Christopher J., additional, Ryan, Marisa A., additional, Sampah, Maame E.S., additional, Sanchez-Valle, Amarilis, additional, Sant’Anna, Guilherme M., additional, Saugstad, Ola D., additional, RobertH., Anne and, additional, Schacht, John P., additional, Schelonka, Robert L., additional, Schofield, Erin E., additional, Selewski, David T., additional, Shah, Prakesh S., additional, Shih, Jessica G., additional, Sibinga, Erica M.S., additional, Sigal, Winnie, additional, Sims, Brian, additional, Singh, Rachana, additional, Singh, Srijan, additional, Snyder, Donna, additional, Sobrero, Helena, additional, Sponseller, Paul D., additional, Stafstrom, Carl E., additional, Steflik, Heidi J., additional, Sun, Lisa R., additional, Sundararajan, Sripriya, additional, Taylor, Sarah N., additional, Terrin, Norma, additional, Thacker, Prolima G., additional, Thébaud, Bernard, additional, Toms, Rune, additional, Torres, Benjamin A., additional, Tunkel, David E., additional, Umandap, Christine H., additional, Chaves, Diana Vargas, additional, Vento, Maximo, additional, Walsh, Jonathan, additional, Walter, Jolan, additional, Weaver, Meaghann S., additional, Weimer, Kristin, additional, Weller, Jennine, additional, Winter, Lindy W., additional, Wu, Tai-Wei, additional, and Yau, Mabel, additional

Published
2024
Full Text
View/download PDF

48. Demystifying Prompts in Language Models via Perplexity Estimation

Author

Gonen, Hila, Iyer, Srini, Blevins, Terra, Smith, Noah A., and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language
Abstract

Language models can be prompted to perform a wide variety of zero- and few-shot learning problems. However, performance varies significantly with the choice of prompt, and we do not yet understand why this happens or how to pick the best prompts. In this work, we analyze the factors that contribute to this variance and establish a new empirical hypothesis: the performance of a prompt is coupled with the extent to which the model is familiar with the language it contains. Over a wide range of tasks, we show that the lower the perplexity of the prompt is, the better the prompt is able to perform the task. As a result, we devise a method for creating prompts: (1) automatically extend a small seed set of manually written prompts by paraphrasing using GPT3 and backtranslation and (2) choose the lowest perplexity prompts to get significant gains in performance.

Published
2022

49. Prompting Language Models for Linguistic Structure

Author

Blevins, Terra, Gonen, Hila, and Zettlemoyer, Luke

Subjects
Computer Science - Computation and Language
Abstract

Although pretrained language models (PLMs) can be prompted to perform a wide range of language tasks, it remains an open question how much this ability comes from generalizable linguistic understanding versus surface-level lexical patterns. To test this, we present a structured prompting approach for linguistic structured prediction tasks, allowing us to perform zero- and few-shot sequence tagging with autoregressive PLMs. We evaluate this approach on part-of-speech tagging, named entity recognition, and sentence chunking, demonstrating strong few-shot performance in all cases. We also find that while PLMs contain significant prior knowledge of task labels due to task leakage into the pretraining corpus, structured prompting can also retrieve linguistic structure with arbitrary labels. These findings indicate that the in-context learning ability and linguistic knowledge of PLMs generalizes beyond memorization of their training data., Comment: ACL 2023

Published
2022

50. Development and validation of systems for genetic manipulation of the Old World tick-borne relapsing fever spirochete, Borrelia duttonii.

Author

Clay D Jackson-Litteken, Wanfeng Guo, Brandon A Hogland, C Tyler Ratliff, LeAnn McFadden, Marissa S Fullerton, Daniel E Voth, Ryan O M Rego, and Jon S Blevins

Subjects
Arctic medicine. Tropical medicine, RC955-962, Public aspects of medicine, RA1-1270
Abstract

Relapsing fever (RF), a vector-borne disease caused by Borrelia spp., is characterized by recurring febrile episodes due to repeated bouts of bacteremia. RF spirochetes can be geographically and phylogenetically divided into two distinct groups; Old World RF Borrelia (found in Africa, Asia, and Europe) and New World RF Borrelia (found in the Americas). While RF is a rarely reported disease in the Americas, RF is prevalent in endemic parts of Africa. Despite phylogenetic differences between Old World and New World RF Borrelia and higher incidence of disease associated with Old World RF spirochete infection, genetic manipulation has only been described in New World RF bacteria. Herein, we report the generation of genetic tools for use in the Old World RF spirochete, Borrelia duttonii. We describe methods for transformation and establish shuttle vector- and integration-based approaches for genetic complementation, creating green fluorescent protein (gfp)-expressing B. duttonii strains as a proof of principle. Allelic exchange mutagenesis was also used to inactivate a homolog of the Borrelia burgdorferi p66 gene, which encodes an important virulence factor, in B. duttonii and demonstrate that this mutant was attenuated in a murine model of RF. Finally, the B. duttonii p66 mutant was complemented using shuttle vector- and cis integration-based approaches. As expected, complemented p66 mutant strains were fully infectious, confirming that P66 is required for optimal mammalian infection. The genetic tools and techniques reported herein represent an important advancement in the study of RF Borrelia that allows for future characterization of virulence determinants and colonization factors important for the enzootic cycle of Old World RF spirochetes.

Published
2024
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results