Search

We present SeaEval, a benchmark for multilingual foundation models. In addition to characterizing how these models understand and reason with natural language, we also investigate how well they comprehend cultural practices, nuances, and values. Alongside standard accuracy metrics, we investigate the brittleness of foundation models in the dimensions of semantics and multilinguality. Our analyses span both open-sourced and closed models, leading to empirical results across classic NLP tasks, reasoning, and cultural comprehension. Key findings indicate (1) Most models exhibit varied behavior when given paraphrased instructions. (2) Many models still suffer from exposure bias (e.g., positional bias, majority label bias). (3) For questions rooted in factual, scientific, and commonsense knowledge, consistent responses are expected across multilingual queries that are semantically equivalent. Yet, most models surprisingly demonstrate inconsistent performance on these queries. (4) Multilingually-trained models have not attained "balanced multilingual" capabilities. Our endeavors underscore the need for more generalizable semantic representations and enhanced multilingual contextualization. SeaEval can serve as a launchpad for more thorough investigations and evaluations for multilingual and multicultural scenarios., Comment: To appear in NAACL 2024. 20 pages. More datasets (2 on Cross-Lingual Consistency and 4 on Cultural Understanding) and more supported languages. Code: https://seaeval.github.io

High-definition optical coherence tomography (HD-OCT) permits real-time 3D imaging of the impact of selected agents on human skin allografts. The real-time 3D HD-OCT assessment of (i) the impact on morphological and cellular characteristics of the processing of human acellular dermal matrices (HADMs) and (ii) repopulation of HADMs in vitro by human fibroblasts and remodelling of the extracellular matrix by these cells. Four different skin decellularization methods, Dispase II/Triton X-100, Dispase II/SDS (sodium dodecyl sulphate), NaCl/Triton X-100 and NaCl/SDS, were analysed by HD-OCT. HD-OCT features of epidermal removal, dermo-epidermal junction (DEJ) integrity, cellularity and dermal architecture were correlated with reflectance confocal microscopy (RCM), histopathology and immunohistochemistry. Human adult dermal fibroblasts were in vitro seeded on the NaCl/Triton X-100 processed HADMs, cultured up to 19 days and evaluated by HD-OCT in comparison with MTT proliferation test and histology. Epidermis was effectively removed by all treatments. DEJ was best preserved after NaCl/Triton X-100 treatment. Dispase II/SDS treatment seemed to remove all cellular debris in comparison with NaCl/Triton X-100 but disturbed the DEJ severely. The dermal micro-architectural structure and vascular spaces of (sub)papillary dermis were best preserved with the NaCl/Triton X-100. The impact on the 3D structure and vascular holes was detrimental with Dispase II/SDS. Elastic fibre fragmentation was only observed after Dispase II incubation. HD-OCT showed that NaCl/Triton X-100 processed matrices permitted in vitro repopulation by human dermal fibroblasts (confirmed by MTT test and histology) and underwent remodelling upon increasing incubation time. Care must be taken in choosing the appropriate processing steps to maintain selected properties of the extracellular matrix in HADMs. Processing HADMs with NaCl/Triton X-100 permits in vitro the proliferation and remodelling activity of hum, SCOPUS: ar.j, FLWIN, info:eu-repo/semantics/published

High-definition optical coherence tomography (HD-OCT) permits real-time 3D imaging of the impact of selected agents on human skin allografts. The real-time 3D HD-OCT assessment of (i) the impact on morphological and cellular characteristics of the processing of human acellular dermal matrices (HADMs) and (ii) repopulation of HADMs in vitro by human fibroblasts and remodelling of the extracellular matrix by these cells. Four different skin decellularization methods, Dispase II/Triton X-100, Dispase II/SDS (sodium dodecyl sulphate), NaCl/Triton X-100 and NaCl/SDS, were analysed by HD-OCT. HD-OCT features of epidermal removal, dermo-epidermal junction (DEJ) integrity, cellularity and dermal architecture were correlated with reflectance confocal microscopy (RCM), histopathology and immunohistochemistry. Human adult dermal fibroblasts were in vitro seeded on the NaCl/Triton X-100 processed HADMs, cultured up to 19 days and evaluated by HD-OCT in comparison with MTT proliferation test and histology. Epidermis was effectively removed by all treatments. DEJ was best preserved after NaCl/Triton X-100 treatment. Dispase II/SDS treatment seemed to remove all cellular debris in comparison with NaCl/Triton X-100 but disturbed the DEJ severely. The dermal micro-architectural structure and vascular spaces of (sub)papillary dermis were best preserved with the NaCl/Triton X-100. The impact on the 3D structure and vascular holes was detrimental with Dispase II/SDS. Elastic fibre fragmentation was only observed after Dispase II incubation. HD-OCT showed that NaCl/Triton X-100 processed matrices permitted in vitro repopulation by human dermal fibroblasts (confirmed by MTT test and histology) and underwent remodelling upon increasing incubation time. Care must be taken in choosing the appropriate processing steps to maintain selected properties of the extracellular matrix in HADMs. Processing HADMs with NaCl/Triton X-100 permits in vitro the proliferation and remodelling activity of hum, SCOPUS: ar.j, FLWIN, info:eu-repo/semantics/published

L'incorporation du nitrate d'argent (5mg/l) dans le milieu de culture des embryons zygotiques immatures de 17 cultivars de blé (Triticum durum L. et T. aestivum L.), a amélioré significativement les pourcentages d'induction de cals embryogènes et de régénération de plantules par cal. Le rendement en cals embryogènes a été multiplié par trois pour le cultivar «Cocorit» en présence de nitrate d'argent. La régénération de plantes à partir des cals initiés en présence d'AgN03 a été également 7 fois plus importante pour le cultivar <<1765>>. Cette régénération a, néanmoins, montré des variations importantes selon les génotypes testés. L'étude de la réponse in vitro des embryons immatures après quatre semaines de culture dans le milieu d'induction a permis de distinguer trois types de cals. Placés dans le milieu de différenciation, un type n'a régénéré que des racines alors que les deux autres ont régénéré des tiges et des racines.

L'incorporation du nitrate d'argent (5mg/l) dans le milieu de culture des embryons zygotiques immatures de 17 cultivars de blé (Triticum durum L. et T. aestivum L.), a amélioré significativement les pourcentages d'induction de cals embryogènes et de régénération de plantules par cal. Le rendement en cals embryogènes a été multiplié par trois pour le cultivar «Cocorit» en présence de nitrate d'argent. La régénération de plantes à partir des cals initiés en présence d'AgN03 a été également 7 fois plus importante pour le cultivar <<1765>>. Cette régénération a, néanmoins, montré des variations importantes selon les génotypes testés. L'étude de la réponse in vitro des embryons immatures après quatre semaines de culture dans le milieu d'induction a permis de distinguer trois types de cals. Placés dans le milieu de différenciation, un type n'a régénéré que des racines alors que les deux autres ont régénéré des tiges et des racines.