Search

International audience; This paper presents an experience of creating workflows in text publishing and text corpus analysis projects that integrate, thanks to TEI encoding, two sets of tools created for different purposes.The first set of tools is called Métopes (Métodes et outils pour l’édition structurée, or Methods and tools for structured publishing). It was developed by the Pôle document numérique of the Research centre for the Humanities (MRSH) in Caen (France) and consists in a full single-source publishing toolchain. After primary editing with Microsoft Word the documents are converted using special macros to TEI, which is the core format for further editing and for all publication forms, including PDF for printing (finalized with InDesign), ePubs and online editions produced dynamically from TEI sources by the MaX tool (based on BaseX). Métopes has been adopted by a number of French academic publishers.TXM, on the other hand, is a free and open-source (GPL V3. licence) Java and C based platform for text corpus building, annotationand analysis. It includes NLP tools, search engines and visualization tools with convenient hyperlinks between distant synthetic quantitative analysis to close reading views . TXM uses TEI (with a couple of extension elements) as an internal format for encoding the text structure and all kinds of annotations.So, both Métopes and TXM rely on TEI markup. However, Métopes focuses on general text structure and on presentational aspects (e.g. it is very sensitive to white spaces), while TXM needs to perform precise linguistic analysis (e.g. tokenisation, language identification in multi-language documents).Thanks to funding from CAHIER consortium, an intern from Caen worked for three months with the TXM team in 2017. He created a set of XSLT and CSS stylesheets that make it possible to correctly parse and analyse a Métopes produced text file or corpus with TXM, and to generate high quality publications based on texts prepared for TXM analysis. In many cases both tools use the same TEI tags, which makes integration quite straightforward. In other cases, more work is necessary to ensure full compatibility (e.g. generating table of contents in TXM or supporting word-level annotation by Métopes tools). A further integration step may consist in creating a single editorial and analytical toolchain for text scholars. A simplified workflow chart of this chain is presented in the Figure 1.The work done so far is documented on a wiki page, and the scripts (Groovy and XSLT) are available for download under an LGPL license. All documentation is currently only available in French but we are interested in collaboration for its translation into English and other languages.

International audience; This paper proposes XML-TEI-URS, a generic TEI-based format for the annotation of coreferences in arbitrary corpora. This proposal is made in the context of Democrat, a French Agence Nationale de la Recherche project that aims to produce a large corpus of written French with coreference annotations, in an attempt to design a corpus that is usable both by humans and automated tools and as compatible as possible with future concurrent annotations.

5th Lecture

International audience; This paper presents a project involving TEI encoding of Akkadian tablets for their further analysis with TXM software. The goal of the project is to analyze the vocabulary, spelling and syllabary of a corpus of Akkadian letters, to outline the different Mesopotamian scribal traditions and to understand the complexity of a letter’s writing. The corpus is currently composed of 350 letters written in the Old Babylonian dialect between 2002 BC and 1595 BC. All the letters have been transliterated in Latin characters following the standards established by the Archibab team (http://www.archibab.fr). The transcriptions (previously stored in a relational database) were encoded in TEI for this project. Every word is tagged with a element and annotated with @ana. The element surrounds every transliterated sign, using @ref for mapping to its Rykle Borger’s syllabary identification number and Unicode codepoint. The transcription also encodes damage and conjecture elements , , , , , etc. Special XSLT stylesheets were designed to preprocess the TEI source transcriptions for TXM import via a generic XML import module with tokenization at word or cuneiform character levels optimized for different kinds of queries. It is for example possible to compare different letters by their vocabulary or orthography according to various metadata parameters, to study the different (transliterated) values of the cuneiform signs that are not damaged on the clay tablet or to obtain a kwic concordance of the cuneiform signs that were erased by the scribe during the writing of the letter. Correspondence analysis allows identifying the vocabulary which is characteristic to a place of composition, a circumstance or a period, and visualizing the similarity or dissimilarity of the letters. A sample corpus will be made available under open license at the TXM demo portal (http://portal.textometrie.org/demo) by the time of the TEI conference.

Les questions relatives à la mise sur le web de corpus d'ancien et de moyen français se sont présentées à nous lors du transfert des textes de la Base de Français Médiéval sur le site français de l'ATILF. Jusqu'à présent, les textes de la Base de Français Médiéval n'étaient pas accessibles sur la toile. Ils étaient exploités par l'intermédiaire de concordances, réalisées au moyen du logiciel ANALYSER de Pascal Bonnefois, mais leur accès restait réservé.Le transfert de ces textes et leur intégration dans la grande base FRANTEXT nous a donc fourni l'occasion de nous poser un certain nombre de questions méthodologiques. La transmission de données textuelles peut en effet s'envisager selon deux points de vue : on peut échanger des textes entre institutions ou collègues en laissant à chacun le choix des outils grâce auxquels ils les exploiteront, ou l'on peut accéder à des textes que l'on ne possède pas via une base de données interrogeable à distance. C'est le parti pris par les bases FRANTEXT et ARTFL notamment. Dans le cadre de notre accord avec l'ATILF, nous nous situons clairement dans le second cas de figure. Mais la question du mode de représentation des textes ne nous a pas paru secondaire pour autant. Nous présenterons, dans cet article, les modalités de représentation des textes utilisées nous garantissant un contrôle de la qualité des textes transmis à notre partenaire ainsi que de leur intégration dans notre propre outil d'analyse automatique WEBLEX.

International audience; TXM (http://sf.net/projects/txm) is an open-source software platform providing tools for qualitative and quantitative content analysis of text corpora. It implements the textometric (formerly lexicometric) methods developed in France since the 1980s, as well as generally used tools of corpus search and statistical text analysis (Heiden 2010).TXM uses a TEI extension called “XML-TXM” as its native format for storing tokenized and annotated with NLP tools corpora source texts (http://sourceforge.net/apps/ mediawiki/txm/index.php?title=XML-TXM). The capacity to import and correctly analyze TEI encoded texts was one of the features requested in the original design of the platform.However, the flexibility of the TEI framework (which is its force) and the variety of encoding practices make it virtually impossible to work out a universal strategy for building a properly structured corpus (i.e. compatible with the data model of the search and analysis engines) out of an arbitrary TEI encoded text or group of texts. It should nevertheless be possible to define a subset of TEI elements that would be correctly interpreted during the various stages of the corpus import process (for example, the TEI-lite tag set), to specify the minimum requirements to the document structure and to suggest a mechanism for customization. This work is being progressively carried out by the TXM development team, but it can hardly be successful without an input from the TEI community.The goal of this paper is to present the way TXM currently deals with importing TEI encoded corpora and to discuss the ways to improve this process by interpreting TEI elements in terms of the TXM data model.

Extended abstract available at the conference website: http://idhmc.tamu.edu/teiconference/program/papers/

Texte intégral en ligne : http://www.lrec-conf.org/proceedings/lrec2012/workshops/13.ProceedingsCultHeritage.pdf; International audience; http://www.lrec-conf.org/proceedings/lrec2012/workshops/13.ProceedingsCultHeritage.pdf This paper presents the new TXM software platform giving online access to Old French Text Manuscripts images and tagged transcriptions for concordancing and text mining. This platform is able to import medieval sources encoded in XML according to the TEI Guidelines for linking manuscript images to transcriptions, encode several diplomatic levels of transcription including abbreviations and word level corrections. It includes a sophisticated tokenizer able to deal with TEI tags at different levels of linguistic hierarchy. Words are tagged on the fly during the import process using IMS TreeTagger tool with a specific language model. Synoptic editions displaying side by side manuscript images and text transcriptions are automatically produced during the import process. Texts are organized in a corpus with their own metadata (title, author, date, genre, etc.) and several word properties indexes are produced for the CQP search engine to allow efficient word patterns search to build different type of frequency lists or concordances. For syntactically annotated texts, special indexes are produced for the Tiger Search engine to allow efficient syntactic concordances building. The platform has also been tested on classical Latin, ancient Greek, Old Slavonic and Old Hieroglyphic Egyptian corpora (including various types of encoding and annotations).