Search

Your search keyword '"Institut National Polytechnique de Toulouse - INPT (FRANCE)"' showing total 2 results
Start Over Author "Institut National Polytechnique de Toulouse - INPT (FRANCE)" Search Limiters Peer Reviewed
2 results on '"Institut National Polytechnique de Toulouse - INPT (FRANCE)"'

1. What can new technology tell us about the reviewing process for journal submissions in BJET?

Author

Hartley, James, Cabanac, Guillaume, Keele University [Keele], Systèmes d’Informations Généralisées (IRIT-SIG), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Université Toulouse III - Paul Sabatier (UT3), Centre National de la Recherche Scientifique - CNRS (FRANCE), Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), Keele University (UNITED KINGDOM), Institut de Recherche en Informatique de Toulouse - IRIT (Toulouse, France), and Institut National Polytechnique de Toulouse - INPT (FRANCE)

Subjects
Théorie de l'information, Peer choice, [INFO.INFO-IT]Computer Science [cs]/Information Theory [cs.IT], [INFO.INFO-IR]Computer Science [cs]/Information Retrieval [cs.IR], Recherche d'information
Abstract

International audience; New technology allows us to collect rich and voluminous data about refereeing—something that was not possible before. In this quantitative study, we consider data about the dates of sending (1) suitable papers to BJET, (2) the papers to referees and (3) when the referees' reports are returned to the editor. To do this, we examined data from over 11 000 reports collected between 2005 (when BJET began using ScholarOne as its online editorial manager) and October 2014. We found that most of the submissions and responses were made in the earlier part of the week, with some evidence of academics (and the editor) working on Sundays. We also found modest agreement between referees on the quality of individual papers.

Published
2015
Full Text
View/download PDF

2. Capitalizing on order effects in the bids of peer-reviewed conferences to secure reviews by expert referees

Author

Thomas Preuss, Guillaume Cabanac, Systèmes d’Informations Généralisées (IRIT-SIG), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Université Toulouse III - Paul Sabatier (UT3), Brandenbourg university of Technology, Centre National de la Recherche Scientifique - CNRS (FRANCE), Institut National Polytechnique de Toulouse - INPT (FRANCE), Fachhochschule Brandenburg (GERMANY), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), and Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)

Subjects
Computer Networks and Communications, Process (engineering), Computer science, media_common.quotation_subject, 02 engineering and technology, GeneralLiterature_MISCELLANEOUS, Order effects, World Wide Web, Artificial Intelligence, Originality, 020204 information systems, 0202 electrical engineering, electronic engineering, information engineering, Conference management system, media_common, Théorie de l'information, Point (typography), business.industry, 05 social sciences, Recherche d'information, Public relations, Bidding, Human-Computer Interaction, Scientific conferences, Order (business), [INFO.INFO-IT]Computer Science [cs]/Information Theory [cs.IT], [INFO.INFO-IR]Computer Science [cs]/Information Retrieval [cs.IR], Public trust, 0509 other social sciences, 050904 information & library sciences, business, Paper bids, Software, Information Systems
Abstract

International audience; Peer review supports scientific conferences in selecting high quality papers for publication. Referees are expected to evaluate submissions equitably according to objective criteria (e.g., originality of the contribution, soundness of the theory, validity of the experiments). We argue that the submission date of papers is a subjective factor playing a role in the way they are evaluated. Indeed, program committee (PC) chairs and referees process submission lists that are usually sorted by paperIDs. This order conveys chronological information, as papers are numbered sequentially upon reception.We show that order effects lead to unconsciously favor early-submitted papers to the detriment of later-submitted papers. Our point is supported by a study of 42 peer-reviewed conferences in Computer Science showing a decrease in the number of bids placed on submissions with higher paperIDs. It is advised to counterbalance order effects during the bidding phase of peer review by promoting the submissions with fewer bids to potential referees. This manipulation intends to better share bids out among submissions in order to attract qualified referees for all submissions. This would secure reviews from confident referees, who are keen on voicing sharp opinions and recommendations (acceptance or rejection) about submissions. This work contributes to the integrity of peer review, which is mandatory to maintain public trust in science.

Published
2013
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results