Search

The method of selecting abstracts for an international congress at which only 15% of submitted papers could be accepted entailed a panel of 12 assessors using their specialised knowledges but presentation of the abstract was also important in selection. There was only a limited agreement between assessors in arranging abstracts in order of merit, so that a single assessor would be unacceptable.
Use of the full panel to grade all abstracts was very expensive, but it could be replaced, without unacceptable injustice, by dividing the work randomly among groups of three selectors. [ABSTRACT FROM AUTHOR]