Back to Search
Start Over
How accurate are policy document mentions? A first look at the role of altmetrics database
- Source :
- Scientometrics. 125:1517-1540
- Publication Year :
- 2020
- Publisher :
- Springer Science and Business Media LLC, 2020.
-
Abstract
- Policy document mention is considered to indicate the significance and societal impact of scientific product. However, the accuracy of policy document altmetrics data needs to be evaluated to fully understand its strength and limitation. An in-depth coding analysis was conducted on sample policy documents records of Altmetric.com database. The sample consists of 2079 records from all 79 distinct policy document source platforms tracked by the database. Errors about mentioned publications in the policy documents (type A error) are found in 8% of the records, while errors about either the recorded policy documents or the mentioned publications in the altmetrics database (type B error) are found in 70% of the records. In type B error, policy document link error (5% of the records) could be attributable to the policy document website, transcription error (52% of the records) could be attributable to the third-party bibliographic data provider. These two categories of error are relatively minor and may have limited influence on altmetrics research and practices. False positive policy document mention (13% of the records), however, could be attributable to the Altmetric database and may diminish the validity of research based on the policy document altmetrics data. The underlying reasons remain to be further investigated. Considering the high complexity of extracting mentions of publications from various sources and formats of policy documents as well as its short history, Altmetric database has achieved excellent performance.
- Subjects :
- Database
Computer science
Data needs
05 social sciences
General Social Sciences
Data provider
Societal impact of nanotechnology
Library and Information Sciences
050905 science studies
computer.software_genre
Computer Science Applications
High complexity
Data quality
Transcription error
Altmetrics
0509 other social sciences
050904 information & library sciences
computer
Coding (social sciences)
Subjects
Details
- ISSN :
- 15882861 and 01389130
- Volume :
- 125
- Database :
- OpenAIRE
- Journal :
- Scientometrics
- Accession number :
- edsair.doi...........c5d561c175ce8dd6e9cad00aaf80512d