Peer Prediction for Peer Review: Designing a Marketplace for Ideas

Author(s): Alexander Ugarov

Looking for co-authors: No

The paper describes a potential platform to facilitate academic peer review with emphasis on early-stage research. This platform aims to make peer review more accurate and timely by rewarding reviewers on the basis of peer prediction algorithms. The algorithm uses a variation of Peer Truth Serum for Crowdsourcing Radanovic et al. (2016) with human raters competing against a machine learning benchmark. We explain how our approach addresses two large productive inefficiencies in science: mismatch between research questions and teams and redundancy of research projects. Better peer-review for early research creates additional incentives for sharing it, which simplifies matching ideas to teams and reduces redundancy.

Read the paper

Published: 2023-03-03 16:44:02 PT

Stage: Working Paper

Fields: Digital Economics

Research Group(s): Playground

Referee Reports: No referee reports yet. (Add your report)

Versions: v1 (11/17/2022) , v2 (02/13/2023) , v3 (03/03/2023) , v4 (03/19/2023)

0 comments