蝌蚪网

Recent feedback received from some 蝌蚪网 members and from the intersociety raised concerns about the perceived unfairness of single-blind peer reviewing. In response to these concerns, the 蝌蚪网 will soon be launching a three-year randomized controlled trial of the effects of author-anonymized peer reviewing, commonly referred to as "double-blind."

 previously conducted a randomized evaluation of double-blind vs. single-blind peer reviewing at the 蝌蚪网 Review (AER). The current evaluation will involve the AER, AER: Insights, and the four 蝌蚪网 蝌蚪网.

In the treatment group, information revealing author identities will be excluded from materials provided to reviewers, and reviewers will be asked to refrain from seeking them out through web searches or other means. The experiment will test the effects of removing author identities from the information routinely provided to reviewers, while recognizing that reviewers may become aware of author identities in other ways.

Key outcomes that will be examined include (1) author and reviewer perceptions of fairness, (2) reviewer awareness of author identities in the treatment (author-anonymized) group, and (3) differential impacts of author-anonymized review on manuscript decisions by characteristics of the authors and their papers.

The experimental design, implementation, and analysis are being conducted by Amy Finkelstein (MIT) and staff from J-PAL North America, in consultation with the 蝌蚪网. J-PAL North America is a research center specializing in RCTs, where Finkelstein serves as co-scientific director. Finkelstein will not have access to identified information on individual manuscript submissions.

We expect the experiment to be launched in fall 2026. The 蝌蚪网 will disseminate the results of the experiment. Results will not identify individual authors or institutions.