Notice on NLPCC AI-assisted Peer Review Study
The 15th CCF International Conference on Natural Language Processing and Chinese Computing
About This Study
To explore the appropriate use of artificial intelligence in academic peer review, NLPCC plans to conduct a study on AI-assisted peer review. The purpose of this study is to understand how AI-based reviewing assistance systems can help reviewers better understand papers, locate evidence in manuscripts, and organize review comments.
The system used in this study is ReviewCopilot. ReviewCopilot can assist reviewers in asking questions based on the paper content, locating relevant evidence, organizing review notes, and generating draft review comments. All AI-generated content will be used only as auxiliary information and will not replace human reviewers' judgment.
Research Principles
This study follows the principles below.
- No Impact on Review Fairness
Whether or not an author participates in this study will not affect the review, discussion, scoring, ranking, or final acceptance decision of their paper. - AI Will Not Replace Human Reviewers
The AI system will be used only as a reviewing assistance tool. Final review comments, scores, recommendations, and meta-reviews will remain the responsibility of human reviewers and Area Chairs. - Data Will Be Anonymized and Analyzed in Aggregate
The collected research data will be used only to analyze the overall effectiveness and usage patterns of AI-assisted peer review. The results will be reported only in anonymized and aggregate form. - Paper Manuscripts and Review Comments Will Not Be Publicly Released
NLPCC will not publicly release authors’ paper manuscripts, original review comments, author identities, reviewer identities, or any information that could be used to infer the identity of a specific paper, author, or reviewer. - Data Will Not Be Used to Train AI Reviewers Without Additional Authorization
The primary goal of this study is to conduct statistical analysis and understand the usage and effects of AI-assisted reviewing. If paper manuscripts, review comments, or interaction data are to be used in the future for training AI reviewers, separate explicit authorization will be requested.
Author Opt-out Mechanism
If you do not wish your paper to be included in this AI-assisted peer review study, please opt out before the following deadline:
To opt out, please send an email to:
Email subject:
Opt-out from NLPCC AI-assisted Peer Review Study - Paper ID: [your paper ID]
Email body:
Please include your paper ID, the name of the corresponding author, and the OpenReview link to your paper.
Opting out will not have any negative impact on the review, scoring, discussion, or final acceptance decision of your paper.
Thank you for your understanding and support for NLPCC's efforts to improve the peer review process.