论文标题
我们该怎么做才能改善NLP中的同行评审?
What Can We Do to Improve Peer Review in NLP?
论文作者
论文摘要
同行评审是我们判断会议质量质量的最佳工具,但它越来越虚假。我们认为,问题的一部分是审稿人和区域椅子面临的定义较差,迫使苹果到孔的比较。前进有多种潜在的方式,但是关键困难是为他们在NLP社区的一致实施创造激励措施和机制。
Peer review is our best tool for judging the quality of conference submissions, but it is becoming increasingly spurious. We argue that a part of the problem is that the reviewers and area chairs face a poorly defined task forcing apples-to-oranges comparisons. There are several potential ways forward, but the key difficulty is creating the incentives and mechanisms for their consistent implementation in the NLP community.