How to deal with unethical reviewers? The good example of the EAAI journal

Today, I will talk about a problem that has been plaguing many academic journals in recent years. It is that several unethical reviewers are asking authors to cite several of their papers to boost their citation count. I previous wrote a few blog posts about this: post1, post2, post3 but today, I want to talk about solutions.

I see this problem happening very often in academic journals, especially as an author. In some case, I for example, received reviews for a journal paper where the reviewer was asking to cite 10 papers (!!!) by the same author, which were very remotely relevant to the topic. In this case, it is obvious that the reviewer is just trying to boost his citation count to game the system, and perhaps obtain a promotion or something else.

Usually, when this happen, I will complain to the editor because this behavior is unethical, and I dont want add useless citations in my paper, which would degrade the quality of the paper. But I know several authors that are afraid of such unethical reviewers and that will just do what the reviewers ask and add the citations rather than reporting them for their unethical behavior. But I also understand the authors who do not want to report this problem because the reviewers are in a position of power. So it is hard to fight this problem, and sometimes the editor will not even pay attention to those reports.

So how to handle this problem? I think that a good solution is to follow the approach of the EAAI journal, and this is the topic of this blog for today. I want to praise that journal for the form that they provide to reviewers. The first question of that form is as follows:

In that question, the reviewer is required to clearly indicate all the references that they are asking the authors to cite and to provide the full author list and DOI of each reference. This is important because many unethical reviewers will ask to cite papers but remove their names from the author list, hoping that the editor would not detect the conflict of interest.

The second question of the review form ask the reviewer to clearly indicate any citations from themselves and the reason for asking to cite such papers. There is also a clear warning that this is generally considered unethical.

These two questions in the review form are very simple, but they show that the journal cares and this form tells the reviewers to stay away from this type of unethical behavior. It can certainly have a dissuasive effect.

I think that this is a good approach and other journals should take this as an example and do the same. I know that some other journals do this already but still many journals do not, and this problem is still very common in academia.

And also, a major issue is that several editors just don’t pay attention to this problem as they are sometimes handling hundreds of papers. Thus, some editor will just read the reviews from reviewers very quickly and will not see the problem. And it also happens in some cases that the editor is the problem itself. I have ever seen some suspicious behavior where reviewers where asking me to cite papers from the handling editor. In this case, it is rather obvious that the editor is editing the reviews from reviewers to boost his citation count or the impact factor of his own journal!

So that is all for this post. I just wanted to praise the approach adopted by the EAAI journal as a good example of how to deal with unethical reviewers by adding questions to the review form. Do you have any other suggestions? You may share them in the comment section below.


Philippe Fournier-Viger is a computer science professor and founder of the SPMF open-source data mining library, which offers more than 170 algorithms for analyzing data, implemented in Java.

This entry was posted in Academia and tagged , , , , , , , , , . Bookmark the permalink.

Leave a Reply

Your email address will not be published. Required fields are marked *