Blind Manuscript Submission to Reduce Rejection Bias?

Similar documents
Unconscious Gender Bias in Academia: from PhD Students to Professors

Dissemination experiences from CONSORT and other reporting guidelines

Editorial. From the Editors: Perspectives on Turnaround Time

CHAPTER 2 EVALUATING NUTRITION INFORMATION OVERVIEW

Chapter 2 Evaluating Nutrition Information

SWPS 101: Why we exist and what we do. September 8, 2016 Sylvia Lewin with thanks to Kate Kamdin for the original version of this presentation

Prepare for tobacco industry interference

Gender and ethnicity trends in journal peer review: An empirical investigation using JASIST

Uptake and outcome of manuscripts in Nature journals by review model and author characteristics

Guidelines for reviewers

LILACS - JOURNAL SELECTION AND PERMANENCE CRITERIA

Gender diversity in academia

Cover Page. The handle holds various files of this Leiden University dissertation.

Conflict of interest in randomised controlled surgical trials: Systematic review, qualitative and quantitative analysis

BIOLOGY. The range and suitability of the work submitted

Dentistry. October, To, Editorial Coordinator, Dentistry, ISSN: Subject: Accepting the Editorial Board Member position of Dentistry.

A closer look at the Semantic Web journal s review process

UWA ERA Publications Collection 2011

Organizational Behaviour

P.I. PRESENTATION OUTLINE

Reasons and Emotions that Guide Stakeholder s Decisions and Have an Impact on Corporate Reputation

Responsible Authorship

Insights. Originality The research should be relevant-in time and content.

Principles of publishing

Evaluation of the Type 1 Diabetes Priority Setting Partnership

Excise and Licenses Hearing Changes and Updates. Public Informational Meeting September 17, 2018

Gill, D.L. (1992). Status of the Journal of Sport & Exercise Psychology, Journal of Sport & Exercise Psychology, 14, 1-12.

Reviewing Applicants

How to get your work published. Tracy I. George and Szu-Hee Lee Co-Editors-in-Chief International Journal of Laboratory Hematology

More on Methodological Issues in Free-Response Psi Experiments

HOW IMPLICIT BIAS CAN MAKE PHILOSOPHY CLASSES UNWELCOMING (AND WHAT WE CAN DO ABOUT IT) Matthew Kopec Ph.D., Northwestern University

Client Satisfaction Survey

F ORMATIVE TEST PAPER TEST REVIEW SHEETS

Re: Inhaled insulin for the treatment of type 1 and type 2 diabetes comments on the Assessment Report for the above appraisal

Citation Characteristics of Research Published in Emergency Medicine Versus Other Scientific Journals

The Cochrane Collaboration

Patients To Learn From: On the Need for Systematic Integration of Research and Care in Academic Health Care

NICK HASLAM* AND SIMON M. LAHAM University of Melbourne, Australia

Pilot Testing Data Collection Instruments Janine Johal and Walid Sherif

Metrics of the Gynecologic Oncology Literature Focused on Cited Utilization and Costs

INTERNAL Evaluation Activity Summary by the evaluator for project use

The Power of Feedback

An Examination of Library and Information Studies Faculty Experience with and Attitudes toward Open Access Scholarly Publishing

Fame: I m Skeptical. Fernanda Ferreira. Department of Psychology. University of California, Davis.

Cognitive Authority. Soo Young Rieh. School of Information. University of Michigan.

EQUATOR Network: promises and results of reporting guidelines

ISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology

Authors and Co-Authors,

An Escalation Model of Consciousness

Timing Your Research Career & Publishing Addiction Medicine

COGNITIVE BIAS REPORT

Reviewing Applicants. Research on Bias and Assumptions

Four authorship criteria from the MSU Authorship Guidelines (

VARIED THRUSH MANUSCRIPT REVIEW HISTORY REVIEWS (ROUND 2) Editor Decision Letter

Please don't hesitate to contact me if you wish to discuss this further.

Enhanced Asthma Management with Mobile Communication

MAASH HIP REPLACEMENT: FAST TRACK, NO COMPLICATIONS

Results of the 2016 Gender Equality in the Legal Profession Survey

Why Make Campuses Tobacco Free? A National Perspective

Journal Impact Factor and Scholarly Publishing. PUB 800 Text and Context: Essay #1 Patricia Mangahis October 1, 2018

The psychology publication situation in Cyprus

CAMPAIGN FOR STUDENT SUCCESS

Workplace Health, Safety & Compensation Review Division

How do we identify a good healthcare provider? - Patient Characteristics - Clinical Expertise - Current best research evidence

Are student evaluations of teachers (SETs) biased

Title: Intention-to-treat and transparency of related practices in randomized, controlled trials of anti-infectives

Methods in Research on Research. The Peer Review Process. Why Evidence Based Practices Are Needed?

PO Box , Omaha, NE Phone: Date. Dear Pharmacy Colleagues:

ETHICS IN PUBLISHING OF PAPERS IN THE PROCEEDINGS OF THE INTERNATIONAL SCIENTIFIC SYMPOSIUM "METROLOGY AND METROLOGY ASSURANCE"

Peer review of a scientific manuscript. Hanan Hamamy

Special guidelines for preparation and quality approval of reviews in the form of reference documents in the field of occupational diseases

Eschew Obfuscation: Advice on Writing Clearly

What are your rights if DTA won't give you benefits, or reduces or stops your benefits?

Unconscious Bias and the Hiring Decision

UNCONSCIOUS BIAS. It Matters. Presented by Training Evolution, Inc.

"Everything you need to know about Ethics Iowa Municipal Management Institute March Martha Perego ICMA Director of Ethics

How are Journal Impact, Prestige and Article Influence Related? An Application to Neuroscience*

Glossary of Research Terms Compiled by Dr Emma Rowden and David Litting (UTS Library)

I DON T KNOW WHAT TO BELIEVE...

NCEA Level 3 Chinese (91533) 2016 page 1 of 5

MATH-134. Experimental Design

Editorial misconduct in biomedical journals - the role of an Ombudsman

IJSPT INVITED COMMENTARY ABSTRACT

This report summarizes the stakeholder feedback that was received through the online survey.

WORLD DATABASE OF HAPPINESS 1. Ruut Veenhoven, Erasmus University Rotterdam. Social Indicators, 1995, vol 34, pp

Responsible Conduct of Research: Responsible Authorship. David M. Langenau, PhD, Associate Professor of Pathology Director, Molecular Pathology Unit

SEMINAR ON SERVICE MARKETING

Registered Reports: Peer reviewed study pre-registration. Implications for reporting of human clinical trials

Best Doctors Service Card. Connecting Canadians to the world s best medical information

The Unconscious Bias Masterclass

OSEP Leadership Conference

Focus Words complexity culture element resourceful tradition

More about inferential control models

Pharmacists Defence Association Response to the General Pharmaceutical Council s Consultation on Religion, Personal Values and Beliefs

What Does Pro Se Assistance Mean for Your County?

EXAMPLE MATERIAL ETHICAL COMPETENCY TEST. National Accreditation Authority for Translators and Interpreters (NAATI) SAMPLE QUESTIONS AND ANSWERS

Preparing for an Oral Hearing: Taxi, Limousine or other PDV Applications

Reviewing Papers and Writing Referee Reports. (B. DeMarco, Lance Cooper, Tony Liss, Doug Beck) Why referees are needed

Transcription:

Sci Eng Ethics DOI 10.1007/s11948-014-9547-7 OPINION Blind Manuscript Submission to Reduce Rejection Bias? Khaled Moustafa Received: 10 March 2014 / Accepted: 3 April 2014 Ó Springer Science+Business Media Dordrecht 2014 High percentages of submitted papers are rejected at editorial levels without offering a second chance to authors by sending their papers for further peer-reviews. In most cases, the rejections are typical quick answers without helpful argumentations related to the content of the rejected material. More surprisingly, some journals vaunt their high rejection rates as a mark of prestige! However, journals that reject high percentages of submitted papers have built their prominent positions based on a flawed measure, the impact factor, and from a long and favorable historical context. Their shareholders may think that they are allowed to have a large margin of rejection rates without affecting their sponsorship or funding sources thanks to an extended anchorage since tens, or in some cases hundreds, of years compared to unknown or new journals that struggle to pave a way in the scientific publication world. Historical anchorage of some journals also makes it unfair to compare old and new journals in term of whatever popularity or any ranking system. It will thus be unfair and biased appraisal to compare a journal that was launched in 2000 with a journal that was established in 1950 or 1900 or earlier. Rejecting a high percentage of papers became an objective per se for elitist journals to take pride in an artificial elitist club, arguing strangely that a high rejection rate is a gauge of quality. Worse, sometimes rejection decisions are made after long months of waiting, upwards of a year in some cases without giving information about why the paper is rejected or how to improve it, for at least to compensate authors by useful advices for their wasted time in waiting the journal s negative decision. Doing so, they corrupt science and give negative images of their journals. Elitism is an attitude incompatible with science and knowledge dissemination. K. Moustafa (&) Institut National de la Santé et de la Recherche Médicale (INSERM), Créteil, France e-mail: khaled.moustafa@inserm.fr

K. Moustafa Another subjective and unfounded rejection argumentation is based on space limitation, as if a journal was a means of transport in which all places have been reserved and there are no more places available neither in the current or subsequent issues. In order to reduce such biases and maintain the integrity of scientific publication, an important reform at the submission level would be required. Scientists need to be evaluated by peers based on the content of their articles, not on their nominal or institutional reputation. Editors are ultimately humans. They could be biased consciously or unconsciously in favor or against an article when they recognize the author s name, his gender, country or institution etc. In a recent report for example, it was shown that some biases relating to gender favoritism exist at faculty level (Moss-Racusin et al. 2012). In the same way, an article can be rejected upon initial screening without further consideration just because an editor has an impression about the author s name, his gender, his previous work, his country or his affiliated institution, despite the potential merit of the submitted material. Moreover, at a comparable level of a paper s contents, known scientists having track records and working at prestigious institutions or in a developed country would have much more of chance to get their papers accepted in the highest ranked journal than unknown scientists working in a developing country or at small or unknown institutions. English native-speakers or countries would also have more chance and facility than non-native speakers or countries. Blind submission (submission without disclosing the author s identity and contact details) would thus be an effective solution to reduce rejection biases at the editorial levels and the first stage of paper assessment. Anonymous submission will allow judging articles based only on their content and merit, far from any personal or institutional biases. Together with blind peer-review, blind submission would enhance the scientific integrity and impartiality. The blind review system was introduced to increase the objectivity of the publication assessment (Kmietowicz 2008). But objectivity is also needed, and more importantly, at the first stage of the paper s evaluation, because high rejection rates (up to 90 95 % in some cases) are made at this stage without valid reasons. Too much transparency may kill the transparency and the impartiality. When a double-blind review system was considered by an ecology journal, the representation of female authors was increased (Budden et al. 2008), suggesting that open review system has negative or biased effects on paper acceptances and rejections. It is easily noticeable that there is an apparent asymmetry and double standard for paper acceptance and rejection policies. While the acceptance is generally decided at a collective level (editors plus reviewers), the rejection is often made by only one peer, the editor alone. To reject a paper, things are easy, but to accept a paper some editors need one or several reviewers endorsements. This is a double standard that may need to be reformed because it means that the responsibility for paper acceptance is higher and more serious than the rejection s, though rejections often cause more moral damages for authors than acceptance for editors. A question may arise from this matter is: why are rejection and acceptance not treated equally?

Blind Manuscript Submission to Reduce Rejection Bias? One may also argue that a high rejection rate is sometimes unavoidable due to many more papers being received than the editors can handle. This may be true, particularly for known journals, which highlights another serious problem about why people prefer to target one specific journal rather than another. The answer is straightforward. Many authors believe that publishing in high impact factor journals will valorize them more than publishing in low impact factor journals. Although this is a highly questionable matter, it also poses the problem of the biased evaluation policy conducted by hiring or funding committees that rely on flawed ranking systems to evaluate people or to attribute funds. One of the reasons of the insistence to use such flawed measures (impact factor or similar measures) could be explained, at least partially, by the fact that it is easier for evaluators to compare simple numbers than to read longer texts to probe their potential values and make an objective assessment. For evaluators and administrators, who are in most cases nonscientists or scientists who were politicized for administrative roles, it is easier and faster to compare abstract numbers (i.e. impact factor or number of publications) than written texts that need time, intellectual efforts and concentration to draw an objective assessment compared to a simple number that will do the job painlessly, just by its superior or inferior values. Additionally, the highest impact factor journals are generally Review Journals whose articles are mostly commissioned or solicited, which adds a further layer of flaws to the impact factor and shows to which extent the impact factor could be handled (Moustafa 2014). Publication is not a materialistic matter nor a commercial brand to be categorized into quality classes or ranks based on unique ingredients or exclusive characteristics that one brand can offer but not another. Publication, instead, is an intellectual contribution that could be conveyed in any form (printed or online) in any journal (old or new, with high or low impact factor). In other words, articles are peerreviewed in the same way whatever the journal, and it does not make much sense that journal X should be more valuable than journal Y. In a materialistic world, on other hand, there may be differences in ingredients or characteristics of manufactured goods, but in a scientific publication, journals fairly follow the same process and principles: peer-review followed by publication on paper and/or online, and authors have multiple choices to equally submit to either one. The same reviewers can also be reviewers for journal X or Y, for high or low impact factor journals. Any notion of superiority should thus be meaningless, apart from the originality of the published thoughts or ideas independently from the journal name or its history or its managers. At any rate, blind submission cannot be a rampart against high rejection rates but as a buffer to remove potentially subjective factors from the rejection decisions at the first assessment level. Editors can continue to reject high percentages of submitted papers, if they judge it necessary for their journals, but with a blind submission approach they will do it with greater objectivity and neutrality. Some issues, however, may arise from a blind submission system. The first is the risk for a self-peer review. Since editors will not know the authors identity, an author might be invited to judge his/her own paper. This issue, however, can be easily surmounted from a technical viewpoint. Regardless of the fact that the authors should be aware about such an eventuality, a technical solution could

K. Moustafa also be implemented to avoid such an issue before it happens. One simple code line introduced in the source code of the managing software can solve the problem; for example, If the name(s) of the invited reviewer(s) is/are identical to the author(s) name(s), then do not send the review invitation (or notify the editor ). In a blind submission system, the communication with the corresponding authors can also be personalized by automatic association between the submission number and the author s name, as is the case of the acknowledgements sent automatically upon submissions. With the new facility of web-based technologies, the blind submission is relatively easy to implement and to operate for a better assessment of the scientific integrity and reliability. Since authors do not wish to damage editors or reviewers, a good option would be a submission system in which the author s identity should be undisclosed while the evaluator s identity (including editors and reviewers) should be disclosed. In such a system, editors and reviewers would be responsible for their decisions in case of any subjective assessment or personal biases. The authors, on the other hand, are already responsible for their publications (since their names will be shown), while the names of reviewers and editors are in most cases not disclosed. Undisclosed authors should not matter as the objective of the peer-review process is to objectively assess a manuscript, not the author s name. Moreover, in a submission system of disclosed evaluators/undisclosed authors, reviewers will cease to be virtual numbers; authors will call them more professionally by their names rather than by numbers (reviewer 1, reviewer 2 ). Reviewers, on the other hand, will address their comments as to the author(s), without any particular issue. Finally, if journals editors want to maintain scientific integrity and protect their publication policy from any bias, they should innovate at the submission level and remove any partial or personal influences by adopting a system of undisclosed author/disclosed evaluators. Rejecting papers on subjective criteria may turn scientists away toward other alternatives or we may end with each scientist or institution having his or its journal. The rejection decisions should also be developed and founded on real helpful argumentations rather than on typical or superficial argumentations such as space limitation or high pressure for space which do not make much sense. Authors would accept a rejection decision that is useful to improve their manuscript rather than to increase the reject prestige of the targeted journal, which will vaunt its amplified rejection rate as further prestige. On other hand, most submission processes are currently long, daunting and time consuming. The submission process should be simplified and limited to only login and file uploading in the first stage. Upon acceptance, authors would be happy to provide all the required information and the specific page formatting. In such a case, the time devoted to answer a long series of questions and make a specific formatting is justified by the acceptance; in the case of rejection, it is not less than a waste of time for authors, editors and journals managers. Conflict of interest None.

Blind Manuscript Submission to Reduce Rejection Bias? References Budden, A. E., Tregenza, T., Aarssen, L. W., Koricheva, J., Leimu, R., & Lortie, C. J. (2008). Doubleblind review favours increased representation of female authors. Trends in Ecology & Evolution, 23(1), 4 6. Kmietowicz, Z. (2008). Double blind peer reviews are fairer and more objective, say academics. British Medical Journal, 336(7638), 241. Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2012). Science faculty s subtle gender biases favor male students. Proceedings of the National Academy of Sciences of the United States of America, 109(41), 16474 16479. Moustafa, K. (2014). The disaster of the impact factor. Science and Engineering Ethics. doi:10.1007/ s11948-014-9517-0.