Log in with your email address username.

×

Important notice

doctorportal Learning is on the move as we will be launching a new website very shortly. If you would like to sign up to dp Learning now to register for CPD learning or to use our CPD tracker, please email support@doctorportal.com.au so we can assist you. If you are already signed up to doctorportal Learning, your login will work in the new site so you can continue to enrol for learning, complete an online module, or access your CPD tracker report.

To access and/or sign up for other resources such as Jobs Board, Bookshop or InSight+, please go to www.mja.com.au, or click the relevant menu item and you will be redirected.

All other doctorportal services, such as Find A Doctor, are no longer available.

Assessment of potential bias in research grant peer review in Canada [Research]

BACKGROUND:

Peer review is used to determine what research is funded and published, yet little is known about its effectiveness, and it is suspected that there may be biases. We investigated the variability of peer review and factors influencing ratings of grant applications.

METHODS:

We evaluated all grant applications submitted to the Canadian Institutes of Health Research between 2012 and 2014. The contribution of application, principal applicant and reviewer characteristics to overall application score was assessed after adjusting for the applicant’s scientific productivity.

RESULTS:

Among 11 624 applications, 66.2% of principal applicants were male and 64.1% were in a basic science domain. We found a significant nonlinear association between scientific productivity and final application score that differed by applicant gender and scientific domain, with higher scores associated with past funding success and h-index and lower scores associated with female applicants and those in the applied sciences. Significantly lower application scores were also associated with applicants who were older, evaluated by female reviewers only (v. male reviewers only, –0.05 points, 95% confidence interval [CI] –0.08 to –0.02) or reviewers in scientific domains different from the applicant’s (–0.07 points, 95% CI –0.11 to –0.03). Significantly higher application scores were also associated with reviewer agreement in application score (0.23 points, 95% CI 0.20 to 0.26), the existence of reviewer conflicts (0.09 points, 95% CI 0.07 to 0.11), larger budget requests (0.01 points per $100 000, 95% CI 0.007 to 0.02), and resubmissions (0.15 points, 95% CI 0.14 to 0.17). In addition, reviewers with high expertise were more likely than those with less expertise to provide higher scores to applicants with higher past success rates (0.18 points, 95% CI 0.08 to 0.28).

INTERPRETATION:

There is evidence of bias in peer review of operating grants that is of sufficient magnitude to change application scores from fundable to nonfundable. This should be addressed by training and policy changes in research funding.

email