Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-06-2015 | Research article

A method for measuring individual research productivity in hospitals: development and feasibility

Authors: Caterina Caminiti, Elisa Iezzi, Caterina Ghetti, Gianluigi De’ Angelis, Carlo Ferrari

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Research capacity is a prerequisite for any health care institution intending to provide high-quality care, yet, few clinicians engage in research, and their work is rarely recognized. To make research an institutional activity, it could be helpful to measure health care professionals’ research performance. However, a comprehensive approach to do this is lacking.

Methods

We conducted a literature analysis to determine how best to assess research performance. Our method was not restricted to bibliometric and citation parameters, as is usually the case, but also including “hidden” activities, generally not considered in research performance evaluations.

Results

A set of 12 easily retrievable indicators was used and corresponding points assigned according to a weighting system intended to reflect the effort estimated to perform each activity. We observed a highly skewed score distribution, with a minority of health care professionals performing well across the indicators. The highest score was recorded for scientific papers (768/1098 points, 70 %). Twenty percent of researchers at our institution generated 50 % of points.

Conclusions

We develop a simple method for measuring research performance, which could be rapidly implemented in health care institutions. It is hoped that the proposed method might be useful for promoting research and guiding resource allocation, although further evaluations are needed to confirm the method’s utility.
Appendix
Available only for authorised users
Literature
1.
go back to reference Whitworth A, Haining S, Stringer H. Enhancing research capacity across healthcare and higher education sectors: development and evaluation of an integrated model. BMC Health Serv Res. 2012;12:287.CrossRefPubMedPubMedCentral Whitworth A, Haining S, Stringer H. Enhancing research capacity across healthcare and higher education sectors: development and evaluation of an integrated model. BMC Health Serv Res. 2012;12:287.CrossRefPubMedPubMedCentral
2.
go back to reference Pfeiffer SI, Burd S, Wright A. Clinician and research - recurring obstacles and some possible solutions. J Clin Psychol. 1992;48(1):140–5.CrossRefPubMed Pfeiffer SI, Burd S, Wright A. Clinician and research - recurring obstacles and some possible solutions. J Clin Psychol. 1992;48(1):140–5.CrossRefPubMed
3.
go back to reference Roxburgh M. An exploration of factors which constrain nurses from research participation. J Clin Nurs. 2006;15(5):535–45.CrossRefPubMed Roxburgh M. An exploration of factors which constrain nurses from research participation. J Clin Nurs. 2006;15(5):535–45.CrossRefPubMed
4.
go back to reference Dev AT, Kauf TL, Zekry A, Patel K, Heller K, Schulman KA, et al. Factors influencing the participation of gastroenterologists and hepatologists in clinical research. BMC Health Serv Res. 2008;8:1–11.CrossRef Dev AT, Kauf TL, Zekry A, Patel K, Heller K, Schulman KA, et al. Factors influencing the participation of gastroenterologists and hepatologists in clinical research. BMC Health Serv Res. 2008;8:1–11.CrossRef
5.
go back to reference Paget SP, Lilischkis KJ, Morrow AM, Caldwell PHY. Embedding research in clinical practice: differences in attitudes to research participation among clinicians in a tertiary teaching hospital. Intern Med J. 2014;44(1):86–9.CrossRefPubMed Paget SP, Lilischkis KJ, Morrow AM, Caldwell PHY. Embedding research in clinical practice: differences in attitudes to research participation among clinicians in a tertiary teaching hospital. Intern Med J. 2014;44(1):86–9.CrossRefPubMed
6.
go back to reference Embi PJ, Tsevat J. Commentary: the relative research unit: providing incentives for clinician participation in research activities. Acad Med. 2012;87(1):11–4.CrossRefPubMedPubMedCentral Embi PJ, Tsevat J. Commentary: the relative research unit: providing incentives for clinician participation in research activities. Acad Med. 2012;87(1):11–4.CrossRefPubMedPubMedCentral
8.
go back to reference Banzi R, Moja L, Pistotti V, Facchini A, Liberati A. Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011;9:26.CrossRefPubMedPubMedCentral Banzi R, Moja L, Pistotti V, Facchini A, Liberati A. Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011;9:26.CrossRefPubMedPubMedCentral
9.
go back to reference Pendlebury DA. The use and misuse of journal metrics and other citation indicators. Archivum Immunologiae Et Therapiae Experimentalis. 2009;57(1):1–11.CrossRefPubMed Pendlebury DA. The use and misuse of journal metrics and other citation indicators. Archivum Immunologiae Et Therapiae Experimentalis. 2009;57(1):1–11.CrossRefPubMed
10.
go back to reference Durieux V, Gevenois PA. Bibliometric indicators: quality measurements of scientific publication. Radiology. 2010;255(2):342–51.CrossRefPubMed Durieux V, Gevenois PA. Bibliometric indicators: quality measurements of scientific publication. Radiology. 2010;255(2):342–51.CrossRefPubMed
11.
go back to reference Elliott DB. The impact factor: a useful indicator of journal quality or fatally flawed? Ophthalmic Physiol Opt. 2014;34(1):4–7.CrossRefPubMed Elliott DB. The impact factor: a useful indicator of journal quality or fatally flawed? Ophthalmic Physiol Opt. 2014;34(1):4–7.CrossRefPubMed
12.
go back to reference Wootton R. A simple, generalizable method for measuring individual research productivity and its use in the long-term analysis of departmental performance, including between-country comparisons. Health Res Policy Syst. 2013;11:2.CrossRefPubMedPubMedCentral Wootton R. A simple, generalizable method for measuring individual research productivity and its use in the long-term analysis of departmental performance, including between-country comparisons. Health Res Policy Syst. 2013;11:2.CrossRefPubMedPubMedCentral
13.
go back to reference Smith R. Measuring the social impact of research - Difficult but necessary. Br Med J. 2001;323(7312):528–8.CrossRef Smith R. Measuring the social impact of research - Difficult but necessary. Br Med J. 2001;323(7312):528–8.CrossRef
14.
go back to reference Mezrich R, Nagy PG. The academic RVU: a system for measuring academic productivity. J Am Coll Radiol. 2007;4(7):471–8.CrossRefPubMed Mezrich R, Nagy PG. The academic RVU: a system for measuring academic productivity. J Am Coll Radiol. 2007;4(7):471–8.CrossRefPubMed
15.
go back to reference Lowe B, Hartmann M, Wild B, Nikendei C, Kroenke K, Niehoff D, et al. Effectiveness of a 1-year resident training program in clinical research: A controlled before-and-after study. J Gen Intern Med. 2008;23(2):122–8.CrossRefPubMed Lowe B, Hartmann M, Wild B, Nikendei C, Kroenke K, Niehoff D, et al. Effectiveness of a 1-year resident training program in clinical research: A controlled before-and-after study. J Gen Intern Med. 2008;23(2):122–8.CrossRefPubMed
17.
go back to reference Owlia P, Vasei M, Goliaei B, Nassiri I. Normalized impact factor (NIF): an adjusted method for calculating the citation rate of biomedical journals. J Biomed Inform. 2011;44(2):216–20.CrossRefPubMed Owlia P, Vasei M, Goliaei B, Nassiri I. Normalized impact factor (NIF): an adjusted method for calculating the citation rate of biomedical journals. J Biomed Inform. 2011;44(2):216–20.CrossRefPubMed
18.
go back to reference Tscharntke T, Hochberg ME, Rand TA, Resh VH, Krauss J. Author sequence and credit for contributions in multiauthored publications. Plos Biology. 2007;5(1):13–4.CrossRef Tscharntke T, Hochberg ME, Rand TA, Resh VH, Krauss J. Author sequence and credit for contributions in multiauthored publications. Plos Biology. 2007;5(1):13–4.CrossRef
19.
go back to reference Akl EA, Meerpohl JJ, Raad D, Piaggio G, Mattioni M, Paggi MG, et al. Effects of assessing the productivity of faculty in academic medical centres: a systematic review. Can Med Assoc J. 2012;184(11):E602–12.CrossRef Akl EA, Meerpohl JJ, Raad D, Piaggio G, Mattioni M, Paggi MG, et al. Effects of assessing the productivity of faculty in academic medical centres: a systematic review. Can Med Assoc J. 2012;184(11):E602–12.CrossRef
Metadata
Title
A method for measuring individual research productivity in hospitals: development and feasibility
Authors
Caterina Caminiti
Elisa Iezzi
Caterina Ghetti
Gianluigi De’ Angelis
Carlo Ferrari
Publication date
01-06-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-1130-7

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue