Skip to main content
Top
Published in: Health Research Policy and Systems 1/2008

Open Access 01-12-2008 | Research

Institutional operating figures in basic and applied sciences: Scientometric analysis of quantitative output benchmarking

Authors: Beatrix Groneberg-Kloft, Cristian Scutaru, Carolin Kreiter, Silvana Kölzow, Axel Fischer, David Quarcoo

Published in: Health Research Policy and Systems | Issue 1/2008

Login to get access

Abstract

Background

Institutional operating figures and benchmarking systems are important features for the implementation of efficacy in basic and applied sciences. They are needed for research evaluation and funding policy. However, the current policy settings for research evaluation urgently need review since there may be imbalances present in many areas.

Methods

The present study assessed benchmarking of research output. By the use of large data bases research output was categorized and analyzed. Specific areas of major research activity were identified by comparing publication density on different organ systems and inter- and intrafield comparison was performed for selected countries.

Results

Novel density-equalizing mappings were constructed that illustrate trends of publication activity and identify subsets of major interest in a total of 5,527,558 published items. A dichotomy was present between Western countries such as the US, UK or Germany and Asian countries such as Japan, China or South Korea concerning research focuses.

Conclusion

The present study is the first large scale analysis of global research activity and output over the last 50 years. The presently described assessment of operating figures at the national and international level can be used to identify single areas of research that are heavily focused. Further research on qualitative output benchmarking is needed to improve current policy settings for research evaluation.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference Dezhina I, Graham LR: Research funding. Science foundations: a novelty in Russian science. Science. 2005, 310: 1772-1773. 10.1126/science.1117855.CrossRefPubMed Dezhina I, Graham LR: Research funding. Science foundations: a novelty in Russian science. Science. 2005, 310: 1772-1773. 10.1126/science.1117855.CrossRefPubMed
3.
go back to reference Dalton R: California prepares to roll out stem-cell funding. Nature. 2005, 437: 800-801. 10.1038/437800b.CrossRefPubMed Dalton R: California prepares to roll out stem-cell funding. Nature. 2005, 437: 800-801. 10.1038/437800b.CrossRefPubMed
4.
go back to reference Schirber M: Biomedical policy. U.K. doubles stem cell funding. Science. 2005, 310: 1599-10.1126/science.310.5754.1599a.CrossRefPubMed Schirber M: Biomedical policy. U.K. doubles stem cell funding. Science. 2005, 310: 1599-10.1126/science.310.5754.1599a.CrossRefPubMed
5.
go back to reference Giles J: Research grants: the nightmare before funding. Nature. 2005, 437: 308-311. 10.1038/437308a.CrossRefPubMed Giles J: Research grants: the nightmare before funding. Nature. 2005, 437: 308-311. 10.1038/437308a.CrossRefPubMed
6.
go back to reference Dressler GR: Proposed changes to biomedical funding. Science. 2005, 310: 1279-10.1126/science.310.5752.1279a.CrossRefPubMed Dressler GR: Proposed changes to biomedical funding. Science. 2005, 310: 1279-10.1126/science.310.5752.1279a.CrossRefPubMed
8.
go back to reference Kintisch E: U.S. economy. Panel calls for more science funding to preserve U.S. prestige. Science. 2005, 310: 423-10.1126/science.310.5747.423.CrossRefPubMed Kintisch E: U.S. economy. Panel calls for more science funding to preserve U.S. prestige. Science. 2005, 310: 423-10.1126/science.310.5747.423.CrossRefPubMed
9.
go back to reference Wadman M: Disappointment in slow-down for biomedical funding. Nature. 2005, 433: 559-10.1038/433559a.CrossRefPubMed Wadman M: Disappointment in slow-down for biomedical funding. Nature. 2005, 433: 559-10.1038/433559a.CrossRefPubMed
10.
go back to reference Wiley MM: The Irish health system: developments in strategy, structure, funding and delivery since 1980. Health Econ. 2005, 14: S169-186. 10.1002/hec.1034.CrossRefPubMed Wiley MM: The Irish health system: developments in strategy, structure, funding and delivery since 1980. Health Econ. 2005, 14: S169-186. 10.1002/hec.1034.CrossRefPubMed
11.
go back to reference Charlton BG, Andras P: Medical research funding may have over-expanded and be due for collapse. Qjm. 2005, 98: 53-55. 10.1093/qjmed/hci003.CrossRefPubMed Charlton BG, Andras P: Medical research funding may have over-expanded and be due for collapse. Qjm. 2005, 98: 53-55. 10.1093/qjmed/hci003.CrossRefPubMed
12.
go back to reference Birkhahn RH, Van Deusen SK, Okpara OI, Datillo PA, Briggs WM, Gaeta TJ: Funding and publishing trends of original research by emergency medicine investigators over the past decade. Acad Emerg Med. 2006, 13: 95-101. 10.1111/j.1553-2712.2006.tb00991.x.CrossRefPubMed Birkhahn RH, Van Deusen SK, Okpara OI, Datillo PA, Briggs WM, Gaeta TJ: Funding and publishing trends of original research by emergency medicine investigators over the past decade. Acad Emerg Med. 2006, 13: 95-101. 10.1111/j.1553-2712.2006.tb00991.x.CrossRefPubMed
13.
go back to reference Time to reform European science funding. Nat Neurosci. 2004, 7: 895-10.1038/nn0904-895. Time to reform European science funding. Nat Neurosci. 2004, 7: 895-10.1038/nn0904-895.
14.
15.
go back to reference Lewison G, Grant J, Jansen P: International gastroenterology research: subject areas, impact, and funding. Gut. 2001, 49: 295-302. 10.1136/gut.49.2.295.CrossRefPubMedPubMedCentral Lewison G, Grant J, Jansen P: International gastroenterology research: subject areas, impact, and funding. Gut. 2001, 49: 295-302. 10.1136/gut.49.2.295.CrossRefPubMedPubMedCentral
16.
go back to reference Nossal GJ: A healthier climate for the funding of vaccine research. Nat Immunol. 2004, 5: 457-459. 10.1038/ni0504-457.CrossRefPubMed Nossal GJ: A healthier climate for the funding of vaccine research. Nat Immunol. 2004, 5: 457-459. 10.1038/ni0504-457.CrossRefPubMed
17.
go back to reference Schiermeier Q: Berlin places genomics among top funding priorities. Nature. 1999, 402: 568-10.1038/45036.CrossRefPubMed Schiermeier Q: Berlin places genomics among top funding priorities. Nature. 1999, 402: 568-10.1038/45036.CrossRefPubMed
18.
go back to reference Abbott A: Germany to shift funding from physics to biology. Nature. 1992, 357: 182-10.1038/357529d0.PubMed Abbott A: Germany to shift funding from physics to biology. Nature. 1992, 357: 182-10.1038/357529d0.PubMed
19.
go back to reference Bartels D, Abir-Am P: The Rockefeller Foundation's funding policy for molecular biology: success or failure?. Soc Stud Sci. 1984, 14: 238-243. 10.1177/030631284014002004.CrossRefPubMed Bartels D, Abir-Am P: The Rockefeller Foundation's funding policy for molecular biology: success or failure?. Soc Stud Sci. 1984, 14: 238-243. 10.1177/030631284014002004.CrossRefPubMed
20.
21.
go back to reference Campbell A: Ethos and economics: examining the rationale underlying stem cell and cloning research policies in the United States, Germany, and Japan. Am J Law Med. 2005, 31: 47-86.PubMed Campbell A: Ethos and economics: examining the rationale underlying stem cell and cloning research policies in the United States, Germany, and Japan. Am J Law Med. 2005, 31: 47-86.PubMed
22.
go back to reference Stevens D: Embryonic stem cell research: will President Bush's limitation on federal funding put the United States at a disadvantage? A comparison between U.S. and international law. Houst J Int Law. 2003, 25: 623-653.PubMed Stevens D: Embryonic stem cell research: will President Bush's limitation on federal funding put the United States at a disadvantage? A comparison between U.S. and international law. Houst J Int Law. 2003, 25: 623-653.PubMed
23.
go back to reference Taylor PL: The gap between law and ethics in human embryonic stem cell research: overcoming the effect of U.S. federal policy on research advances and public benefit. Sci Eng Ethics. 2005, 11: 589-616. 10.1007/s11948-005-0028-x.CrossRefPubMed Taylor PL: The gap between law and ethics in human embryonic stem cell research: overcoming the effect of U.S. federal policy on research advances and public benefit. Sci Eng Ethics. 2005, 11: 589-616. 10.1007/s11948-005-0028-x.CrossRefPubMed
24.
go back to reference Moser G: ["A model of joint research"? Cancer research and the funding policies of the German Research Foundation and the Reich Research Council in National Socialist Germany]. Medizinhist J. 2005, 40: 113-139.PubMed Moser G: ["A model of joint research"? Cancer research and the funding policies of the German Research Foundation and the Reich Research Council in National Socialist Germany]. Medizinhist J. 2005, 40: 113-139.PubMed
25.
go back to reference Reed DA, Kern DE, Levine RB, Wright SM: Costs and funding for published medical education research. Jama. 2005, 294: 1052-1057. 10.1001/jama.294.9.1052.CrossRefPubMed Reed DA, Kern DE, Levine RB, Wright SM: Costs and funding for published medical education research. Jama. 2005, 294: 1052-1057. 10.1001/jama.294.9.1052.CrossRefPubMed
26.
go back to reference Darbyshire P, Downes M, Collins C, Dyer S: Moving from institutional dependence to entrepreneurialism. Creating and funding a collaborative research and practice development position. J Clin Nurs. 2005, 14: 926-934. 10.1111/j.1365-2702.2005.01132.x.CrossRefPubMed Darbyshire P, Downes M, Collins C, Dyer S: Moving from institutional dependence to entrepreneurialism. Creating and funding a collaborative research and practice development position. J Clin Nurs. 2005, 14: 926-934. 10.1111/j.1365-2702.2005.01132.x.CrossRefPubMed
27.
go back to reference Thies KM, Harper D: Medicare funding for nursing education: proposal for a coherent policy agenda. Nurs Outlook. 2004, 52: 297-303. 10.1016/j.outlook.2004.09.003.CrossRefPubMed Thies KM, Harper D: Medicare funding for nursing education: proposal for a coherent policy agenda. Nurs Outlook. 2004, 52: 297-303. 10.1016/j.outlook.2004.09.003.CrossRefPubMed
28.
go back to reference Crane BB, Dusenberry J: Power and politics in international funding for reproductive health: the US Global Gag Rule. Reprod Health Matters. 2004, 12: 128-137. 10.1016/S0968-8080(04)24140-4.CrossRefPubMed Crane BB, Dusenberry J: Power and politics in international funding for reproductive health: the US Global Gag Rule. Reprod Health Matters. 2004, 12: 128-137. 10.1016/S0968-8080(04)24140-4.CrossRefPubMed
29.
go back to reference Zwingmann C, Buschmann-Steinhage R, Gerwinn H, Klosterhuis H: [The "rehabilitation sciences" research funding programme: research findings – implementation – impact and perspectives]. Rehabilitation (Stuttg). 2004, 43: 260-270.CrossRef Zwingmann C, Buschmann-Steinhage R, Gerwinn H, Klosterhuis H: [The "rehabilitation sciences" research funding programme: research findings – implementation – impact and perspectives]. Rehabilitation (Stuttg). 2004, 43: 260-270.CrossRef
30.
go back to reference DeLisa JA, Rosenthal M: Funding for rehabilitation medicine: building research capacity. Am J Phys Med Rehabil. 2005, 84: 991-998. 10.1097/01.phm.0000187849.87038.33.CrossRefPubMed DeLisa JA, Rosenthal M: Funding for rehabilitation medicine: building research capacity. Am J Phys Med Rehabil. 2005, 84: 991-998. 10.1097/01.phm.0000187849.87038.33.CrossRefPubMed
31.
go back to reference Anderson A: Funding in Europe: how the big three cope. Science. 1991, 254: 1118-10.1126/science.1957164.CrossRefPubMed Anderson A: Funding in Europe: how the big three cope. Science. 1991, 254: 1118-10.1126/science.1957164.CrossRefPubMed
32.
go back to reference Beauchamp TL: Ethical issues in funding and monitoring university research. Bus Prof Ethics J. 1992, 11: 5-16.CrossRefPubMed Beauchamp TL: Ethical issues in funding and monitoring university research. Bus Prof Ethics J. 1992, 11: 5-16.CrossRefPubMed
33.
go back to reference Jellinek MS, Levine RJ: IRBs and pharmaceutical company funding of research. Irb. 1982, 4: 9-10. 10.2307/3564273.CrossRefPubMed Jellinek MS, Levine RJ: IRBs and pharmaceutical company funding of research. Irb. 1982, 4: 9-10. 10.2307/3564273.CrossRefPubMed
34.
go back to reference Gronbjerg KA: How nonprofit human service organizations manage their funding sources: key findings and policy implications. Nonprofit Manag Leadersh. 1991, 2: 159-175. 10.1002/nml.4130020206.CrossRefPubMed Gronbjerg KA: How nonprofit human service organizations manage their funding sources: key findings and policy implications. Nonprofit Manag Leadersh. 1991, 2: 159-175. 10.1002/nml.4130020206.CrossRefPubMed
35.
go back to reference Ratcliffe J: The influence of funding agencies on international health policy, research and programs. Mobius. 1985, 5: 93-115.PubMed Ratcliffe J: The influence of funding agencies on international health policy, research and programs. Mobius. 1985, 5: 93-115.PubMed
36.
go back to reference Geisow MJ: Public funding of research and development: a broad picture. Trends Biotechnol. 1991, 9: 76-77. 10.1016/0167-7799(91)90026-E.CrossRefPubMed Geisow MJ: Public funding of research and development: a broad picture. Trends Biotechnol. 1991, 9: 76-77. 10.1016/0167-7799(91)90026-E.CrossRefPubMed
37.
41.
go back to reference Gastner MT, Newman ME: From The Cover: Diffusion-based method for producing density-equalizing maps. Proc Natl Acad Sci USA. 2004, 101: 7499-7504. 10.1073/pnas.0400280101.CrossRefPubMedPubMedCentral Gastner MT, Newman ME: From The Cover: Diffusion-based method for producing density-equalizing maps. Proc Natl Acad Sci USA. 2004, 101: 7499-7504. 10.1073/pnas.0400280101.CrossRefPubMedPubMedCentral
42.
go back to reference France G: Centralised versus decentralised funding of evaluative research: impact on medical technology policy in Italy. Soc Sci Med. 1994, 38: 1635-1641. 10.1016/0277-9536(94)90064-7.CrossRefPubMed France G: Centralised versus decentralised funding of evaluative research: impact on medical technology policy in Italy. Soc Sci Med. 1994, 38: 1635-1641. 10.1016/0277-9536(94)90064-7.CrossRefPubMed
43.
go back to reference Boldt J, Zoch TB: [Funding of research projects–the importance of foundations]. Anasthesiol Intensivmed Notfallmed Schmerzther. 2002, 37: 600-603. 10.1055/s-2002-34523.CrossRefPubMed Boldt J, Zoch TB: [Funding of research projects–the importance of foundations]. Anasthesiol Intensivmed Notfallmed Schmerzther. 2002, 37: 600-603. 10.1055/s-2002-34523.CrossRefPubMed
44.
go back to reference Soteriades ES, Falagas ME: Comparison of amount of biomedical research originating from the European Union and the United States. Bmj. 2005, 331: 192-194. 10.1136/bmj.331.7510.192.CrossRefPubMedPubMedCentral Soteriades ES, Falagas ME: Comparison of amount of biomedical research originating from the European Union and the United States. Bmj. 2005, 331: 192-194. 10.1136/bmj.331.7510.192.CrossRefPubMedPubMedCentral
45.
go back to reference Fritzsche FR, Oelrich B, Dietel M, Jung K, Kristiansen G: European and US publications in the 50 highest ranking pathology journals from 2000 to 2006. J Clin Pathol. 2007 Fritzsche FR, Oelrich B, Dietel M, Jung K, Kristiansen G: European and US publications in the 50 highest ranking pathology journals from 2000 to 2006. J Clin Pathol. 2007
46.
go back to reference Siegel JE, Byron SC, Lawrence WF: Federal sponsorship of cost-effectiveness and related research in health care: 1997–2001. Value Health. 2005, 8: 223-236. 10.1111/j.1524-4733.2005.04037.x.CrossRefPubMed Siegel JE, Byron SC, Lawrence WF: Federal sponsorship of cost-effectiveness and related research in health care: 1997–2001. Value Health. 2005, 8: 223-236. 10.1111/j.1524-4733.2005.04037.x.CrossRefPubMed
47.
go back to reference Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ: Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006, 367: 1747-1757. 10.1016/S0140-6736(06)68770-9.CrossRefPubMed Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ: Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006, 367: 1747-1757. 10.1016/S0140-6736(06)68770-9.CrossRefPubMed
48.
go back to reference Wilkinson D, Askew DA, Dixon A: Skin cancer clinics in Australia: workload profile and performance indicators from an analysis of billing data. Med J Aust. 2006, 184: 162-164.PubMed Wilkinson D, Askew DA, Dixon A: Skin cancer clinics in Australia: workload profile and performance indicators from an analysis of billing data. Med J Aust. 2006, 184: 162-164.PubMed
49.
go back to reference Huang YL, Ho YS, Chuang KY: Bibliometric analysis of nursing research in Taiwan 1991–2004. J Nurs Res. 2006, 14: 75-81.CrossRefPubMed Huang YL, Ho YS, Chuang KY: Bibliometric analysis of nursing research in Taiwan 1991–2004. J Nurs Res. 2006, 14: 75-81.CrossRefPubMed
Metadata
Title
Institutional operating figures in basic and applied sciences: Scientometric analysis of quantitative output benchmarking
Authors
Beatrix Groneberg-Kloft
Cristian Scutaru
Carolin Kreiter
Silvana Kölzow
Axel Fischer
David Quarcoo
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2008
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-6-6

Other articles of this Issue 1/2008

Health Research Policy and Systems 1/2008 Go to the issue