Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

A multidisciplinary systematic review of the use of diagrams as a means of collecting data from research subjects: application, benefits and recommendations

Authors: Muriah J Umoquit, Peggy Tso, Helen ED Burchett, Mark J Dobrow

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

In research, diagrams are most commonly used in the analysis of data and visual presentation of results. However there has been a substantial growth in the use of diagrams in earlier stages of the research process to collect data. Despite this growth, guidance on this technique is often isolated within disciplines.

Methods

A multidisciplinary systematic review was performed, which included 13 traditional healthcare and non-health-focused indexes, non-indexed searches and contacting experts in the field. English-language articles that used diagrams as a data collection tool and reflected on the process were included in the review, with no restriction on publication date.

Results

The search identified 2690 documents, of which 80 were included in the final analysis. The choice to use diagrams for data collection is often determined by requirements of the research topic, such as the need to understand research subjects' knowledge or cognitive structure, to overcome cultural and linguistic differences, or to understand highly complex subject matter. How diagrams were used for data collection varied by the degrees of instruction for, and freedom in, diagram creation, the number of diagrams created or edited and the use of diagrams in conjunction with other data collection methods. Depending on how data collection is structured, a variety of options for qualitative and quantitative analysis are available to the researcher. The review identified a number of benefits to using diagrams in data collection, including the ease with which the method can be adapted to complement other data collection methods and its ability to focus discussion. However it is clear that the benefits and challenges of diagramming depend on the nature of its application and the type of diagrams used.

Discussion/Conclusion

The results of this multidisciplinary systematic review examine the application of diagrams in data collection and the methods for analyzing the unique datasets elicited. Three recommendations are presented. Firstly, the diagrammatic approach should be chosen based on the type of data needed. Secondly, appropriate instructions will depend on the approach chosen. And thirdly, the final results should present examples of original or recreated diagrams. This review also highlighted the need for a standardized terminology of the method and a supporting theoretical framework.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wheeldon J, Faubert J: Framing experience: concept maps, mind maps, and data collection in qualitative research. International Journal of Qualitative Methods. 2009, 8: 68-83. Wheeldon J, Faubert J: Framing experience: concept maps, mind maps, and data collection in qualitative research. International Journal of Qualitative Methods. 2009, 8: 68-83.
2.
go back to reference Forbes MA: Hope in the older adult with chronic illness: A comparison of two research methods in theory building. Advances in Nursing Science. 1999, 22: 74-87.CrossRefPubMed Forbes MA: Hope in the older adult with chronic illness: A comparison of two research methods in theory building. Advances in Nursing Science. 1999, 22: 74-87.CrossRefPubMed
3.
go back to reference Jafri T, Lyons MN, Clarkson PJ: The supply of medicines in the NHS. 2008, Improving Patient Safety: Cambridge, UK Jafri T, Lyons MN, Clarkson PJ: The supply of medicines in the NHS. 2008, Improving Patient Safety: Cambridge, UK
4.
go back to reference O'Campo P, Salmon C, Burke J: Neighbourhoods and mental well-being: what are the pathways?. Health and Place. 2009, 15: 56-68.CrossRefPubMed O'Campo P, Salmon C, Burke J: Neighbourhoods and mental well-being: what are the pathways?. Health and Place. 2009, 15: 56-68.CrossRefPubMed
5.
go back to reference Pluto DM, Hirshorn BA: Process mapping as a tool for home health network analysis. Home Health Care Services Quarterly. 2003, 22: 1-16. 10.1300/J027v22n02_01.CrossRefPubMed Pluto DM, Hirshorn BA: Process mapping as a tool for home health network analysis. Home Health Care Services Quarterly. 2003, 22: 1-16. 10.1300/J027v22n02_01.CrossRefPubMed
6.
go back to reference Franca S, d'Ivernois JF, Marchand C, Haenni C, Ybarra J, Golay A: Evaluation of nutritional education using concept mapping. Patient Education and Counseling. 2004, 52: 183-192. 10.1016/S0738-3991(03)00037-5.CrossRefPubMed Franca S, d'Ivernois JF, Marchand C, Haenni C, Ybarra J, Golay A: Evaluation of nutritional education using concept mapping. Patient Education and Counseling. 2004, 52: 183-192. 10.1016/S0738-3991(03)00037-5.CrossRefPubMed
7.
go back to reference Marchand C, d'Ivernois JF, Assal JP, Slama G, Hivon R: An analysis, using concept mapping, of diabetic patients' knowledge, before and after patient education. Medical Teacher. 2002, 24: 90-99. 10.1080/01421590120091087.CrossRefPubMed Marchand C, d'Ivernois JF, Assal JP, Slama G, Hivon R: An analysis, using concept mapping, of diabetic patients' knowledge, before and after patient education. Medical Teacher. 2002, 24: 90-99. 10.1080/01421590120091087.CrossRefPubMed
8.
go back to reference Jones MG, Rua MJ: Conceptual representations of flu and microbial illness held by students, teachers, and medical professionals. Social Science and Mathematics. 2008, 108: 263-278.CrossRef Jones MG, Rua MJ: Conceptual representations of flu and microbial illness held by students, teachers, and medical professionals. Social Science and Mathematics. 2008, 108: 263-278.CrossRef
9.
go back to reference Abel WM, Freeze M: Evaluation of concept mapping in an associate degree nursing program. Journal of Nursing Education. 2006, 45: 356-364.PubMed Abel WM, Freeze M: Evaluation of concept mapping in an associate degree nursing program. Journal of Nursing Education. 2006, 45: 356-364.PubMed
10.
go back to reference Daley BJ, Shaw CR, Balistrieri T, Glasenapp K, Piacentine L: Concept maps: a strategy to teach and evaluate critical thinking. Journal of Nursing Education. 1999, 38: 42-47.PubMed Daley BJ, Shaw CR, Balistrieri T, Glasenapp K, Piacentine L: Concept maps: a strategy to teach and evaluate critical thinking. Journal of Nursing Education. 1999, 38: 42-47.PubMed
11.
go back to reference Hicks-Moore SL, Pastirik PJ: Evaluating critical thinking in clinical concept maps: A pilot study. International Journal of Nursing Education Scholarship. 2006, 3: 1-15. 10.2202/1548-923X.1314.CrossRef Hicks-Moore SL, Pastirik PJ: Evaluating critical thinking in clinical concept maps: A pilot study. International Journal of Nursing Education Scholarship. 2006, 3: 1-15. 10.2202/1548-923X.1314.CrossRef
12.
go back to reference Coad J: Using art-based techniques in engaging children and young people in health care consultations and/or research... including commentary by Bishop V and Picard C. Journal of Research in Nursing. 2007, 12: 487-497. 10.1177/1744987107081250.CrossRef Coad J: Using art-based techniques in engaging children and young people in health care consultations and/or research... including commentary by Bishop V and Picard C. Journal of Research in Nursing. 2007, 12: 487-497. 10.1177/1744987107081250.CrossRef
13.
go back to reference Haidet P, Hatem DS, Fecile ML, Stein HF, Haley H-L, Kimmel B, et al: The role of relationships in the professional formation of physicians: Case report and illustration of an elicitation technique. Patient Education and Counseling. 2008, 72: 382-387. 10.1016/j.pec.2008.05.016.CrossRefPubMed Haidet P, Hatem DS, Fecile ML, Stein HF, Haley H-L, Kimmel B, et al: The role of relationships in the professional formation of physicians: Case report and illustration of an elicitation technique. Patient Education and Counseling. 2008, 72: 382-387. 10.1016/j.pec.2008.05.016.CrossRefPubMed
14.
go back to reference Umoquit MJ, Dobrow MJ, Lemieux-Charles L, Ritvo PG, Urbach DR, Wodchis WP: The efficiency and effectiveness of utilizing diagrams in interviews: An assessment of participatory diagramming and graphic elicitation. BMC Medical Research Methodology. 2008, 8- Umoquit MJ, Dobrow MJ, Lemieux-Charles L, Ritvo PG, Urbach DR, Wodchis WP: The efficiency and effectiveness of utilizing diagrams in interviews: An assessment of participatory diagramming and graphic elicitation. BMC Medical Research Methodology. 2008, 8-
15.
go back to reference Crilly N, Blackwell A, Clarkson P: Graphic elicitation: using research diagrams as interview stimuli. Qualitative Research. 2006, 6: 341-366. 10.1177/1468794106065007.CrossRef Crilly N, Blackwell A, Clarkson P: Graphic elicitation: using research diagrams as interview stimuli. Qualitative Research. 2006, 6: 341-366. 10.1177/1468794106065007.CrossRef
16.
go back to reference Jun GT, Ward JR, Morris ZS, Clarkson PJ: Health care process modelling: which method when?. International Journal for Quality in Health Care. 2009, 21: 214-224. 10.1093/intqhc/mzp016.CrossRefPubMed Jun GT, Ward JR, Morris ZS, Clarkson PJ: Health care process modelling: which method when?. International Journal for Quality in Health Care. 2009, 21: 214-224. 10.1093/intqhc/mzp016.CrossRefPubMed
17.
go back to reference Jun GT, Ward JR, Clarkson PJ: Systems modelling approaches to the design of safe healthcare delivery:ease of use and usefulness percived by healthcare works. Ergonomics. 2010, 53: 829-847. 10.1080/00140139.2010.489653.CrossRefPubMed Jun GT, Ward JR, Clarkson PJ: Systems modelling approaches to the design of safe healthcare delivery:ease of use and usefulness percived by healthcare works. Ergonomics. 2010, 53: 829-847. 10.1080/00140139.2010.489653.CrossRefPubMed
18.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Medicine. 2009, 6: e100100-10.1371/journal.pmed.1000100.CrossRef Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Medicine. 2009, 6: e100100-10.1371/journal.pmed.1000100.CrossRef
19.
go back to reference Zhang L, Wang Y, Dong B, Zhou Z: The comparison study of Chinese and American secondary school students' knowledge structure--An experimental research based on concept map assessment technique. Frontiers of Education in China. 2009, 4: 286-297. 10.1007/s11516-009-0015-0.CrossRef Zhang L, Wang Y, Dong B, Zhou Z: The comparison study of Chinese and American secondary school students' knowledge structure--An experimental research based on concept map assessment technique. Frontiers of Education in China. 2009, 4: 286-297. 10.1007/s11516-009-0015-0.CrossRef
20.
go back to reference Hay DB: Using concept maps to measure deep, surface and non-learning outcomes. Studies in Higher Education. 2007, 32: 39-57. 10.1080/03075070601099432.CrossRef Hay DB: Using concept maps to measure deep, surface and non-learning outcomes. Studies in Higher Education. 2007, 32: 39-57. 10.1080/03075070601099432.CrossRef
21.
go back to reference Lavigne NC, Salkind SJ, Yan J: Exploring college students' mental representations of inferential statistics. The Journal of Mathematical Behavior. 2008, 27: 11-32. 10.1016/j.jmathb.2007.10.003.CrossRef Lavigne NC, Salkind SJ, Yan J: Exploring college students' mental representations of inferential statistics. The Journal of Mathematical Behavior. 2008, 27: 11-32. 10.1016/j.jmathb.2007.10.003.CrossRef
22.
go back to reference West DC, Park JK, Pomeroy JR, Sandoval J: Concept mapping assessment in medical education: A comparison of two scoring systems. Medical Education. 2002, 36: 820-826. 10.1046/j.1365-2923.2002.01292.x.CrossRefPubMed West DC, Park JK, Pomeroy JR, Sandoval J: Concept mapping assessment in medical education: A comparison of two scoring systems. Medical Education. 2002, 36: 820-826. 10.1046/j.1365-2923.2002.01292.x.CrossRefPubMed
23.
go back to reference Carter G, Jones MG, Rua M: Effects of partner's ability on the achievement and conceptual organization of high-achieving fifth-grade students. Science Education. 2002, 87: 94-111. 10.1002/sce.10031.CrossRef Carter G, Jones MG, Rua M: Effects of partner's ability on the achievement and conceptual organization of high-achieving fifth-grade students. Science Education. 2002, 87: 94-111. 10.1002/sce.10031.CrossRef
24.
go back to reference Hay DB, Wells H, Kinchin IM: Quantitative and qualitative measures of student learning at university level. Higher Education. 2008, 56: 221-240. 10.1007/s10734-007-9099-8.CrossRef Hay DB, Wells H, Kinchin IM: Quantitative and qualitative measures of student learning at university level. Higher Education. 2008, 56: 221-240. 10.1007/s10734-007-9099-8.CrossRef
25.
go back to reference Powell RR: The influence of prior experiences on pedagogical constructs of traditional and nontraditional preservice teachers. Teaching and Teacher Education. 1992, 8: 225-238. 10.1016/0742-051X(92)90022-U.CrossRef Powell RR: The influence of prior experiences on pedagogical constructs of traditional and nontraditional preservice teachers. Teaching and Teacher Education. 1992, 8: 225-238. 10.1016/0742-051X(92)90022-U.CrossRef
26.
go back to reference Kesby M: Participatory diagramming as a means to improve communication about sex in rural Zimbabwe: a pilot study. Social Science & Medicine. 2000, 50: 1723-1741.CrossRef Kesby M: Participatory diagramming as a means to improve communication about sex in rural Zimbabwe: a pilot study. Social Science & Medicine. 2000, 50: 1723-1741.CrossRef
27.
go back to reference Van der Riet M: Diagramming as mediational means: Vygotskian theory and participatory research. South African Journal of Psychology. 2008, 38: 455-465.CrossRef Van der Riet M: Diagramming as mediational means: Vygotskian theory and participatory research. South African Journal of Psychology. 2008, 38: 455-465.CrossRef
28.
go back to reference Wheeldon J: Is a picture worth a thousand words? Using mind maps to facilitate participant recall in qualitative research. Qualitative Report. Wheeldon J: Is a picture worth a thousand words? Using mind maps to facilitate participant recall in qualitative research. Qualitative Report.
29.
go back to reference Bagnoli A: Beyond the standard interview: The use of graphic elicitation and arts-based methods. Qualitative Research. 2009, 9: 547-571. 10.1177/1468794109343625.CrossRef Bagnoli A: Beyond the standard interview: The use of graphic elicitation and arts-based methods. Qualitative Research. 2009, 9: 547-571. 10.1177/1468794109343625.CrossRef
30.
go back to reference Lim SE, Chan Cheng PW, Lam MS, Ngan SF: Developing reflective and thinking skills by means of semantic mapping strategies in kindergarten teacher education. Early Child Development and Care. 2003, 173 (1): 55-72. 10.1080/0300443022000022422.CrossRef Lim SE, Chan Cheng PW, Lam MS, Ngan SF: Developing reflective and thinking skills by means of semantic mapping strategies in kindergarten teacher education. Early Child Development and Care. 2003, 173 (1): 55-72. 10.1080/0300443022000022422.CrossRef
31.
go back to reference Ozesmi U, Ozesmi SL: Ecological models based on people's knowledge: A multi-step fuzzy cognitive mapping approach. Ecological Modeling. 2004, 176: 43-64. 10.1016/j.ecolmodel.2003.10.027.CrossRef Ozesmi U, Ozesmi SL: Ecological models based on people's knowledge: A multi-step fuzzy cognitive mapping approach. Ecological Modeling. 2004, 176: 43-64. 10.1016/j.ecolmodel.2003.10.027.CrossRef
32.
go back to reference Varga-Atkins T, O'Brien M: From drawings to diagrams: Maintaining researcher control during graphic elicitation in qualitative interviews. International Journal of Research & Methods in Education. 2009, 32: 53-67.CrossRef Varga-Atkins T, O'Brien M: From drawings to diagrams: Maintaining researcher control during graphic elicitation in qualitative interviews. International Journal of Research & Methods in Education. 2009, 32: 53-67.CrossRef
33.
go back to reference Williams CG: Using concept maps to assess conceptual knowledge of function. Journal for Research in Mathematics Education. 1998, 29: 414-421. 10.2307/749858.CrossRef Williams CG: Using concept maps to assess conceptual knowledge of function. Journal for Research in Mathematics Education. 1998, 29: 414-421. 10.2307/749858.CrossRef
34.
go back to reference Strean WB, Holt NL: Coaches', athletes', and parents' perceptions of fun in youth sports: assumptions about learning and implications for practice. AVANTE. 2000, 6: 83-98. Strean WB, Holt NL: Coaches', athletes', and parents' perceptions of fun in youth sports: assumptions about learning and implications for practice. AVANTE. 2000, 6: 83-98.
35.
go back to reference Wheeldon J: Mapping mixed methods research: Methods, measures, and meaning. Journal of Mixed Methods Research. 2010, 48: 87-102. 10.1177/1558689809358755.CrossRef Wheeldon J: Mapping mixed methods research: Methods, measures, and meaning. Journal of Mixed Methods Research. 2010, 48: 87-102. 10.1177/1558689809358755.CrossRef
36.
go back to reference Rye JA, Rubba PA: An exploration of the concept map as an interview tool to facilitate the externalization of students' understandings about global atmospheric change. Journal of Research in Science Teaching. 1998, 35: 521-546. 10.1002/(SICI)1098-2736(199805)35:5<521::AID-TEA4>3.0.CO;2-R.CrossRef Rye JA, Rubba PA: An exploration of the concept map as an interview tool to facilitate the externalization of students' understandings about global atmospheric change. Journal of Research in Science Teaching. 1998, 35: 521-546. 10.1002/(SICI)1098-2736(199805)35:5<521::AID-TEA4>3.0.CO;2-R.CrossRef
37.
go back to reference Lourdel N, Gondran N, Laforest V, Debray B, Brodhag C: Sustainable development cognitive map: A new method of evaluating student understanding. International Journal of Sustainability in Higher Education. 2007, 8: 170-182. 10.1108/14676370710726634.CrossRef Lourdel N, Gondran N, Laforest V, Debray B, Brodhag C: Sustainable development cognitive map: A new method of evaluating student understanding. International Journal of Sustainability in Higher Education. 2007, 8: 170-182. 10.1108/14676370710726634.CrossRef
38.
go back to reference Koul R, Clariana RB, Salehi R: Comparing several human and computer-based methods for scoring concept maps and essays. Journal of Educational Computing Research. 2005, 32: 227-239. 10.2190/5X9Y-0ETN-213U-8FV7.CrossRef Koul R, Clariana RB, Salehi R: Comparing several human and computer-based methods for scoring concept maps and essays. Journal of Educational Computing Research. 2005, 32: 227-239. 10.2190/5X9Y-0ETN-213U-8FV7.CrossRef
39.
go back to reference Shymansky JA, Yore LD, Treagust DF, Thiele RB, Harrison A, Waldrip BG, et al: Examining the construction process: A study of changes in level 10 students' understanding of classical mechanics. Journal of Research in Science Teaching. 1997, 34: 571-593. 10.1002/(SICI)1098-2736(199708)34:6<571::AID-TEA3>3.0.CO;2-K.CrossRef Shymansky JA, Yore LD, Treagust DF, Thiele RB, Harrison A, Waldrip BG, et al: Examining the construction process: A study of changes in level 10 students' understanding of classical mechanics. Journal of Research in Science Teaching. 1997, 34: 571-593. 10.1002/(SICI)1098-2736(199708)34:6<571::AID-TEA3>3.0.CO;2-K.CrossRef
40.
go back to reference West DC, Pomeroy JR, Park JK, Gerstenberger EA, Sandoval J: Critical thinking in graduate medical education: A role for concept mapping assessment?. Journal of the American Medical Association. 2000, 284: 1105-1110. 10.1001/jama.284.9.1105.CrossRefPubMed West DC, Pomeroy JR, Park JK, Gerstenberger EA, Sandoval J: Critical thinking in graduate medical education: A role for concept mapping assessment?. Journal of the American Medical Association. 2000, 284: 1105-1110. 10.1001/jama.284.9.1105.CrossRefPubMed
41.
go back to reference Lian MWS: An investigation into high-achiever and low-achiever knowledge organisation and knowledge processing in concept mapping: A case study. Research in Science Education. 1998, 28: 337-352. 10.1007/BF02461567.CrossRef Lian MWS: An investigation into high-achiever and low-achiever knowledge organisation and knowledge processing in concept mapping: A case study. Research in Science Education. 1998, 28: 337-352. 10.1007/BF02461567.CrossRef
42.
go back to reference Crilly N, Clarkson P, Blackwell A: Using research diagrams for member validation in qualitative research. Diagrams. 2006, 4045: 258-262. Crilly N, Clarkson P, Blackwell A: Using research diagrams for member validation in qualitative research. Diagrams. 2006, 4045: 258-262.
43.
go back to reference Cox P, Niewoehner J, Pidgeon N, Gerrard S, Fischhoff B, Riley D: The use of mental models in chemical risk protection: Developing a generic workplace methodology. Risk Analysis. 2003, 23: 311-324. 10.1111/1539-6924.00311.CrossRefPubMed Cox P, Niewoehner J, Pidgeon N, Gerrard S, Fischhoff B, Riley D: The use of mental models in chemical risk protection: Developing a generic workplace methodology. Risk Analysis. 2003, 23: 311-324. 10.1111/1539-6924.00311.CrossRefPubMed
44.
go back to reference Koury K, Hollingsead C, Fitzgerald G, Miller K, Mitchem K, Tsai HH, et al: Case-based instruction in different delivery contexts: The impact of time in cases. Journal of Interactive Learning Research. 2009, 20: 445-467. Koury K, Hollingsead C, Fitzgerald G, Miller K, Mitchem K, Tsai HH, et al: Case-based instruction in different delivery contexts: The impact of time in cases. Journal of Interactive Learning Research. 2009, 20: 445-467.
45.
go back to reference Gill PE, Persson M: On using concept-maps to study school-children's understanding of leisure-time. Leisure Studies. 2008, 27: 213-220. 10.1080/02614360802048795.CrossRef Gill PE, Persson M: On using concept-maps to study school-children's understanding of leisure-time. Leisure Studies. 2008, 27: 213-220. 10.1080/02614360802048795.CrossRef
46.
go back to reference Wheeldon J: To guide or provoke? Maps, pedagogy, and the value(s) of teaching criminal justice ethics. Criminal Justice Education. Wheeldon J: To guide or provoke? Maps, pedagogy, and the value(s) of teaching criminal justice ethics. Criminal Justice Education.
47.
go back to reference Mouratiadou I, Moran D: Mapping public participation in the Water Framework Directive: A case study of the Pinios River Basin, Greece. Ecological Economics. 2007, 62: 66-76. 10.1016/j.ecolecon.2007.01.009.CrossRef Mouratiadou I, Moran D: Mapping public participation in the Water Framework Directive: A case study of the Pinios River Basin, Greece. Ecological Economics. 2007, 62: 66-76. 10.1016/j.ecolecon.2007.01.009.CrossRef
48.
go back to reference Kimber K, Pillay H, Richards C: Technoliteracy and learning: An analysis of the quality of knowledge in electronic representations of understanding. Computers & Education. 2007, 48: 59-79.CrossRef Kimber K, Pillay H, Richards C: Technoliteracy and learning: An analysis of the quality of knowledge in electronic representations of understanding. Computers & Education. 2007, 48: 59-79.CrossRef
49.
go back to reference Artiles AJ, Barreto RM, Pena L, McClafferty K: Pathways to teacher learning in multicultural contexts - A longitudinal case study of two novice bilingual teachers in urban schools. Remedial and Special Education. 1998, 19: 70-90. 10.1177/074193259801900203.CrossRef Artiles AJ, Barreto RM, Pena L, McClafferty K: Pathways to teacher learning in multicultural contexts - A longitudinal case study of two novice bilingual teachers in urban schools. Remedial and Special Education. 1998, 19: 70-90. 10.1177/074193259801900203.CrossRef
50.
go back to reference Farrell TSC: Critical reflection in a TESL Course: Mapping conceptual change. ELT Journal. 2008, 63: 221-229. 10.1093/elt/ccn058.CrossRef Farrell TSC: Critical reflection in a TESL Course: Mapping conceptual change. ELT Journal. 2008, 63: 221-229. 10.1093/elt/ccn058.CrossRef
51.
go back to reference Lourdel N, Gondran N, Laforest V, Brodhag C: Introduction of sustainable development in engineers' curricula: Problematic and evaluation methods. International Journal of Sustainability in Higher Education. 2005, 6: 254-264. 10.1108/14676370510607223.CrossRef Lourdel N, Gondran N, Laforest V, Brodhag C: Introduction of sustainable development in engineers' curricula: Problematic and evaluation methods. International Journal of Sustainability in Higher Education. 2005, 6: 254-264. 10.1108/14676370510607223.CrossRef
52.
go back to reference Naykki P, Jarvela S: How pictorial knowledge representations mediate collaborative knowledge construction in groups. Journal of Research on Technology in Education. 2008, 40: 359-CrossRef Naykki P, Jarvela S: How pictorial knowledge representations mediate collaborative knowledge construction in groups. Journal of Research on Technology in Education. 2008, 40: 359-CrossRef
53.
go back to reference Conceicao SC, Taylor LD: Using a constructivist approach with online concept maps: relationship between theory and nursing education. Nursing Education Perspectives. 2007, 28: 268-275.PubMed Conceicao SC, Taylor LD: Using a constructivist approach with online concept maps: relationship between theory and nursing education. Nursing Education Perspectives. 2007, 28: 268-275.PubMed
54.
go back to reference Kesby M: Participatory diagramming: Deploying qualitative methods through an action research epistemology. Area. 2000, 32: 423-435. 10.1111/j.1475-4762.2000.tb00158.x.CrossRef Kesby M: Participatory diagramming: Deploying qualitative methods through an action research epistemology. Area. 2000, 32: 423-435. 10.1111/j.1475-4762.2000.tb00158.x.CrossRef
55.
go back to reference Ahmed R, Ali NA: Performance appraisal decision in Malaysian public service. International Journal of Public Sector Management. 17: 48-64. 10.1108/09513550410515565. 4 A.D Ahmed R, Ali NA: Performance appraisal decision in Malaysian public service. International Journal of Public Sector Management. 17: 48-64. 10.1108/09513550410515565. 4 A.D
56.
go back to reference Cole C, Lin Y, Leide J, Large A, Beheshti J: A classification of mental models of undergraduates seeking information for a course essay in history and psychology: preliminary investigations into aligning their mental models with online thesauri. Journal of the American Society for Information Science & Technology. 2007, 58: 2092-2104.CrossRef Cole C, Lin Y, Leide J, Large A, Beheshti J: A classification of mental models of undergraduates seeking information for a course essay in history and psychology: preliminary investigations into aligning their mental models with online thesauri. Journal of the American Society for Information Science & Technology. 2007, 58: 2092-2104.CrossRef
57.
go back to reference Rowe AL, Cooke NJ: Measuring mental models: Choosing the right tools for the job. Human Resources Development Quarterly. 1995, 6: 243-255. 10.1002/hrdq.3920060303.CrossRef Rowe AL, Cooke NJ: Measuring mental models: Choosing the right tools for the job. Human Resources Development Quarterly. 1995, 6: 243-255. 10.1002/hrdq.3920060303.CrossRef
58.
go back to reference Wheeldon J: Learning from Latvia: Adoption, adaptation, and evidence based justice reform. Journal of Baltic Studies. Wheeldon J: Learning from Latvia: Adoption, adaptation, and evidence based justice reform. Journal of Baltic Studies.
59.
go back to reference Garegae KGM: . Teachers, beliefs about mathematics, its teaching and learning and the communication of these beliefs to students: A case study in Botswana. Ph.D. 2002, Canada: The University of Manitoba Garegae KGM: . Teachers, beliefs about mathematics, its teaching and learning and the communication of these beliefs to students: A case study in Botswana. Ph.D. 2002, Canada: The University of Manitoba
60.
go back to reference McWhirter LJ: Conceptual development and retention within the learning cycle. Ph.D. 1998, United States -- Oklahoma: The University of Oklahoma McWhirter LJ: Conceptual development and retention within the learning cycle. Ph.D. 1998, United States -- Oklahoma: The University of Oklahoma
61.
go back to reference Williams CG: . Using concepts maps to determine differences in the concept image of function held by students in reform and traditional calculus classes. Ph.D. 1994, United States -- California: University of California Williams CG: . Using concepts maps to determine differences in the concept image of function held by students in reform and traditional calculus classes. Ph.D. 1994, United States -- California: University of California
62.
go back to reference Puukari S: . Video programmes as learning tools: Teaching the gas laws and behaviour of gases in Finnish and Canadian senior high schools. Ed.D. 2003, Finland: Jyvaskylan Yliopisto Puukari S: . Video programmes as learning tools: Teaching the gas laws and behaviour of gases in Finnish and Canadian senior high schools. Ed.D. 2003, Finland: Jyvaskylan Yliopisto
63.
go back to reference Mathews S: An ethnographic examination of perspective consciousness and intercultural competence among social studies student-teachers in Kenya, East Africa. Ph.D. 2008, United States -- Indiana: Indiana University Mathews S: An ethnographic examination of perspective consciousness and intercultural competence among social studies student-teachers in Kenya, East Africa. Ph.D. 2008, United States -- Indiana: Indiana University
64.
go back to reference Skidmore L: Concept mapping to promote meaningful learning at the community college level. 2008, United States -- Minnesota: Walden University, Ed.D Skidmore L: Concept mapping to promote meaningful learning at the community college level. 2008, United States -- Minnesota: Walden University, Ed.D
65.
go back to reference Yin Y, Vanides J, Ruiz-Primo MA, Ayala CC, Shavelson R: A Comparison of Two Construct-a-Concept-Map Science Assessments: Created Linking Phrases and Selected Linking Phrases. 2004, The Regents of the University of California, 1-28. unknown CSE Report 624 Yin Y, Vanides J, Ruiz-Primo MA, Ayala CC, Shavelson R: A Comparison of Two Construct-a-Concept-Map Science Assessments: Created Linking Phrases and Selected Linking Phrases. 2004, The Regents of the University of California, 1-28. unknown CSE Report 624
66.
go back to reference Rios JM: Studies of contrast: Relationships between subject matter structures and teaching. 1995, United States -- Wisconsin: The University of Wisconsin, Ph.D Rios JM: Studies of contrast: Relationships between subject matter structures and teaching. 1995, United States -- Wisconsin: The University of Wisconsin, Ph.D
67.
go back to reference Feldsine JE: The construction of concept maps facilitates the learning of general college chemistry: A case study. 1987, United States -- New York: Cornell University, Ph.D Feldsine JE: The construction of concept maps facilitates the learning of general college chemistry: A case study. 1987, United States -- New York: Cornell University, Ph.D
68.
go back to reference Butler KA: Scaffolding software: How does it influence student conceptual understanding and motivation?. 2004, United States -- Illinois: Southern Illinois University at Carbondale, Ph.D Butler KA: Scaffolding software: How does it influence student conceptual understanding and motivation?. 2004, United States -- Illinois: Southern Illinois University at Carbondale, Ph.D
69.
go back to reference Alexander LM: Variations of professional identity over time: A study of physician assistants. 2003, United States -- District of Columbia: The George Washington University, Ed.D Alexander LM: Variations of professional identity over time: A study of physician assistants. 2003, United States -- District of Columbia: The George Washington University, Ed.D
70.
go back to reference Cantu DA: A naturalistic investigation of the relationship between secondary social studies teachers' beliefs and practice. 1997, United States -- Illinois: Southern Illinois University at Carbondale, Ph.D Cantu DA: A naturalistic investigation of the relationship between secondary social studies teachers' beliefs and practice. 1997, United States -- Illinois: Southern Illinois University at Carbondale, Ph.D
71.
go back to reference Cozza B: Concept mapping through logs and metacognitive reflection during third graders' scientific problem-solving. 1996, United States -- New York: Fordham University, Ph.D Cozza B: Concept mapping through logs and metacognitive reflection during third graders' scientific problem-solving. 1996, United States -- New York: Fordham University, Ph.D
72.
go back to reference Ballard BG: Preservice teachers' beliefs about classroom management before and after student teaching. 2002, United States -- Nevada: University of Nevada, Las Vegas, Ed.D Ballard BG: Preservice teachers' beliefs about classroom management before and after student teaching. 2002, United States -- Nevada: University of Nevada, Las Vegas, Ed.D
73.
go back to reference Lowe M: Continuing medical education for physicians: Key factors contributing to learning and change. 2007, United States -- Connecticut: University of Connecticut, Ph.D Lowe M: Continuing medical education for physicians: Key factors contributing to learning and change. 2007, United States -- Connecticut: University of Connecticut, Ph.D
74.
go back to reference Yue H: Concept maps as assessment tools in mathematics: Comparison with clinical interviews. 2008, United States -- Texas: The University of Texas at El Paso, MAT Yue H: Concept maps as assessment tools in mathematics: Comparison with clinical interviews. 2008, United States -- Texas: The University of Texas at El Paso, MAT
75.
go back to reference White E: Institutional effectiveness: The integration of program review, strategic planning and budgeting processes in two California community colleges. 2007, Andrews University, Berrien Springs, MI White E: Institutional effectiveness: The integration of program review, strategic planning and budgeting processes in two California community colleges. 2007, Andrews University, Berrien Springs, MI
76.
go back to reference Grunow JEM: Using concept maps in a professional development program to assess and enhance teachers' understanding of rational number. 1998, United States -- Wisconsin: The University of Wisconsin, Ph.D Grunow JEM: Using concept maps in a professional development program to assess and enhance teachers' understanding of rational number. 1998, United States -- Wisconsin: The University of Wisconsin, Ph.D
77.
go back to reference Rowe AL: Mental models of physical systems: Examining the relationship between knowing and doing. 1995, Rice University Rowe AL: Mental models of physical systems: Examining the relationship between knowing and doing. 1995, Rice University
78.
go back to reference Kane M, Trochim WMK: Concept mapping for planning and evaluation. 2007, Thousand Oaks, CA, US: Sage Publications, IncCrossRef Kane M, Trochim WMK: Concept mapping for planning and evaluation. 2007, Thousand Oaks, CA, US: Sage Publications, IncCrossRef
79.
go back to reference Kesby M: Participatory diagramming and the ethical and practical challenges of helping Africans themselves to move HIV work 'beyond epidemiology'. HIV/AIDS in Africa: Beyond Epidemiology. Edited by: Kalipendi E, Craddock S, Oppong J, Ghosh J. 2004, Blackwell, 217-228. Kesby M: Participatory diagramming and the ethical and practical challenges of helping Africans themselves to move HIV work 'beyond epidemiology'. HIV/AIDS in Africa: Beyond Epidemiology. Edited by: Kalipendi E, Craddock S, Oppong J, Ghosh J. 2004, Blackwell, 217-228.
80.
go back to reference Schreiber DA, Abegg GL: Scoring Student-Generated Concept Maps in Introductory College Chemistry. 1991, The National Association for Research in Science Teaching, 1-19. Annual meeting Schreiber DA, Abegg GL: Scoring Student-Generated Concept Maps in Introductory College Chemistry. 1991, The National Association for Research in Science Teaching, 1-19. Annual meeting
81.
go back to reference Williams CG: Concept Maps as Research Tools in Mathematics. 18 April, 1995. 1995, 1-65. Williams CG: Concept Maps as Research Tools in Mathematics. 18 April, 1995. 1995, 1-65.
82.
go back to reference Varga-Atkins T, O'Brien M: Graphic elicitation as a research technique: reflecting on drawings and diagrams as complementary methods. 2008, 1-22. Ref Type: Report Varga-Atkins T, O'Brien M: Graphic elicitation as a research technique: reflecting on drawings and diagrams as complementary methods. 2008, 1-22. Ref Type: Report
83.
go back to reference Emmel N: Participatory Mapping: An innovative sociological method. Toolkit #3. 2008, ESRC National Centre for Research Methods, 1-8. Ref Type: Report Emmel N: Participatory Mapping: An innovative sociological method. Toolkit #3. 2008, ESRC National Centre for Research Methods, 1-8. Ref Type: Report
84.
go back to reference Beyerbach BA: Concept Mapping in Assessing Prospective Teachers' Concept Development. n/a, 1-16. 1986, US Department of Education, Ref Type: Report Beyerbach BA: Concept Mapping in Assessing Prospective Teachers' Concept Development. n/a, 1-16. 1986, US Department of Education, Ref Type: Report
85.
go back to reference Kane M, Trochim WMK: Concept Mapping for Planning and Evaluation. 2007, Thousand Oaks, CA, US: Sage Publications, IncCrossRef Kane M, Trochim WMK: Concept Mapping for Planning and Evaluation. 2007, Thousand Oaks, CA, US: Sage Publications, IncCrossRef
86.
go back to reference Nesbit JC, Adescope O: Learning with concept and knowledge maps: A meta-analysis. Review of Education Research. 2006, 76: 413-448. 10.3102/00346543076003413.CrossRef Nesbit JC, Adescope O: Learning with concept and knowledge maps: A meta-analysis. Review of Education Research. 2006, 76: 413-448. 10.3102/00346543076003413.CrossRef
Metadata
Title
A multidisciplinary systematic review of the use of diagrams as a means of collecting data from research subjects: application, benefits and recommendations
Authors
Muriah J Umoquit
Peggy Tso
Helen ED Burchett
Mark J Dobrow
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-11

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue