Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Research article

A qualitative approach to guide choices for designing a diary study

Authors: Karin A. M. Janssens, Elisabeth H. Bos, Judith G. M. Rosmalen, Marieke C. Wichers, Harriëtte Riese

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Electronic diaries are increasingly used in diverse disciplines to collect momentary data on experienced feelings, cognitions, behavior and social context in real life situations. Choices to be made for an effective and feasible design are however a challenge. Careful and detailed documentation of argumentation of choosing a particular design, as well as general guidelines on how to design such studies are largely lacking in scientific papers. This qualitative study provides a systematic overview of arguments for choosing a specific diary study design (e.g. time frame) in order to optimize future design decisions.

Methods

During the first data assessment round, 47 researchers experienced in diary research from twelve different countries participated. They gave a description of and arguments for choosing their diary design (i.e., study duration, measurement frequency, random or fixed assessment, momentary or retrospective assessment, allowed delay to respond to the beep). During the second round, 38 participants (81%) rated the importance of the different themes identified during the first assessment round for the different diary design topics.

Results

The rationales for diary design choices reported during the first round were mostly strongly related to the research question. The rationales were categorized into four overarching themes: nature of the variables, reliability, feasibility, and statistics. During the second round, all overarching themes were considered important for all diary design topics.

Conclusions

We conclude that no golden standard for the optimal design of a diary study exists since the design depends heavily upon the research question of the study. The findings of the current study are helpful to explicate and guide the specific choices that have to be made when designing a diary study.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kimhy D, Myin-Germeys I, Palmier-Claus J, Swendsen J. Mobile assessment guide for research in schizophrenia and severe mental disorders. Schizophr Bull. 2012;38:386–95.CrossRef Kimhy D, Myin-Germeys I, Palmier-Claus J, Swendsen J. Mobile assessment guide for research in schizophrenia and severe mental disorders. Schizophr Bull. 2012;38:386–95.CrossRef
2.
go back to reference Wichers M, Groot PC, Psychosystems EWS Group ESMG. Critical slowing down as a personalized early warning signal for depression. Psychother Psychosom. 2016;85:114–6.CrossRef Wichers M, Groot PC, Psychosystems EWS Group ESMG. Critical slowing down as a personalized early warning signal for depression. Psychother Psychosom. 2016;85:114–6.CrossRef
3.
go back to reference Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.CrossRef Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.CrossRef
4.
go back to reference Conner TS, Lehman BJ. Getting started. Launching a study in daily life. In: Mehl MR, Conner TS, editors. Handbook of research methods for studying daily life. vol. 2 first. New York: The Guiloford Press; 2012. p. 89–1067. Conner TS, Lehman BJ. Getting started. Launching a study in daily life. In: Mehl MR, Conner TS, editors. Handbook of research methods for studying daily life. vol. 2 first. New York: The Guiloford Press; 2012. p. 89–1067.
5.
go back to reference Delespaul PEAG. Technical note: devices and sampling procedures. In: Delespaul PEAG, editor. Assessing schizophrenia in daily life; vol. 4 first. Maastricht: IPSER Foundation; 1995. p. 83–102. Delespaul PEAG. Technical note: devices and sampling procedures. In: Delespaul PEAG, editor. Assessing schizophrenia in daily life; vol. 4 first. Maastricht: IPSER Foundation; 1995. p. 83–102.
6.
go back to reference Palmier-Claus JE, Myin-Germeys I, Barkus E, Bentley L, Udachina A, Delespaul PA, et al. Experience sampling research in individuals with mental illness: reflections and guidance. Acta Psychiatr Scand. 2011;123:12–20.CrossRef Palmier-Claus JE, Myin-Germeys I, Barkus E, Bentley L, Udachina A, Delespaul PA, et al. Experience sampling research in individuals with mental illness: reflections and guidance. Acta Psychiatr Scand. 2011;123:12–20.CrossRef
7.
go back to reference Smyth J, Wonderlich S, Crosby R, Miltenberg R, Mitchell J, Rorty M. The use of ecological momentary assessment approaches in eating disorder research. Int J Eat Disord. 2001;30:83–95.CrossRef Smyth J, Wonderlich S, Crosby R, Miltenberg R, Mitchell J, Rorty M. The use of ecological momentary assessment approaches in eating disorder research. Int J Eat Disord. 2001;30:83–95.CrossRef
8.
go back to reference Stone AA, Shiffman S. Capturing momentary, self-report data: a proposal for reporting guidelines. Ann Behav Med. 2002;24:236–43.CrossRef Stone AA, Shiffman S. Capturing momentary, self-report data: a proposal for reporting guidelines. Ann Behav Med. 2002;24:236–43.CrossRef
9.
go back to reference Liao Y, Skelton K, Dunton G, Bruening M. A systematic review of methods and procedures used in ecological momentary assessments of diet and physical activity research in youth: an adapted STROBE checklist for reporting EMA studies (CREMAS). J Med Internet Res. 2016;18:e151.CrossRef Liao Y, Skelton K, Dunton G, Bruening M. A systematic review of methods and procedures used in ecological momentary assessments of diet and physical activity research in youth: an adapted STROBE checklist for reporting EMA studies (CREMAS). J Med Internet Res. 2016;18:e151.CrossRef
11.
go back to reference Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41:376–82.CrossRef Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41:376–82.CrossRef
12.
go back to reference Csikszentmihalyi M, Larson R. Validity and reliability of the experience-sampling method. J Nerv Ment Dis. 1987;175:526–36.CrossRef Csikszentmihalyi M, Larson R. Validity and reliability of the experience-sampling method. J Nerv Ment Dis. 1987;175:526–36.CrossRef
13.
go back to reference Hektner JM, Schmidt JA, Csikszentmihalyi M. Experience sampling method: measuring the quality of everyday life. Vol. first. Thousand Oaks: SAGE Publications; 2006. Hektner JM, Schmidt JA, Csikszentmihalyi M. Experience sampling method: measuring the quality of everyday life. Vol. first. Thousand Oaks: SAGE Publications; 2006.
14.
go back to reference Jacobs N, van Os J, Derom C, Thiery E, Delespaul P, Wichers M. Neuroticism explained? From a non-informative vulnerability marker to informative person-context interactions in the realm of daily life. Br J Clin Psychol. 2011;50:19–32.CrossRef Jacobs N, van Os J, Derom C, Thiery E, Delespaul P, Wichers M. Neuroticism explained? From a non-informative vulnerability marker to informative person-context interactions in the realm of daily life. Br J Clin Psychol. 2011;50:19–32.CrossRef
15.
go back to reference Lütkepohl H. New introduction to multiple time series analysis. New York: Springer; 2007. Lütkepohl H. New introduction to multiple time series analysis. New York: Springer; 2007.
16.
go back to reference Tudor-Locke C, Burkett L, Reis JP, Ainsworth BE, Macera CA, Wilson DK. How many days of pedometer monitoring predict weekly physical activity in adults? Prev Med (Baltim). 2005;40:293–8.CrossRef Tudor-Locke C, Burkett L, Reis JP, Ainsworth BE, Macera CA, Wilson DK. How many days of pedometer monitoring predict weekly physical activity in adults? Prev Med (Baltim). 2005;40:293–8.CrossRef
17.
go back to reference Wichers MC, Myin-Germeys I, Jacobs N, Peeters F, Kenis G, Derom C, et al. Evidence that moment-to-moment variation in positive emotions buffer genetic risk for depression: a momentary assessment twin study. Acta Psychiatr Scand. 2007;115:451–7.CrossRef Wichers MC, Myin-Germeys I, Jacobs N, Peeters F, Kenis G, Derom C, et al. Evidence that moment-to-moment variation in positive emotions buffer genetic risk for depression: a momentary assessment twin study. Acta Psychiatr Scand. 2007;115:451–7.CrossRef
18.
go back to reference Ebner-Priemer UW, Sawitzki G. Ambulatory assessment of affective instability in borderline personality disorder. Eur J Psychol Assess. 2007;23:238–47.CrossRef Ebner-Priemer UW, Sawitzki G. Ambulatory assessment of affective instability in borderline personality disorder. Eur J Psychol Assess. 2007;23:238–47.CrossRef
19.
go back to reference Lightman SL, Conway-Campbell BL. The crucial role of pulsatile activity of the HPA axis for continuous dynamic equilibration. Nat Rev. 2010;11:710–8.CrossRef Lightman SL, Conway-Campbell BL. The crucial role of pulsatile activity of the HPA axis for continuous dynamic equilibration. Nat Rev. 2010;11:710–8.CrossRef
20.
go back to reference Stone AA, Broderick JE, Shiffman SS, Schwartz JE. Understanding recall of weekly pain from a momentary assessment perspective: absolute agreement, between- and within-person consistency, and judged change in weekly pain. Pain. 2004;107:61–9.CrossRef Stone AA, Broderick JE, Shiffman SS, Schwartz JE. Understanding recall of weekly pain from a momentary assessment perspective: absolute agreement, between- and within-person consistency, and judged change in weekly pain. Pain. 2004;107:61–9.CrossRef
21.
go back to reference van den Brink M, Bandell-Hoekstra EN, Abu-Saad HH. The occurrence of recall bias in pediatric headache: a comparison of questionnaire and diary data. Headache. 2001;41:11–20.CrossRef van den Brink M, Bandell-Hoekstra EN, Abu-Saad HH. The occurrence of recall bias in pediatric headache: a comparison of questionnaire and diary data. Headache. 2001;41:11–20.CrossRef
22.
go back to reference Houtveen JH, Oei NY. Recall bias in reporting medically unexplained symptoms comes from semantic memory. J Psychosom Res. 2007;62:277–82.CrossRef Houtveen JH, Oei NY. Recall bias in reporting medically unexplained symptoms comes from semantic memory. J Psychosom Res. 2007;62:277–82.CrossRef
24.
go back to reference Chan SW, Goodwin GM, Harmer CJ. Highly neurotic never-depressed students have negative biases in information processing. Psychol Med. 2007;37:1281–91.CrossRef Chan SW, Goodwin GM, Harmer CJ. Highly neurotic never-depressed students have negative biases in information processing. Psychol Med. 2007;37:1281–91.CrossRef
25.
go back to reference Ben-Zeev D, Young MA. Accuracy of hospitalized depressed patients’ and healthy controls’ retrospective symptom reports: an experience sampling study. J Nerv Ment Dis. 2010;198:280–5.CrossRef Ben-Zeev D, Young MA. Accuracy of hospitalized depressed patients’ and healthy controls’ retrospective symptom reports: an experience sampling study. J Nerv Ment Dis. 2010;198:280–5.CrossRef
26.
go back to reference Broderick JE, Schwartz JE, Vikingstad G, Pribbernow M, Grossman S, Stone AA. The accuracy of pain and fatigue items across different reporting periods. Pain. 2008;139:146–57.CrossRef Broderick JE, Schwartz JE, Vikingstad G, Pribbernow M, Grossman S, Stone AA. The accuracy of pain and fatigue items across different reporting periods. Pain. 2008;139:146–57.CrossRef
27.
go back to reference Johnson EI, Grondin O, Barrault M, Faytout M, Helbig S, Husky M, et al. Computerized ambulatory monitoring in psychiatry: a multi-site collaborative study of acceptability, compliance, and reactivity. Int J Methods Psychiatr Res. 2009;18:48–57.CrossRef Johnson EI, Grondin O, Barrault M, Faytout M, Helbig S, Husky M, et al. Computerized ambulatory monitoring in psychiatry: a multi-site collaborative study of acceptability, compliance, and reactivity. Int J Methods Psychiatr Res. 2009;18:48–57.CrossRef
28.
go back to reference Bolger N, Davis A, Rafaeli E. Diary methods: capturing life as it is lived. Annu Rev Psychol. 2003;54:579–616.CrossRef Bolger N, Davis A, Rafaeli E. Diary methods: capturing life as it is lived. Annu Rev Psychol. 2003;54:579–616.CrossRef
29.
go back to reference Santangelo P, Reinhard I, Mussgay L, Steil R, Sawitzki G, Klein C, et al. Specificity of affective instability in patients with borderline personality disorder compared to posttraumatic stress disorder, bulimia nervosa, and healthy controls. J Abnorm Psychol. 2014;123:258–72.CrossRef Santangelo P, Reinhard I, Mussgay L, Steil R, Sawitzki G, Klein C, et al. Specificity of affective instability in patients with borderline personality disorder compared to posttraumatic stress disorder, bulimia nervosa, and healthy controls. J Abnorm Psychol. 2014;123:258–72.CrossRef
Metadata
Title
A qualitative approach to guide choices for designing a diary study
Authors
Karin A. M. Janssens
Elisabeth H. Bos
Judith G. M. Rosmalen
Marieke C. Wichers
Harriëtte Riese
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0579-6

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue