Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Care | Research

Developing and testing the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide for primary care providers using think-aloud, near-live, and interview procedures

Authors: Tamara L. Morgan, Jensen Pletch, Emma Faught, Michelle S. Fortier, Mary Kate Gazendam, Kelly Howse, Rahul Jain, Kirstin N. Lane, Kaleigh Maclaren, Taylor McFadden, Jeanette C. Prorok, Zachary J. Weston, Jennifer R. Tomasone

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Canada’s 24-Hour Movement Guidelines for Adults have shifted the focus from considering movement behaviours (i.e., physical activity, sedentary behaviour, and sleep) separately to a 24-h paradigm, which considers how they are integrated. Accordingly, primary care providers (PCPs) have the opportunity to improve their practice to promote all movement behaviours cohesively. However, PCPs have faced barriers to discussing physical activity alone (e.g., time, competing priorities, inadequate training), leading to low frequency of physical activity discussions. Consequently, discussing three movement behaviours may seem challenging. Tools to facilitate primary care discussions about physical activity have been developed and used; however, few have undergone usability testing and none have integrated all movement behaviours. Following a synthesis of physical activity, sedentary behaviour, and sleep tools for PCPs, we developed the Whole Day Matters Tool and User Guide that incorporate all movement behaviours. The present study aimed to explore PCPs’ perceptions on the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide to improve their relevancy among PCPs.

Methods

Twenty-six PCPs were observed and audio–video recorded while using the Tool and User Guide in a think-aloud procedure, then in a near-live encounter with a mock service-user. A debriefing interview using a guide informed by Normalization Process Theory followed. Recordings were transcribed verbatim and analysed using content analysis and a critical friend to enhance rigour.

Results

PCPs valued aspects of the Tool and User Guide including their structure, user-friendliness, visual appeal, and multi-behaviour focus and suggested modifications to improve usability and acceptability. Findings are further discussed in the context of Normalization Process Theory and previous literature.

Conclusions

The Tool and User Guide were revised, including adding plain language, reordering and renaming sections, reducing text, and clarifying instructions. Results also informed the addition of a Preamble and a Handout for adults accessing care (i.e., patients/clients/service-users) to explain the evidence underpinning the 24-Hour Movement Guidelines for Adults and support a person-centered approach. These four resources (i.e., Tool, User Guide, Preamble, Handout) have since undergone a consensus building process to arrive at their final versions before being disseminated into primary care practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Tremblay MS, Ross R. How should we move for health? The case for the 24-hour movement paradigm. Can Med Assoc J. 2020;192(49):E1728–9.CrossRef Tremblay MS, Ross R. How should we move for health? The case for the 24-hour movement paradigm. Can Med Assoc J. 2020;192(49):E1728–9.CrossRef
4.
go back to reference Rosenberger ME, Fulton JE, Buman MP, Troiano RP, Grandner MA, Buchner DM, et al. The 24-hour activity cycle: a new paradigm for physical activity. Med Sci Sports Exerc. 2019;51(3):454–64.PubMedPubMedCentralCrossRef Rosenberger ME, Fulton JE, Buman MP, Troiano RP, Grandner MA, Buchner DM, et al. The 24-hour activity cycle: a new paradigm for physical activity. Med Sci Sports Exerc. 2019;51(3):454–64.PubMedPubMedCentralCrossRef
5.
go back to reference Fowles JR, O’Brien MW, Solmundson K, Oh PI, Shields CA. Exercise is medicine Canada physical activity counselling and exercise prescription training improves counselling, prescription, and referral practices among physicians across Canada. Appl Physiol Nutr Metab. 2018;43(5):535–9.PubMedCrossRef Fowles JR, O’Brien MW, Solmundson K, Oh PI, Shields CA. Exercise is medicine Canada physical activity counselling and exercise prescription training improves counselling, prescription, and referral practices among physicians across Canada. Appl Physiol Nutr Metab. 2018;43(5):535–9.PubMedCrossRef
7.
go back to reference Baillot A, Baillargeon JP, Pare A, Poder TG, Brown C, Langlois MF. Physical activity assessment and counseling in Quebec family medicine groups Évaluation de l ’ activité physique et counseling dans des groupes de médecine de famille au Québec. Can Fam Physician. 2018;64(5):234–41. Baillot A, Baillargeon JP, Pare A, Poder TG, Brown C, Langlois MF. Physical activity assessment and counseling in Quebec family medicine groups Évaluation de l ’ activité physique et counseling dans des groupes de médecine de famille au Québec. Can Fam Physician. 2018;64(5):234–41.
9.
go back to reference Huntington J, Dwyer JJM, Shama S, Brauer P. Registered dietitians’ beliefs and behaviours related to counselling patients on physical activity and sedentary behaviour from a theory of planned behaviour perspective. BMC Nutr. 2020;6(1):1–13.CrossRef Huntington J, Dwyer JJM, Shama S, Brauer P. Registered dietitians’ beliefs and behaviours related to counselling patients on physical activity and sedentary behaviour from a theory of planned behaviour perspective. BMC Nutr. 2020;6(1):1–13.CrossRef
11.
go back to reference Hébert ET, Caughy MO, Shuval K. Primary care providers’ perceptions of physical activity counselling in a clinical setting: a systematic review. Br J Sports Med. 2012;46(9):625–31.PubMedCrossRef Hébert ET, Caughy MO, Shuval K. Primary care providers’ perceptions of physical activity counselling in a clinical setting: a systematic review. Br J Sports Med. 2012;46(9):625–31.PubMedCrossRef
12.
go back to reference Dyas J V, Apekey TA, Tilling M, Ørner R, Middleton H, Siriwardena AN. Patients’ and clinicians’ experiences of consultations in primary care for sleep problems and insomnia: A focus group study. Br J Gen Pract. 2010;60(574):e180–200. https://doi.org/10.3399/bjgp10X484183. Dyas J V, Apekey TA, Tilling M, Ørner R, Middleton H, Siriwardena AN. Patients’ and clinicians’ experiences of consultations in primary care for sleep problems and insomnia: A focus group study. Br J Gen Pract. 2010;60(574):e180–200. https://​doi.​org/​10.​3399/​bjgp10X484183.
14.
go back to reference Huijg JM, Gebhardt WA, Verheijden MW, van der Zouwe N, de Vries JD, Middelkoop BJC, et al. Factors influencing primary health care professionals’ physical activity promotion behaviors: a systematic review. Int J Behav Med. 2015;22(1):32–50.PubMedCrossRef Huijg JM, Gebhardt WA, Verheijden MW, van der Zouwe N, de Vries JD, Middelkoop BJC, et al. Factors influencing primary health care professionals’ physical activity promotion behaviors: a systematic review. Int J Behav Med. 2015;22(1):32–50.PubMedCrossRef
15.
go back to reference Gonzalez-Viana A, ViolanFors M, Castell Abat C, RubinatMasot M, Oliveras L, Garcia-Gil J, et al. Promoting physical activity through primary health care: the case of Catalonia. BMC Public Health. 2018;18(1):1–17.CrossRef Gonzalez-Viana A, ViolanFors M, Castell Abat C, RubinatMasot M, Oliveras L, Garcia-Gil J, et al. Promoting physical activity through primary health care: the case of Catalonia. BMC Public Health. 2018;18(1):1–17.CrossRef
16.
go back to reference Morgan TL, Faught E, Ross-White A, Fortier MS, Duggan M, Jain R, et al. Tools to guide clinical discussions on physical activity, sedentary behaviour, and/or sleep for health promotion between health care providers and individuals who access care: a scoping review. J Med Internet Res Med Informatics. 2022. https://doi.org/10.2196/preprints.39112. Preprint. Morgan TL, Faught E, Ross-White A, Fortier MS, Duggan M, Jain R, et al. Tools to guide clinical discussions on physical activity, sedentary behaviour, and/or sleep for health promotion between health care providers and individuals who access care: a scoping review. J Med Internet Res Med Informatics. 2022. https://​doi.​org/​10.​2196/​preprints.​39112. Preprint.
17.
go back to reference Kastner M, Makarski J, Hayden L, Lai Y, Chan J, Treister V, et al. Improving KT tools and products: development and evaluation of a framework for creating optimized, Knowledge-activated Tools (KaT). Implement Sci Commun. 2020;1(1):1–15.CrossRef Kastner M, Makarski J, Hayden L, Lai Y, Chan J, Treister V, et al. Improving KT tools and products: development and evaluation of a framework for creating optimized, Knowledge-activated Tools (KaT). Implement Sci Commun. 2020;1(1):1–15.CrossRef
19.
go back to reference Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.PubMedCrossRef Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.PubMedCrossRef
20.
go back to reference Tomasone JR, Flood SM, Latimer-Cheung AE, Faulkner G, Duggan ME, Jones R, et al. The knowledge translation process of the Canadian 24-hour movement guidelines for adults aged 18–64 years and adults aged 65 years or older: a proposed framework for guideline knowledge translation. Appl Physiol Nutr Metab. 2020;45(10(Suppl. 2)):S102–24. https://doi.org/10.1139/apnm-2020-0601.CrossRef Tomasone JR, Flood SM, Latimer-Cheung AE, Faulkner G, Duggan ME, Jones R, et al. The knowledge translation process of the Canadian 24-hour movement guidelines for adults aged 18–64 years and adults aged 65 years or older: a proposed framework for guideline knowledge translation. Appl Physiol Nutr Metab. 2020;45(10(Suppl. 2)):S102–24. https://​doi.​org/​10.​1139/​apnm-2020-0601.CrossRef
22.
go back to reference Richardson S, Mishuris R, O’Connell A, Feldstein D, Hess R, Smith P, et al. “Think aloud” and “Near live” usability testing of two complex clinical decision support tools. Int J Med Inform. 2017;106(June):1–8.PubMedPubMedCentralCrossRef Richardson S, Mishuris R, O’Connell A, Feldstein D, Hess R, Smith P, et al. “Think aloud” and “Near live” usability testing of two complex clinical decision support tools. Int J Med Inform. 2017;106(June):1–8.PubMedPubMedCentralCrossRef
24.
go back to reference Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76.CrossRef Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76.CrossRef
25.
go back to reference May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.CrossRef May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.CrossRef
26.
go back to reference May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009;4(1):1–9.CrossRef May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009;4(1):1–9.CrossRef
27.
go back to reference Bueno M, Stevens B, Rao M, Riahi S, Lanese A, et al. Usability, acceptability, and feasibility of the Implementation of Infant Pain Practice Change (ImPaC) Resource. Paediatr Neonatal Pain. 2020;2(3):82–92.PubMedPubMedCentralCrossRef Bueno M, Stevens B, Rao M, Riahi S, Lanese A, et al. Usability, acceptability, and feasibility of the Implementation of Infant Pain Practice Change (ImPaC) Resource. Paediatr Neonatal Pain. 2020;2(3):82–92.PubMedPubMedCentralCrossRef
28.
go back to reference Nguyen T, Graham ID, Mrklas KJ, Bowen S, Cargo M, Estabrooks CA, et al. How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge? Learning from experts in the field. Heal Res Policy Syst. 2020;18(1):1–20. Nguyen T, Graham ID, Mrklas KJ, Bowen S, Cargo M, Estabrooks CA, et al. How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge? Learning from experts in the field. Heal Res Policy Syst. 2020;18(1):1–20.
31.
go back to reference Carroll JK, Antognoli E, Flocke SA. Evaluation of physical activity counseling in primary care using direct observation of the 5As. Ann Fam Med. 2011;9(5):416–22.PubMedPubMedCentralCrossRef Carroll JK, Antognoli E, Flocke SA. Evaluation of physical activity counseling in primary care using direct observation of the 5As. Ann Fam Med. 2011;9(5):416–22.PubMedPubMedCentralCrossRef
32.
go back to reference Miller WR, Rollnick S. Motivational interviewing. 3rd ed. New York, NY: Guilford Press; 2013. Miller WR, Rollnick S. Motivational interviewing. 3rd ed. New York, NY: Guilford Press; 2013.
34.
go back to reference Poucher ZA, Tamminen KA, Caron JG, Sweet SN. Thinking through and designing qualitative research studies: a focused mapping review of 30 years of qualitative research in sport psychology. Int Rev Sport Exerc Psychol. 2020;13(1):163-86. Poucher ZA, Tamminen KA, Caron JG, Sweet SN. Thinking through and designing qualitative research studies: a focused mapping review of 30 years of qualitative research in sport psychology. Int Rev Sport Exerc Psychol. 2020;13(1):163-86.
35.
go back to reference Tamminen KA, Poucher ZA. Research Philosophies. In: Hackfort D, Schinke R, editors. The Routledge International Encyclopedia of Sport and Exercise Psychology. 2020. Tamminen KA, Poucher ZA. Research Philosophies. In: Hackfort D, Schinke R, editors. The Routledge International Encyclopedia of Sport and Exercise Psychology. 2020.
36.
go back to reference O’Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245–51.PubMedCrossRef O’Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245–51.PubMedCrossRef
37.
go back to reference Lobelo F, de Quevedo IG. The evidence in support of physicians and health care providers as physical activity role models. Am J Lifestyle Med. 2016;10(1):36–52.PubMedCrossRef Lobelo F, de Quevedo IG. The evidence in support of physicians and health care providers as physical activity role models. Am J Lifestyle Med. 2016;10(1):36–52.PubMedCrossRef
38.
go back to reference Tulloch H, Fortier M, Hogg W. Physical activity counseling in primary care: Who has and who should be counseling? Patient Educ Couns. 2006;64(1–3):6–20.PubMedCrossRef Tulloch H, Fortier M, Hogg W. Physical activity counseling in primary care: Who has and who should be counseling? Patient Educ Couns. 2006;64(1–3):6–20.PubMedCrossRef
41.
go back to reference Kates N, McPherson-Doe C, George L. Integrating mental health services within primary care settings: The Hamilton family health team. J Ambul Care Manage. 2011;34(2):174–82.PubMedCrossRef Kates N, McPherson-Doe C, George L. Integrating mental health services within primary care settings: The Hamilton family health team. J Ambul Care Manage. 2011;34(2):174–82.PubMedCrossRef
43.
go back to reference TechSmith Corporation. Camtasia [Windows]. TechSmith Corporation; 2021. TechSmith Corporation. Camtasia [Windows]. TechSmith Corporation; 2021.
46.
go back to reference Chai WJ, Abd Hamid AI, Abdullah JM. Working memory from the psychological and neurosciences perspectives: a review. Front Psychol. 2018;9(March):1–16. Chai WJ, Abd Hamid AI, Abdullah JM. Working memory from the psychological and neurosciences perspectives: a review. Front Psychol. 2018;9(March):1–16.
47.
go back to reference Lundgrén-Laine H, Salanterä S. Think-aloud technique and protocol analysis in clinical decision-making research. Qual Health Res. 2010;20(4):565–75.PubMedCrossRef Lundgrén-Laine H, Salanterä S. Think-aloud technique and protocol analysis in clinical decision-making research. Qual Health Res. 2010;20(4):565–75.PubMedCrossRef
48.
go back to reference QSR International Ltd. NVivo (released in March 2020) [Windows]. QSR International Ltd.; 2020. QSR International Ltd. NVivo (released in March 2020) [Windows]. QSR International Ltd.; 2020.
49.
51.
52.
go back to reference Forsetlund L, O’Brien MA, Forsén L, Reinar LM, Okwen MP, Horsley T, et al. Continuing education meetings and workshops: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2021;2021(9):CD003030.PubMedCentral Forsetlund L, O’Brien MA, Forsén L, Reinar LM, Okwen MP, Horsley T, et al. Continuing education meetings and workshops: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2021;2021(9):CD003030.PubMedCentral
53.
go back to reference Scalia P, Elwyn G, Durand MA. Provoking conversations”: Case studies of organizations where Option Grid™ decision aids have become ‘normalized. BMC Med Inform Decis Mak. 2017;17(1):1–10.CrossRef Scalia P, Elwyn G, Durand MA. Provoking conversations”: Case studies of organizations where Option Grid™ decision aids have become ‘normalized. BMC Med Inform Decis Mak. 2017;17(1):1–10.CrossRef
55.
go back to reference Miech EJ, Rattray NA, Flanagan ME, Damschroder L, Schmid AA, Damush TM. Inside help: an integrative review of champions in healthcare-related implementation. SAGE Open Med. 2018;6:205031211877326.CrossRef Miech EJ, Rattray NA, Flanagan ME, Damschroder L, Schmid AA, Damush TM. Inside help: an integrative review of champions in healthcare-related implementation. SAGE Open Med. 2018;6:205031211877326.CrossRef
56.
go back to reference Osunlana AM, Asselin J, Anderson R, Ogunleye AA, Cave A, Sharma AM, et al. 5As Team obesity intervention in primary care: development and evaluation of shared decision-making weight management tools. Clin Obes. 2015;5(4):219–25.PubMedPubMedCentralCrossRef Osunlana AM, Asselin J, Anderson R, Ogunleye AA, Cave A, Sharma AM, et al. 5As Team obesity intervention in primary care: development and evaluation of shared decision-making weight management tools. Clin Obes. 2015;5(4):219–25.PubMedPubMedCentralCrossRef
57.
go back to reference Ogunleye A, Osunlana A, Asselin J, Cave A, Sharma AM, Campbell-Scherer DL. The 5As team intervention: bridging the knowledge gap in obesity management among primary care practitioners. BMC Res Notes. 2015;8(1):1–13.CrossRef Ogunleye A, Osunlana A, Asselin J, Cave A, Sharma AM, Campbell-Scherer DL. The 5As team intervention: bridging the knowledge gap in obesity management among primary care practitioners. BMC Res Notes. 2015;8(1):1–13.CrossRef
59.
go back to reference Morgan TL, Suart TN, Fortier MS, Tomasone JR. Moving toward co-production: Five ways to get a grip on collaborative implementation of Movement Behaviour curricula in undergraduate medical education. Can Med Educ J. 2022;13:87–100.PubMedPubMedCentral Morgan TL, Suart TN, Fortier MS, Tomasone JR. Moving toward co-production: Five ways to get a grip on collaborative implementation of Movement Behaviour curricula in undergraduate medical education. Can Med Educ J. 2022;13:87–100.PubMedPubMedCentral
61.
go back to reference Sniehotta FF. Towards a theory of intentional behaviour change: Plans, planning, and self-regulation. Br J Health Psychol. 2009;14(2):261–73.PubMedCrossRef Sniehotta FF. Towards a theory of intentional behaviour change: Plans, planning, and self-regulation. Br J Health Psychol. 2009;14(2):261–73.PubMedCrossRef
63.
go back to reference Miller WR, Moyers TB. Eight stages in learning motivational interviewing. J Teach Addict. 2006;5(1):3–17.CrossRef Miller WR, Moyers TB. Eight stages in learning motivational interviewing. J Teach Addict. 2006;5(1):3–17.CrossRef
64.
go back to reference Martin-Misener R, Wong ST, Johnston S, Blackman S, Scott C, Hogg W, et al. Regional variation in primary care improvement strategies and policy: Case studies that consider qualitative contextual data for performance measurement in three Canadian provinces. BMJ Open. 2019;9(10):1–11.CrossRef Martin-Misener R, Wong ST, Johnston S, Blackman S, Scott C, Hogg W, et al. Regional variation in primary care improvement strategies and policy: Case studies that consider qualitative contextual data for performance measurement in three Canadian provinces. BMJ Open. 2019;9(10):1–11.CrossRef
65.
go back to reference Lucini D, Pagani M. Exercise prescription to foster health and well-being: a behavioral approach to transform barriers into opportunities. Int J Environ Res Public Health. 2021;18(3):1–22.CrossRef Lucini D, Pagani M. Exercise prescription to foster health and well-being: a behavioral approach to transform barriers into opportunities. Int J Environ Res Public Health. 2021;18(3):1–22.CrossRef
67.
go back to reference Tracy SJ. Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qual Inq. 2010;16(10):837–51.CrossRef Tracy SJ. Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qual Inq. 2010;16(10):837–51.CrossRef
Metadata
Title
Developing and testing the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide for primary care providers using think-aloud, near-live, and interview procedures
Authors
Tamara L. Morgan
Jensen Pletch
Emma Faught
Michelle S. Fortier
Mary Kate Gazendam
Kelly Howse
Rahul Jain
Kirstin N. Lane
Kaleigh Maclaren
Taylor McFadden
Jeanette C. Prorok
Zachary J. Weston
Jennifer R. Tomasone
Publication date
01-12-2023
Publisher
BioMed Central
Keyword
Care
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02147-x

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue