Skip to main content
Top
Published in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 6/2019

01-06-2019 | Reports of Original Investigations

The evaluation of smartphone versions of the visual analogue scale and numeric rating scale as postoperative pain assessment tools: a prospective randomized trial

Authors: Lily Y. L. Chiu, MD, Terri Sun, MD, Ronald Ree, MD, FRCPC, Dustin Dunsmuir, MSc, Alexander Dotto, MD, J. Mark Ansermino, MBBCH, FRCPC, Cynthia Yarnold, MD, FRCPC

Published in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Issue 6/2019

Login to get access

Abstract

Purpose

The Pain assessment using a novel digital application (Panda) is a smartphone application that contains the digital versions of the visual analogue scale (VAS-100) and numeric rating scale (NRS-11). This study aimed to investigate if the Panda versions of these two pain scales are equivalent to the paper versions in adult patients.

Methods

This was a prospective, randomized, cross-over-controlled trial of subjects aged 19–75 yr undergoing procedures with anticipated post-surgical pain. Each subject used both the Panda and paper versions of VAS-100 or NRS-11 pain scores after emergence from anesthesia and after meeting postanesthesia care unit (PACU) discharge criteria. Correlations between the two tools were analyzed, and Bland-Altman agreement was calculated. The smartphone and paper versions were considered equivalent at each time point if the differences (and their 95% confidence interval [CI]) between them were less than 20 points for the VAS-100 and 2.1 for NRS-11.

Results

The two versions of the VAS-100 correlated strongly after emergence (Pearson’s r = 0.93; P < 0.001) and upon meeting discharge criteria (r = 0.94; P < 0.001); the mean (standard deviation [SD]) Panda score after emergence was 35 (27) compared with the paper score of 37 (26) (mean difference, − 2; 95% CI, − 22 to 19). The mean (SD) VAS-100 Panda score upon meeting discharge criteria was 21 (20) compared with the paper score of 23 (21) (mean difference, − 2; 95% CI, − 17 to 13). For the NRS-11, Panda again correlated strongly with the original tool scores after emergence (r = 0.93; P < 0.001) and upon meeting discharge criteria (r = 0.96; P < 0.001); the mean (SD) Panda and paper scores after emergence were both 4 (3) (mean difference, 0.05; 95% CI, − 1.87 to 1.96). The mean (SD) NRS-11 Panda and paper scores upon meeting PACU discharge criteria were both 3 (2) (mean difference, − 0.08; 95% CI, − 1.41 to 1.26).

Conclusion

Following emergence from anesthesia in adult patients, the digital Panda version of the NRS-11, but not the VAS-100, is equivalent to the validated paper version. In those who are ready for discharge from the PACU, the digital Panda versions of both the VAS-100 and NRS-11 agreed adequately and can be used in place of the original paper versions.
Literature
1.
go back to reference Breivik H. Postoperative pain management: why is it difficult to show that it improves outcome? Eur J Anaesthesiol 1998; 15: 748-51.CrossRefPubMed Breivik H. Postoperative pain management: why is it difficult to show that it improves outcome? Eur J Anaesthesiol 1998; 15: 748-51.CrossRefPubMed
2.
go back to reference Shipton EA. The transition from acute to chronic post surgical pain. Anaesth Intensive Care 2011; 39: 824-36.CrossRefPubMed Shipton EA. The transition from acute to chronic post surgical pain. Anaesth Intensive Care 2011; 39: 824-36.CrossRefPubMed
3.
go back to reference Dworkin RH, McDermottMP, Raja SN. Preventing chronic postsurgical pain: how much of a difference makes a difference? Anesthesiology 2010; 112: 516-8. Dworkin RH, McDermottMP, Raja SN. Preventing chronic postsurgical pain: how much of a difference makes a difference? Anesthesiology 2010; 112: 516-8.
4.
go back to reference Apfelbaum JL, Chen C, Mehta SS, Gan TJ. Postoperative pain experience: results from a national survey suggest postoperative pain continues to be undermanaged. Anesth Analg 2003; 97: 534-40.CrossRefPubMed Apfelbaum JL, Chen C, Mehta SS, Gan TJ. Postoperative pain experience: results from a national survey suggest postoperative pain continues to be undermanaged. Anesth Analg 2003; 97: 534-40.CrossRefPubMed
7.
go back to reference Hjermstad MJ, Fayers PM, Haugen DF, et al. Studies comparing numerical rating scales, verbal rating scales, and visual analogue scales for assessment of pain intensity in adults: a systematic literature review. J Pain Symptom Manage 2011; 41: 1073-93.CrossRefPubMed Hjermstad MJ, Fayers PM, Haugen DF, et al. Studies comparing numerical rating scales, verbal rating scales, and visual analogue scales for assessment of pain intensity in adults: a systematic literature review. J Pain Symptom Manage 2011; 41: 1073-93.CrossRefPubMed
8.
go back to reference McClellan CB, Schatz JC, Puffer E, Sanchez CE, Stancil MT, Roberts CW. Use of handheld wireless technology for a home-based sickle cell pain management protocol. J Pediatr Psychol 2009; 34: 564-73.CrossRefPubMed McClellan CB, Schatz JC, Puffer E, Sanchez CE, Stancil MT, Roberts CW. Use of handheld wireless technology for a home-based sickle cell pain management protocol. J Pediatr Psychol 2009; 34: 564-73.CrossRefPubMed
9.
go back to reference Lim J, Cloete G, Dunsmuir DT, et al. Usability and feasibility of PIERS on the move: an mHealth app for pre-eclampsia triage. JMIR Mhealth Uhealth 2015; 3: e37.CrossRefPubMedPubMedCentral Lim J, Cloete G, Dunsmuir DT, et al. Usability and feasibility of PIERS on the move: an mHealth app for pre-eclampsia triage. JMIR Mhealth Uhealth 2015; 3: e37.CrossRefPubMedPubMedCentral
10.
go back to reference Brown NJ, Kimble RM, Rodger S, Ware RS, Cuttle L. Play and heal: randomized controlled trial of Ditto™ intervention efficacy on improving re-epithelialization in pediatric burns. Burns 2014; 40: 204-13.CrossRefPubMed Brown NJ, Kimble RM, Rodger S, Ware RS, Cuttle L. Play and heal: randomized controlled trial of Ditto™ intervention efficacy on improving re-epithelialization in pediatric burns. Burns 2014; 40: 204-13.CrossRefPubMed
11.
go back to reference Kirwan M, Vandelanotte C, Fenning A, Duncan MJ. Diabetes self-management smartphone application for adults with type 1 diabetes: randomized controlled trial. J Med Internet Res 2013; 15: e235.CrossRefPubMedPubMedCentral Kirwan M, Vandelanotte C, Fenning A, Duncan MJ. Diabetes self-management smartphone application for adults with type 1 diabetes: randomized controlled trial. J Med Internet Res 2013; 15: e235.CrossRefPubMedPubMedCentral
12.
go back to reference Sindhu B, Shechtman O, Tuckey L. Validity, reliability, and responsiveness of a digital version of the visual analog scale. J Hand Ther 2011; 24: 356-63.CrossRefPubMed Sindhu B, Shechtman O, Tuckey L. Validity, reliability, and responsiveness of a digital version of the visual analog scale. J Hand Ther 2011; 24: 356-63.CrossRefPubMed
13.
go back to reference Sun T, West N, Ansermino JM, et al. A smartphone version of the faces pain scale-revised and the color analog scale for postoperative pain assessment in children. Pediatr Anesth 2015; 25: 1264-73.CrossRef Sun T, West N, Ansermino JM, et al. A smartphone version of the faces pain scale-revised and the color analog scale for postoperative pain assessment in children. Pediatr Anesth 2015; 25: 1264-73.CrossRef
14.
go back to reference Wood C, von Baeyer C, Falinower S, Moyse D, Annequin D, Legout V. Electronic and paper versions of a faces pain intensity scale: concordance and preference in hospitalized children. BMC Pediatr 2011; 11: 87.CrossRefPubMedPubMedCentral Wood C, von Baeyer C, Falinower S, Moyse D, Annequin D, Legout V. Electronic and paper versions of a faces pain intensity scale: concordance and preference in hospitalized children. BMC Pediatr 2011; 11: 87.CrossRefPubMedPubMedCentral
15.
go back to reference Cravero JP, Fanciullo GJ, McHugo GJ, Baird JC. The validity of the computer face scale for measuring pediatric pain and mood. Pediatr Anesth 2013; 23: 156-61.CrossRef Cravero JP, Fanciullo GJ, McHugo GJ, Baird JC. The validity of the computer face scale for measuring pediatric pain and mood. Pediatr Anesth 2013; 23: 156-61.CrossRef
16.
go back to reference Bird ML, Callisaya ML, Cannell J, Gibbons T, Smith ST, Ahuja KD. Accuracy, validity, and reliability of an electronic visual analog scale for pain on a touch screen tablet in healthy older adults: a clinical trial. Interact J Med Res 2016; 5: e3.CrossRefPubMedPubMedCentral Bird ML, Callisaya ML, Cannell J, Gibbons T, Smith ST, Ahuja KD. Accuracy, validity, and reliability of an electronic visual analog scale for pain on a touch screen tablet in healthy older adults: a clinical trial. Interact J Med Res 2016; 5: e3.CrossRefPubMedPubMedCentral
17.
go back to reference Castarlenas E, Sanchez-Rodriguez E, de la Vega R, Roset R, Miro J. Agreement between verbal and electronic versions of the numerical rating scale (NRS-11) when used to assess pain intensity in adolescents. Clin J Pain 2015; 31: 229-34.CrossRefPubMed Castarlenas E, Sanchez-Rodriguez E, de la Vega R, Roset R, Miro J. Agreement between verbal and electronic versions of the numerical rating scale (NRS-11) when used to assess pain intensity in adolescents. Clin J Pain 2015; 31: 229-34.CrossRefPubMed
18.
go back to reference Jensen MP, Karoly P. Self-report scales and procedures for assessing pain in adults. In: Turk DC, Melzack R, editors. Handbook of Pain Assessment. 3rd ed. NY: Guilford Press; 2011. p. 19-45. Jensen MP, Karoly P. Self-report scales and procedures for assessing pain in adults. In: Turk DC, Melzack R, editors. Handbook of Pain Assessment. 3rd ed. NY: Guilford Press; 2011. p. 19-45.
19.
go back to reference DeLoach L, Higgins MS, Caplan AB, Stiff JL. The visual analogue scale in the immediate postoperative period: intrasubject variability and correlation with a numeric scale. Anesth Analg 1998; 86: 102-6.PubMed DeLoach L, Higgins MS, Caplan AB, Stiff JL. The visual analogue scale in the immediate postoperative period: intrasubject variability and correlation with a numeric scale. Anesth Analg 1998; 86: 102-6.PubMed
20.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009; 42: 377-81.CrossRef Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009; 42: 377-81.CrossRef
22.
go back to reference Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999; 8: 135-60.CrossRefPubMed Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999; 8: 135-60.CrossRefPubMed
23.
go back to reference Abu-Arafeh A, Jordan H, Drummond G. Reporting of method comparison studies: a review of advice, an assessment of current practice, and specific suggestions for future reports. Br J Anaesth 2016; 117: 569-75.CrossRefPubMed Abu-Arafeh A, Jordan H, Drummond G. Reporting of method comparison studies: a review of advice, an assessment of current practice, and specific suggestions for future reports. Br J Anaesth 2016; 117: 569-75.CrossRefPubMed
24.
go back to reference Liao JJ. Sample size calculation for an agreement study. Pharm Stat 2010; 9: 125-32.PubMed Liao JJ. Sample size calculation for an agreement study. Pharm Stat 2010; 9: 125-32.PubMed
25.
go back to reference Bernstein SL, Bijur PE, Gallagher EJ. Relationship between pain intensity and relief in patients with acute severe pain. Am J Emerg Med 2006; 24: 162-6.CrossRefPubMed Bernstein SL, Bijur PE, Gallagher EJ. Relationship between pain intensity and relief in patients with acute severe pain. Am J Emerg Med 2006; 24: 162-6.CrossRefPubMed
26.
go back to reference Gandhi K, Lindenmuth DM, Hadzic A, et al. The effect of stimulating versus conventional perineural catheters on postoperative analgesia following ultrasound-guided femoral nerve localization. J Clin Anesth 2011; 23: 626-31.CrossRefPubMed Gandhi K, Lindenmuth DM, Hadzic A, et al. The effect of stimulating versus conventional perineural catheters on postoperative analgesia following ultrasound-guided femoral nerve localization. J Clin Anesth 2011; 23: 626-31.CrossRefPubMed
27.
go back to reference Li L, Liu X, Herr K. Postoperative pain intensity assessment: a comparison of four scales in Chinese adults. Pain Med 2007; 8: 223-34.CrossRefPubMed Li L, Liu X, Herr K. Postoperative pain intensity assessment: a comparison of four scales in Chinese adults. Pain Med 2007; 8: 223-34.CrossRefPubMed
28.
go back to reference Gagliese L, Weizblit N, Ellis W, Chan VW. The measurement of postoperative pain: a comparison of intensity scales in younger and older surgical patients. Pain 2005; 117: 412-20.CrossRefPubMed Gagliese L, Weizblit N, Ellis W, Chan VW. The measurement of postoperative pain: a comparison of intensity scales in younger and older surgical patients. Pain 2005; 117: 412-20.CrossRefPubMed
29.
go back to reference Gauthier LR, Gagliese L. Assessment of pain in older persons. In: Turk D, Melzack R, editors. Handbook of Pain Assessment. 3rd ed. NY: Guilford Press; 2011. p. 242-60. Gauthier LR, Gagliese L. Assessment of pain in older persons. In: Turk D, Melzack R, editors. Handbook of Pain Assessment. 3rd ed. NY: Guilford Press; 2011. p. 242-60.
30.
go back to reference Sloman R, Wruble AW, Rosen G, Rom M. Determination of clinically meaningful levels of pain reduction in patients experiencing acute postoperative pain. Pain Manag Nurs 2006; 7: 153-8.CrossRefPubMed Sloman R, Wruble AW, Rosen G, Rom M. Determination of clinically meaningful levels of pain reduction in patients experiencing acute postoperative pain. Pain Manag Nurs 2006; 7: 153-8.CrossRefPubMed
31.
go back to reference Farrar J, Young JP Jr, LaMoreaux L, Werth JL, Poole RM. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain 2001; 94: 149-58.CrossRef Farrar J, Young JP Jr, LaMoreaux L, Werth JL, Poole RM. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain 2001; 94: 149-58.CrossRef
32.
go back to reference Todd KH, Funk KG, Funk JP, Bonacci R. Clinical significance of reported changes in pain severity. Ann Emerg Med 1996; 27: 485-9.CrossRefPubMed Todd KH, Funk KG, Funk JP, Bonacci R. Clinical significance of reported changes in pain severity. Ann Emerg Med 1996; 27: 485-9.CrossRefPubMed
Metadata
Title
The evaluation of smartphone versions of the visual analogue scale and numeric rating scale as postoperative pain assessment tools: a prospective randomized trial
Authors
Lily Y. L. Chiu, MD
Terri Sun, MD
Ronald Ree, MD, FRCPC
Dustin Dunsmuir, MSc
Alexander Dotto, MD
J. Mark Ansermino, MBBCH, FRCPC
Cynthia Yarnold, MD, FRCPC
Publication date
01-06-2019
Publisher
Springer International Publishing
Published in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Issue 6/2019
Print ISSN: 0832-610X
Electronic ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-019-01324-9

Other articles of this Issue 6/2019

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 6/2019 Go to the issue