Skip to main content
Top
Published in: Quality of Life Research 7/2018

Open Access 01-07-2018

Validation of the PROMIS Sleep Disturbance and Sleep-Related Impairment item banks in Dutch adolescents

Authors: Jojanneke A. M. C. van Kooten, Raphaёle R. L. van Litsenburg, Whitney R. Yoder, Gertjan J. L. Kaspers, Caroline B. Terwee

Published in: Quality of Life Research | Issue 7/2018

Login to get access

Abstract

Purpose

Sleep problems are common in adolescents and have a negative impact on daytime functioning. However, there is a lack of well-validated adolescent sleep questionnaires. The Patient-Reported Outcomes Measurement Information System (PROMIS) Sleep Disturbance and Sleep-Related Impairment item banks are well-validated instruments developed for and tested in adults. The aim of this study was to evaluate their structural validity in adolescents.

Methods

Test and retest data were collected for the Dutch–Flemish V1.0 PROMIS Sleep Disturbance (27) and Sleep-Related Impairment (16 items) item banks from 1046 adolescents (11–19 years). Cross-validation methods, Confirmatory (CFA), and Exploratory Factor Analyses (EFA) were used. Fit indices and factor loadings were used to improve the models. The final models were assessed for model fit using retest data.

Results

The one-factor Sleep Disturbance (CFI = 0.795, TLI = 0.778, RMSEA = 0.117) and Sleep-Related Impairment (CFI = 0.897, TLI = 0.882, RMSEA = 0.156) models could not be replicated in adolescents. Cross-validation resulted in a final Sleep Disturbance model of 23 and a Sleep-Related Impairment model of 11 items. Retest data CFA showed adequate fit for the Sleep-Related Impairment-11 (CFI = 0.981, TLI = 0.976, RMSEA = 0.116). The Sleep Disturbance-23 model fit indices stayed below the recommended values (CFI = 0.895, TLI = 0.885, RMSEA = 0.105).

Conclusions

While the PROMIS Sleep Disturbance-23 for adolescents and PROMIS Sleep-Related Impairment-11 for adolescents provide a framework to assess adolescent sleep, additional research is needed to replicate these findings in a larger and more diverse sample.
Literature
1.
go back to reference Olds, T., Blunden, S., Petkov, J., & Forchino, F. (2010). The relationships between sex, age, geography and time in bed in adolescents: A meta-analysis of data from 23 countries. Sleep Medicine Reviews, 14(6), 371–378.CrossRefPubMed Olds, T., Blunden, S., Petkov, J., & Forchino, F. (2010). The relationships between sex, age, geography and time in bed in adolescents: A meta-analysis of data from 23 countries. Sleep Medicine Reviews, 14(6), 371–378.CrossRefPubMed
2.
go back to reference Colrain, I. M., & Baker, F. C. (2011). Changes in sleep as a function of adolescent development. Neuropsychology Review, 21(1), 5–21.CrossRefPubMed Colrain, I. M., & Baker, F. C. (2011). Changes in sleep as a function of adolescent development. Neuropsychology Review, 21(1), 5–21.CrossRefPubMed
3.
go back to reference Hagenauer, M. H., Perryman, J. I., Lee, T. M., & Carskadon, M. A. (2009). Adolescent changes in the homeostatic and circadian regulation of sleep. Developmental Neuroscience, 31(4), 276–284.CrossRefPubMedPubMedCentral Hagenauer, M. H., Perryman, J. I., Lee, T. M., & Carskadon, M. A. (2009). Adolescent changes in the homeostatic and circadian regulation of sleep. Developmental Neuroscience, 31(4), 276–284.CrossRefPubMedPubMedCentral
4.
go back to reference Dregan, A., & Armstrong, D. (2010). Adolescence Sleep Disturbances as predictors of adulthood Sleep Disturbances—A cohort study. Journal of Adolescent Health, 46(5), 482–487.CrossRefPubMed Dregan, A., & Armstrong, D. (2010). Adolescence Sleep Disturbances as predictors of adulthood Sleep Disturbances—A cohort study. Journal of Adolescent Health, 46(5), 482–487.CrossRefPubMed
6.
go back to reference Wang, B., Isensee, C., Becker, A., Wong, J., Eastwood, P. R., Huang, R. C., Runions, K. C., Stewart, R. M., Meyer, T., Bruni, L. G., Zepf, F. D., & Rothenberger, A. (2016). Developmental Trajectories of sleep problems from childhood to adolescence both predict and are predicted by emotional and behavioral problems. Frontiers Psychology, 7, 1874. Wang, B., Isensee, C., Becker, A., Wong, J., Eastwood, P. R., Huang, R. C., Runions, K. C., Stewart, R. M., Meyer, T., Bruni, L. G., Zepf, F. D., & Rothenberger, A. (2016). Developmental Trajectories of sleep problems from childhood to adolescence both predict and are predicted by emotional and behavioral problems. Frontiers Psychology, 7, 1874.
7.
go back to reference Paruthi, S., Brooks, L. J., D’Ambrosio, C., Hall, W. A., Kotagal, S., Lloyd, R. M., Malow, B. A., Maski, K., Nichols, C., Quan, S. F., Rosen, C. L., Troester, M. M., & Wise, M. S. (2016). Recommended amount of sleep for pediatric populations: A consensus statement of the American Academy of Sleep Medicine. Journal of Clinical Sleep Medicine, 12(6), 785–786.CrossRefPubMedPubMedCentral Paruthi, S., Brooks, L. J., D’Ambrosio, C., Hall, W. A., Kotagal, S., Lloyd, R. M., Malow, B. A., Maski, K., Nichols, C., Quan, S. F., Rosen, C. L., Troester, M. M., & Wise, M. S. (2016). Recommended amount of sleep for pediatric populations: A consensus statement of the American Academy of Sleep Medicine. Journal of Clinical Sleep Medicine, 12(6), 785–786.CrossRefPubMedPubMedCentral
9.
go back to reference Eaton, D. K., McKnight-Eily, L. R., Lowry, R., Perry, G. S., Presley-Cantrell, L., & Croft, J. B. (2010). Prevalence of insufficient, borderline, and optimal hours of sleep among high school students—United States, 2007. Journal of Adolescent Health, 46(4), 399–401.CrossRefPubMed Eaton, D. K., McKnight-Eily, L. R., Lowry, R., Perry, G. S., Presley-Cantrell, L., & Croft, J. B. (2010). Prevalence of insufficient, borderline, and optimal hours of sleep among high school students—United States, 2007. Journal of Adolescent Health, 46(4), 399–401.CrossRefPubMed
10.
go back to reference Moore, M., & Meltzer, L. J. (2008). The sleepy adolescent: Causes and consequences of sleepiness in teens. Paediatric Respiratory Reviews, 9(2), 114–120.CrossRefPubMed Moore, M., & Meltzer, L. J. (2008). The sleepy adolescent: Causes and consequences of sleepiness in teens. Paediatric Respiratory Reviews, 9(2), 114–120.CrossRefPubMed
11.
go back to reference Malone, S. K. (2011). Early to bed, early to rise? An exploration of adolescent sleep hygiene practices. J Sch Nurs, 27(5), 348–354.CrossRefPubMed Malone, S. K. (2011). Early to bed, early to rise? An exploration of adolescent sleep hygiene practices. J Sch Nurs, 27(5), 348–354.CrossRefPubMed
12.
go back to reference Arora, T., Broglia, E., Thomas, G. N., & Taheri, S. (2014). Associations between specific technologies and adolescent sleep quantity, sleep quality, and parasomnias. Sleep Medicine, 15(2), 240–247.CrossRefPubMed Arora, T., Broglia, E., Thomas, G. N., & Taheri, S. (2014). Associations between specific technologies and adolescent sleep quantity, sleep quality, and parasomnias. Sleep Medicine, 15(2), 240–247.CrossRefPubMed
13.
go back to reference O’Brien, E. M., & Mindell, J. A. (2005). Sleep and risk-taking behavior in adolescents. Behavioral Sleep Medicine, 3(3), 113–133.CrossRefPubMed O’Brien, E. M., & Mindell, J. A. (2005). Sleep and risk-taking behavior in adolescents. Behavioral Sleep Medicine, 3(3), 113–133.CrossRefPubMed
14.
go back to reference Gradisar, M., Terrill, G., Johnston, A., & Douglas, P. (2008). Adolescent sleep and working memory performance. Sleep and Biological Rhythms, 6(3), 146–154.CrossRef Gradisar, M., Terrill, G., Johnston, A., & Douglas, P. (2008). Adolescent sleep and working memory performance. Sleep and Biological Rhythms, 6(3), 146–154.CrossRef
15.
go back to reference Erickson, J. M., Macpherson, C. F., Ameringer, S., Baggott, C., Linder, L., & Stegenga, K. (2013). Symptoms and symptom clusters in adolescents receiving cancer treatment: A review of the literature. Int J Nurs Stud, 50(6), 847–869.CrossRefPubMed Erickson, J. M., Macpherson, C. F., Ameringer, S., Baggott, C., Linder, L., & Stegenga, K. (2013). Symptoms and symptom clusters in adolescents receiving cancer treatment: A review of the literature. Int J Nurs Stud, 50(6), 847–869.CrossRefPubMed
16.
go back to reference Gordijn, M. S., van Litsenburg, R. R., Gemke, R. J., Huisman, J., Bierings, M. B., Hoogerbrugge, P. M., & Kaspers, G. J. (2013). Sleep, fatigue, depression, and quality of life in survivors of childhood acute lymphoblastic leukemia. Pediatric Blood Cancer, 60(3), 479–485.CrossRefPubMed Gordijn, M. S., van Litsenburg, R. R., Gemke, R. J., Huisman, J., Bierings, M. B., Hoogerbrugge, P. M., & Kaspers, G. J. (2013). Sleep, fatigue, depression, and quality of life in survivors of childhood acute lymphoblastic leukemia. Pediatric Blood Cancer, 60(3), 479–485.CrossRefPubMed
17.
go back to reference van Litsenburg, R. R., Huisman, J., Hoogerbrugge, P. M., Egeler, R. M., Kaspers, G. J., & Gemke, R. J. (2011). Impaired sleep affects quality of life in children during maintenance treatment for acute lymphoblastic leukemia: An exploratory study. Health Quality of Life Outcomes, 9, 25.CrossRefPubMedPubMedCentral van Litsenburg, R. R., Huisman, J., Hoogerbrugge, P. M., Egeler, R. M., Kaspers, G. J., & Gemke, R. J. (2011). Impaired sleep affects quality of life in children during maintenance treatment for acute lymphoblastic leukemia: An exploratory study. Health Quality of Life Outcomes, 9, 25.CrossRefPubMedPubMedCentral
18.
go back to reference Arora, T., Broglia, E., Pushpakumar, D., Lodhi, T., & Taheri, S. (2013). An investigation into the strength of the association and agreement levels between subjective and objective sleep duration in adolescents. PLoS ONE, 8(8), e72406.CrossRefPubMedPubMedCentral Arora, T., Broglia, E., Pushpakumar, D., Lodhi, T., & Taheri, S. (2013). An investigation into the strength of the association and agreement levels between subjective and objective sleep duration in adolescents. PLoS ONE, 8(8), e72406.CrossRefPubMedPubMedCentral
19.
go back to reference Ji, X., & Liu, J. (2016). Subjective sleep measures for adolescents: A systematic review. Child Care Health and Development, 42(6), 825–839.CrossRef Ji, X., & Liu, J. (2016). Subjective sleep measures for adolescents: A systematic review. Child Care Health and Development, 42(6), 825–839.CrossRef
20.
go back to reference Buysse, D. J., Yu, L., Moul, D. E., Germain, A., Stover, A., Dodds, N. E., Johnston, K. L., Shablesky-Cade, M. A., & Pilkonis, P. A. (2010). Development and validation of patient-reported outcome measures for Sleep Disturbance and Sleep-Related Impairments. Sleep, 33(6), 781–792.CrossRefPubMedPubMedCentral Buysse, D. J., Yu, L., Moul, D. E., Germain, A., Stover, A., Dodds, N. E., Johnston, K. L., Shablesky-Cade, M. A., & Pilkonis, P. A. (2010). Development and validation of patient-reported outcome measures for Sleep Disturbance and Sleep-Related Impairments. Sleep, 33(6), 781–792.CrossRefPubMedPubMedCentral
21.
go back to reference Yu, L., Buysse, D. J., Germain, A., Moul, D. E., Stover, A., Dodds, N. E., Johnston, K. L., & Pilkonis, P. A. (2011). Development of short forms from the PROMIS Sleep Disturbance and Sleep-Related Impairment item banks. Behavioral Sleep Medicine, 10(1), 6–24.CrossRefPubMedPubMedCentral Yu, L., Buysse, D. J., Germain, A., Moul, D. E., Stover, A., Dodds, N. E., Johnston, K. L., & Pilkonis, P. A. (2011). Development of short forms from the PROMIS Sleep Disturbance and Sleep-Related Impairment item banks. Behavioral Sleep Medicine, 10(1), 6–24.CrossRefPubMedPubMedCentral
22.
go back to reference Cella, D., Gershon, R., Lai, J. S., & Choi, S. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 133–141.CrossRefPubMed Cella, D., Gershon, R., Lai, J. S., & Choi, S. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 133–141.CrossRefPubMed
23.
go back to reference Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., Devellis, R., DeWalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J. S., Pilkonis, P., Revicki, D., Rose, M., Weinfurt, K., & Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194.CrossRefPubMedPubMedCentral Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., Devellis, R., DeWalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J. S., Pilkonis, P., Revicki, D., Rose, M., Weinfurt, K., & Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194.CrossRefPubMedPubMedCentral
24.
go back to reference Witter, J. P. (2016). The promise of Patient-Reported Outcomes Measurement Information System-turning theory into reality: A uniform approach to patient-reported outcomes across rheumatic diseases. Rheumatic Disease Clinics of North America, 42(2), 377–394.CrossRefPubMed Witter, J. P. (2016). The promise of Patient-Reported Outcomes Measurement Information System-turning theory into reality: A uniform approach to patient-reported outcomes across rheumatic diseases. Rheumatic Disease Clinics of North America, 42(2), 377–394.CrossRefPubMed
25.
go back to reference Bjorner, J. B., Chang, C. H., Thissen, D., & Reeve, B. B. (2007). Developing tailored instruments: Item banking and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 95–108.CrossRefPubMed Bjorner, J. B., Chang, C. H., Thissen, D., & Reeve, B. B. (2007). Developing tailored instruments: Item banking and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 95–108.CrossRefPubMed
26.
go back to reference Cook, K. F., O’Malley, K. J., & Roddey, T. S. (2005). Dynamic assessment of health outcomes: Time to let the CAT out of the bag? Health Service Research, 40(5 Pt 2), 1694–1711.CrossRef Cook, K. F., O’Malley, K. J., & Roddey, T. S. (2005). Dynamic assessment of health outcomes: Time to let the CAT out of the bag? Health Service Research, 40(5 Pt 2), 1694–1711.CrossRef
27.
go back to reference Hanish, A. E., Lin-Dyken, D. C., & Han, J. C. (2017). PROMIS Sleep Disturbance and Sleep-Related Impairment in adolescents: Examining psychometrics using self-report and actigraphy. Nursing Research, 66(3), 246–251.CrossRefPubMedPubMedCentral Hanish, A. E., Lin-Dyken, D. C., & Han, J. C. (2017). PROMIS Sleep Disturbance and Sleep-Related Impairment in adolescents: Examining psychometrics using self-report and actigraphy. Nursing Research, 66(3), 246–251.CrossRefPubMedPubMedCentral
28.
go back to reference Milette, K., Hudson, M., Korner, A., Baron, M., & Thombs, B. D. (2013). Sleep Disturbances in systemic sclerosis: Evidence for the role of gastrointestinal symptoms, pain and pruritus. Rheumatology, 52(9), 1715–1720.CrossRefPubMed Milette, K., Hudson, M., Korner, A., Baron, M., & Thombs, B. D. (2013). Sleep Disturbances in systemic sclerosis: Evidence for the role of gastrointestinal symptoms, pain and pruritus. Rheumatology, 52(9), 1715–1720.CrossRefPubMed
29.
go back to reference Terwee, C. B., Roorda, L. D., de Vet, H. C., Dekker, J., Westhovens, R., van Leeuwen, J., Cella, D., Correia, H., Arnold, B., Perez, B., & Boers, M. (2014). Dutch–Flemish translation of 17 item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS). Quality of Life Research, 23(6), 1733–1741.PubMed Terwee, C. B., Roorda, L. D., de Vet, H. C., Dekker, J., Westhovens, R., van Leeuwen, J., Cella, D., Correia, H., Arnold, B., Perez, B., & Boers, M. (2014). Dutch–Flemish translation of 17 item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS). Quality of Life Research, 23(6), 1733–1741.PubMed
30.
go back to reference Rogers, L. Q., Fogleman, A., Trammell, R., Hopkins-Price, P., Spenner, A., Vicari, S., Rao, K., Courneya, K. S., Hoelzer, K., Robbs, R., & Verhulst, S. (2015). Inflammation and psychosocial factors mediate exercise effects on sleep quality in breast cancer survivors: Pilot randomized controlled trial. Psychooncology, 24(3), 302–310.CrossRefPubMed Rogers, L. Q., Fogleman, A., Trammell, R., Hopkins-Price, P., Spenner, A., Vicari, S., Rao, K., Courneya, K. S., Hoelzer, K., Robbs, R., & Verhulst, S. (2015). Inflammation and psychosocial factors mediate exercise effects on sleep quality in breast cancer survivors: Pilot randomized controlled trial. Psychooncology, 24(3), 302–310.CrossRefPubMed
31.
go back to reference Silva, E. C. Z. M., Rde, P., Mendonca, M., T. M., & Silva, C. H. (2014). Brazilian–Portuguese translation and cultural adaptation of the sleep and wake disturbances domains of the Patient-Reported-Outcomes Measurement Information System (PROMIS). Cad Saude Publica, 30(7), 1391–1401.CrossRefPubMed Silva, E. C. Z. M., Rde, P., Mendonca, M., T. M., & Silva, C. H. (2014). Brazilian–Portuguese translation and cultural adaptation of the sleep and wake disturbances domains of the Patient-Reported-Outcomes Measurement Information System (PROMIS). Cad Saude Publica, 30(7), 1391–1401.CrossRefPubMed
32.
go back to reference Alonso, J., Bartlett, S. J., Rose, M., Aaronson, N. K., Chaplin, J. E., Efficace, F., Leplege, A., Lu, A., Tulsky, D. S., Raat, H., Ravens-Sieberer, U., Revicki, D., Terwee, C. B., Valderas, J. M., Cella, D., & Forrest, C. B. (2013). The case for an international Patient-Reported Outcomes Measurement Information System (PROMIS(R)) initiative. Health and Quality of Life Outcomes, 11, 210.CrossRefPubMedPubMedCentral Alonso, J., Bartlett, S. J., Rose, M., Aaronson, N. K., Chaplin, J. E., Efficace, F., Leplege, A., Lu, A., Tulsky, D. S., Raat, H., Ravens-Sieberer, U., Revicki, D., Terwee, C. B., Valderas, J. M., Cella, D., & Forrest, C. B. (2013). The case for an international Patient-Reported Outcomes Measurement Information System (PROMIS(R)) initiative. Health and Quality of Life Outcomes, 11, 210.CrossRefPubMedPubMedCentral
33.
go back to reference van Kooten, J. A., Terwee, C. B., Kaspers, G. J., & van Litsenburg, R. R. (2016). Content validity of the Patient-Reported Outcomes Measurement Information System Sleep Disturbance and Sleep Related Impairment item banks in adolescents. Health and Quality of Life Outcomes, 14, 92.CrossRefPubMedPubMedCentral van Kooten, J. A., Terwee, C. B., Kaspers, G. J., & van Litsenburg, R. R. (2016). Content validity of the Patient-Reported Outcomes Measurement Information System Sleep Disturbance and Sleep Related Impairment item banks in adolescents. Health and Quality of Life Outcomes, 14, 92.CrossRefPubMedPubMedCentral
36.
go back to reference Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H., Gershon, R., Reise, S. P., Lai, J. S., & Cella, D. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–S31. Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H., Gershon, R., Reise, S. P., Lai, J. S., & Cella, D. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–S31.
37.
go back to reference Reckase, M. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational and Bhavioral Statistics, 4, 207–230.CrossRef Reckase, M. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational and Bhavioral Statistics, 4, 207–230.CrossRef
38.
40.
go back to reference Touitou, Y. (2013). Adolescent sleep misalignment: A chronic jet lag and a matter of public health. J Physiol Paris, 107(4), 323–326.CrossRefPubMed Touitou, Y. (2013). Adolescent sleep misalignment: A chronic jet lag and a matter of public health. J Physiol Paris, 107(4), 323–326.CrossRefPubMed
41.
go back to reference Gradisar, M., Gardner, G., & Dohnt, H. (2011). Recent worldwide sleep patterns and problems during adolescence: A review and meta-analysis of age, region, and sleep. Sleep Medicine, 12(2), 110–118.CrossRefPubMed Gradisar, M., Gardner, G., & Dohnt, H. (2011). Recent worldwide sleep patterns and problems during adolescence: A review and meta-analysis of age, region, and sleep. Sleep Medicine, 12(2), 110–118.CrossRefPubMed
43.
go back to reference Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44, 409–432.CrossRef Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44, 409–432.CrossRef
Metadata
Title
Validation of the PROMIS Sleep Disturbance and Sleep-Related Impairment item banks in Dutch adolescents
Authors
Jojanneke A. M. C. van Kooten
Raphaёle R. L. van Litsenburg
Whitney R. Yoder
Gertjan J. L. Kaspers
Caroline B. Terwee
Publication date
01-07-2018
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 7/2018
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-018-1856-x

Other articles of this Issue 7/2018

Quality of Life Research 7/2018 Go to the issue