Skip to main content
Top
Published in: BMC Public Health 1/2013

Open Access 01-12-2013 | Research article

Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS)

Authors: Rachel A Millstein, Kelli L Cain, James F Sallis, Terry L Conway, Carrie Geremia, Lawrence D Frank, Jim Chapman, Delfien Van Dyck, Lindsay R Dipzinski, Jacqueline Kerr, Karen Glanz, Brian E Saelens

Published in: BMC Public Health | Issue 1/2013

Login to get access

Abstract

Background

Streetscape (microscale) features of the built environment can influence people’s perceptions of their neighborhoods’ suitability for physical activity. Many microscale audit tools have been developed, but few have published systematic scoring methods. We present the development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS) tool and its theoretically-based subscales.

Methods

MAPS was based on prior instruments and was developed to assess details of streetscapes considered relevant for physical activity. MAPS sections (route, segments, crossings, and cul-de-sacs) were scored by two independent raters for reliability analyses. There were 290 route pairs, 516 segment pairs, 319 crossing pairs, and 53 cul-de-sac pairs in the reliability sample. Individual inter-rater item reliability analyses were computed using Kappa, intra-class correlation coefficient (ICC), and percent agreement. A conceptual framework for subscale creation was developed using theory, expert consensus, and policy relevance. Items were grouped into subscales, and subscales were analyzed for inter-rater reliability at tiered levels of aggregation.

Results

There were 160 items included in the subscales (out of 201 items total). Of those included in the subscales, 80 items (50.0%) had good/excellent reliability, 41 items (25.6%) had moderate reliability, and 18 items (11.3%) had low reliability, with limited variability in the remaining 21 items (13.1%). Seventeen of the 20 route section subscales, valence (positive/negative) scores, and overall scores (85.0%) demonstrated good/excellent reliability and 3 demonstrated moderate reliability. Of the 16 segment subscales, valence scores, and overall scores, 12 (75.0%) demonstrated good/excellent reliability, three demonstrated moderate reliability, and one demonstrated poor reliability. Of the 8 crossing subscales, valence scores, and overall scores, 6 (75.0%) demonstrated good/excellent reliability, and 2 demonstrated moderate reliability. The cul-de-sac subscale demonstrated good/excellent reliability.

Conclusions

MAPS items and subscales predominantly demonstrated moderate to excellent reliability. The subscales and scoring system represent a theoretically based framework for using these complex microscale data and may be applicable to other similar instruments.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ding D, Sallis JF, Kerr J, Lee S, Rosenberg DE: Neighborhood environment and physical activity among youth: a review. Am J Prev Med. 2011, 41: 442-455. 10.1016/j.amepre.2011.06.036.CrossRefPubMed Ding D, Sallis JF, Kerr J, Lee S, Rosenberg DE: Neighborhood environment and physical activity among youth: a review. Am J Prev Med. 2011, 41: 442-455. 10.1016/j.amepre.2011.06.036.CrossRefPubMed
2.
go back to reference Gebel K, Bauman AE, Petticrew M: The physical environment and physical activity: a critical appraisal of review articles. Am J Prev Med. 2007, 32 (5): 361-369. 10.1016/j.amepre.2007.01.020.CrossRefPubMed Gebel K, Bauman AE, Petticrew M: The physical environment and physical activity: a critical appraisal of review articles. Am J Prev Med. 2007, 32 (5): 361-369. 10.1016/j.amepre.2007.01.020.CrossRefPubMed
3.
go back to reference Heath GW, Brownson RC, Kruger J, Miles R, Powell KE, Ramsey LT: The effectiveness of urban design and land use and transport policies and practices to increase physical activity: a systematic review. J Phys Act Health. 2006, 3 (Suppl 1): S55-S76. Heath GW, Brownson RC, Kruger J, Miles R, Powell KE, Ramsey LT: The effectiveness of urban design and land use and transport policies and practices to increase physical activity: a systematic review. J Phys Act Health. 2006, 3 (Suppl 1): S55-S76.
4.
go back to reference Van Cauwenberg J, De Bourdeaudhuij I, De Meester F, Van Dyck D, Salmon J, Clarys P, Deforche B: Relationship between the physical environment and physical activity in older adults: a systematic review. Health Place. 2011, 17: 458-469. 10.1016/j.healthplace.2010.11.010.CrossRefPubMed Van Cauwenberg J, De Bourdeaudhuij I, De Meester F, Van Dyck D, Salmon J, Clarys P, Deforche B: Relationship between the physical environment and physical activity in older adults: a systematic review. Health Place. 2011, 17: 458-469. 10.1016/j.healthplace.2010.11.010.CrossRefPubMed
5.
go back to reference Brownson RC, Hoehner CM, Day K, Forsyth A, Sallis JF: Measuring the built environment for physical activity: state of the science. Am J Prev Med. 2009, 36 (Suppl 4): S99-123. 10.1016/j.amepre.2009.01.005.CrossRefPubMedPubMedCentral Brownson RC, Hoehner CM, Day K, Forsyth A, Sallis JF: Measuring the built environment for physical activity: state of the science. Am J Prev Med. 2009, 36 (Suppl 4): S99-123. 10.1016/j.amepre.2009.01.005.CrossRefPubMedPubMedCentral
6.
go back to reference Saelens BE, Handy SL: Built environment correlates of walking: a review. Med Sci Sports Exerc. 2008, 40 (Supp 7): S550-S556. 10.1249/MSS.0b013e31817c67a4.CrossRefPubMedPubMedCentral Saelens BE, Handy SL: Built environment correlates of walking: a review. Med Sci Sports Exerc. 2008, 40 (Supp 7): S550-S556. 10.1249/MSS.0b013e31817c67a4.CrossRefPubMedPubMedCentral
7.
go back to reference Brennan Ramirez LK, Hoehner CM, Brownson RC, Cook R, Orleans CT, Hollander M, Barker DC, Bors P, Ewing R, Killingsworth R, Petersmarck K, Schmid T, Wilkinson W: Indicators of activity-friendly communities: an evidence-based consensus process. Am J Prev Med. 2006, 31: 515-524. 10.1016/j.amepre.2006.07.026.CrossRefPubMed Brennan Ramirez LK, Hoehner CM, Brownson RC, Cook R, Orleans CT, Hollander M, Barker DC, Bors P, Ewing R, Killingsworth R, Petersmarck K, Schmid T, Wilkinson W: Indicators of activity-friendly communities: an evidence-based consensus process. Am J Prev Med. 2006, 31: 515-524. 10.1016/j.amepre.2006.07.026.CrossRefPubMed
8.
go back to reference Sallis JF, Slymen DJ, Conway TL, Frank LD, Saelens BE, Cain K, Chapman JE: Income disparities in perceived neighborhood built and social environment attributes. Health Place. 2011, 17: 1274-1283. http://dx.doi.org/10.1016/j.healthplace.2011.02.006.CrossRefPubMed Sallis JF, Slymen DJ, Conway TL, Frank LD, Saelens BE, Cain K, Chapman JE: Income disparities in perceived neighborhood built and social environment attributes. Health Place. 2011, 17: 1274-1283. http://​dx.​doi.​org/​10.​1016/​j.​healthplace.​2011.​02.​006.​CrossRefPubMed
9.
go back to reference Boarnet MG, Forsyth A, Day K, Oakes JM: The street level built environment and physical activity and walking: results of a predictive validity study for the Irvine-Minnesota Inventory. Environ Behav. 2011, 43: 735-775. 10.1177/0013916510379760.CrossRef Boarnet MG, Forsyth A, Day K, Oakes JM: The street level built environment and physical activity and walking: results of a predictive validity study for the Irvine-Minnesota Inventory. Environ Behav. 2011, 43: 735-775. 10.1177/0013916510379760.CrossRef
12.
go back to reference Badland HM, Opit S, Witten K, Kearns RA, Mavoa S: Can virtual streetscape audits reliably replace physical streetscape audits?. J Urban Health. 2010, 87: 1007-16. 10.1007/s11524-010-9505-x.CrossRefPubMedPubMedCentral Badland HM, Opit S, Witten K, Kearns RA, Mavoa S: Can virtual streetscape audits reliably replace physical streetscape audits?. J Urban Health. 2010, 87: 1007-16. 10.1007/s11524-010-9505-x.CrossRefPubMedPubMedCentral
14.
go back to reference Alfonzo M, Boarnet MG, Day K, McMillan T, Anderson CL: The relationship of neighbourhood built environment features and adult parents’ walking. J Urban Des. 2008, 13: 29-51. 10.1080/13574800701803456.CrossRef Alfonzo M, Boarnet MG, Day K, McMillan T, Anderson CL: The relationship of neighbourhood built environment features and adult parents’ walking. J Urban Des. 2008, 13: 29-51. 10.1080/13574800701803456.CrossRef
15.
go back to reference Brownson RC, Hoehner CM, Brennan LK, Cook RA, Elliott MB, McMullen KM: Reliability of two instruments for auditing the environment for physical activity. J Phys Act Health. 2004, 1: 189-207. Brownson RC, Hoehner CM, Brennan LK, Cook RA, Elliott MB, McMullen KM: Reliability of two instruments for auditing the environment for physical activity. J Phys Act Health. 2004, 1: 189-207.
17.
go back to reference Evenson KR, Sotres-Alvarez D, Herring AH, Messer L, Laraia BA, Rodríguez DA: Assessing urban and rural neighborhood characteristics using audit and GIS data: derivation and reliability of constructs. Int J Behav Nutr Phys Act. 2009, 6: 44-10.1186/1479-5868-6-44.CrossRefPubMedPubMedCentral Evenson KR, Sotres-Alvarez D, Herring AH, Messer L, Laraia BA, Rodríguez DA: Assessing urban and rural neighborhood characteristics using audit and GIS data: derivation and reliability of constructs. Int J Behav Nutr Phys Act. 2009, 6: 44-10.1186/1479-5868-6-44.CrossRefPubMedPubMedCentral
18.
go back to reference McCormack GR, Mâsse LC, Bulsara M, Pikora TJ, Giles-Corti B: Constructing indices representing supportiveness of the physical environment for walking using the Rasch measurement model. Int J Behav Nutr Phys Act. 2006, 13: 1-13. 10.1186/1479-5868-3-44. McCormack GR, Mâsse LC, Bulsara M, Pikora TJ, Giles-Corti B: Constructing indices representing supportiveness of the physical environment for walking using the Rasch measurement model. Int J Behav Nutr Phys Act. 2006, 13: 1-13. 10.1186/1479-5868-3-44.
21.
go back to reference Jago R, Baranowski T, Zakeri I, Harris M: Observed environmental features and the physical activity of adolescent males. Am J Prev Med. 2005, 29: 98-104. 10.1016/j.amepre.2005.04.002.CrossRefPubMed Jago R, Baranowski T, Zakeri I, Harris M: Observed environmental features and the physical activity of adolescent males. Am J Prev Med. 2005, 29: 98-104. 10.1016/j.amepre.2005.04.002.CrossRefPubMed
22.
go back to reference Frank LD, Saelens BE, Chapman J, Sallis JF, Kerr J, Glanz K, Couch SC, Learnihan V, Zhou C, Colburn T, Cain KL: Objective assessment of obesogenic environments in youth: geographic information system methods and spatial findings from the Neighborhood Impact on Kids (NIK) Study. Am J Prev Med. 2012, 42 (5): e47-55. 10.1016/j.amepre.2012.02.006.CrossRefPubMed Frank LD, Saelens BE, Chapman J, Sallis JF, Kerr J, Glanz K, Couch SC, Learnihan V, Zhou C, Colburn T, Cain KL: Objective assessment of obesogenic environments in youth: geographic information system methods and spatial findings from the Neighborhood Impact on Kids (NIK) Study. Am J Prev Med. 2012, 42 (5): e47-55. 10.1016/j.amepre.2012.02.006.CrossRefPubMed
23.
go back to reference King AC, Sallis JF, Frank LD, Saelens BE, Cain K, Conway TL, Chapman JE, Ahn DK, Kerr J: Aging in neighborhoods differing in walkability and income: associations with physical activity and obesity in older adults. Soc Sci Med. 2011, 73: 1525-1533. 10.1016/j.socscimed.2011.08.032.CrossRefPubMedPubMedCentral King AC, Sallis JF, Frank LD, Saelens BE, Cain K, Conway TL, Chapman JE, Ahn DK, Kerr J: Aging in neighborhoods differing in walkability and income: associations with physical activity and obesity in older adults. Soc Sci Med. 2011, 73: 1525-1533. 10.1016/j.socscimed.2011.08.032.CrossRefPubMedPubMedCentral
24.
go back to reference Sallis JF, Conway TL, Kerr J, Saelens BE, Frank LD, Glanz K, Slymen DJ, Cain KL, Chapman JC: Adolescents’ Physical Activity as Related to Built Environments: TEAN Study in the US. Presentation at International Society Behavioral Nutrition and Physical Activity conference:. 2011, Melbourne, Australia, June Sallis JF, Conway TL, Kerr J, Saelens BE, Frank LD, Glanz K, Slymen DJ, Cain KL, Chapman JC: Adolescents’ Physical Activity as Related to Built Environments: TEAN Study in the US. Presentation at International Society Behavioral Nutrition and Physical Activity conference:. 2011, Melbourne, Australia, June
25.
go back to reference Frank LD, Sallis JF, Saelens BE, Leary L, Cain K, Conway TL, Hess PM: The development of a walkability index: application to the Neighborhood Quality of Life Study. Br J Sports Med. 2010, 44: 924-933. 10.1136/bjsm.2009.058701.CrossRefPubMed Frank LD, Sallis JF, Saelens BE, Leary L, Cain K, Conway TL, Hess PM: The development of a walkability index: application to the Neighborhood Quality of Life Study. Br J Sports Med. 2010, 44: 924-933. 10.1136/bjsm.2009.058701.CrossRefPubMed
26.
go back to reference Kealey M, Kruger J, Hunter R, Ivey S, Satariano W, Bayles C, Ramirez B, Bryant L, Johnson C, Lee C, Levinger D, Mctigue K, Moni C, Moudon AV, Pluto D, Prohaska T, Sible C, Tindal S, Wilcox S, Winters K, Williams K: Engaging Older Adults to Be More Active Where They Live: Audit Tool Development. Proceedings of the 19th National Conference on Chronic Disease Prevention and Control. 2005, Atlanta, March Kealey M, Kruger J, Hunter R, Ivey S, Satariano W, Bayles C, Ramirez B, Bryant L, Johnson C, Lee C, Levinger D, Mctigue K, Moni C, Moudon AV, Pluto D, Prohaska T, Sible C, Tindal S, Wilcox S, Winters K, Williams K: Engaging Older Adults to Be More Active Where They Live: Audit Tool Development. Proceedings of the 19th National Conference on Chronic Disease Prevention and Control. 2005, Atlanta, March
27.
go back to reference Hoehner CM, Brennan Ramirez LK, Elliott MB, Handy SL, Brownson RC: Perceived and objective environmental measures and physical activity among urban adults. Am J Prev Med. 2005, 28 (2 Suppl 2): 105-16. 10.1016/j.amepre.2004.10.023.CrossRefPubMed Hoehner CM, Brennan Ramirez LK, Elliott MB, Handy SL, Brownson RC: Perceived and objective environmental measures and physical activity among urban adults. Am J Prev Med. 2005, 28 (2 Suppl 2): 105-16. 10.1016/j.amepre.2004.10.023.CrossRefPubMed
29.
go back to reference Cohen J: A coefficient of agreement for nominal scales. Ed Psych Measurement. 1960, 20: 37-46. 10.1177/001316446002000104.CrossRef Cohen J: A coefficient of agreement for nominal scales. Ed Psych Measurement. 1960, 20: 37-46. 10.1177/001316446002000104.CrossRef
30.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
31.
go back to reference Saelens BE, Frank LD, Auffrey C, Whitaker RC, Burdette HL, Colabianchi N: Measuring physical environments of parks and playgrounds: EAPRS instrument development and inter-rater reliability. J Phys Act Health. 2006, 3 (Suppl 1): 190-207. Saelens BE, Frank LD, Auffrey C, Whitaker RC, Burdette HL, Colabianchi N: Measuring physical environments of parks and playgrounds: EAPRS instrument development and inter-rater reliability. J Phys Act Health. 2006, 3 (Suppl 1): 190-207.
32.
go back to reference Shrout PE: Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998, 7: 301-317. 10.1177/096228029800700306.CrossRefPubMed Shrout PE: Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998, 7: 301-317. 10.1177/096228029800700306.CrossRefPubMed
33.
go back to reference Boarnet MG, Day K, Alfonzo M, Forsyth A, Oakes M: The Irvine-Minnesota inventory to measure built environments: reliability tests. Am J Prev Med. 2006, 30: 153-159. 10.1016/j.amepre.2005.09.018.CrossRefPubMed Boarnet MG, Day K, Alfonzo M, Forsyth A, Oakes M: The Irvine-Minnesota inventory to measure built environments: reliability tests. Am J Prev Med. 2006, 30: 153-159. 10.1016/j.amepre.2005.09.018.CrossRefPubMed
34.
go back to reference Brennan Ramirez LK, Hoehner CM, Brownson RC, Cook R, Orleans CT, Hollander M, Barker DC, Bors P, Ewing R, Killingsworth R, Petersmarck K, Schmid T, Wilkinson W: Indicators of activity-friendly communities: an evidence-based consensus process. Am J Prev Med. 2006, 31: 515-24. 10.1016/j.amepre.2006.07.026.CrossRefPubMed Brennan Ramirez LK, Hoehner CM, Brownson RC, Cook R, Orleans CT, Hollander M, Barker DC, Bors P, Ewing R, Killingsworth R, Petersmarck K, Schmid T, Wilkinson W: Indicators of activity-friendly communities: an evidence-based consensus process. Am J Prev Med. 2006, 31: 515-24. 10.1016/j.amepre.2006.07.026.CrossRefPubMed
35.
go back to reference Clifton K, Livi Smith A, Rodriguez D: The development and testing of an audit for the pedestrian environment. Landscape Urban Plan. 2007, 80: 95-110. 10.1016/j.landurbplan.2006.06.008.CrossRef Clifton K, Livi Smith A, Rodriguez D: The development and testing of an audit for the pedestrian environment. Landscape Urban Plan. 2007, 80: 95-110. 10.1016/j.landurbplan.2006.06.008.CrossRef
36.
go back to reference Pikora TJ, Giles-Corti B, Knuiman MW, Bull FC, Jamrozik K, Donovan RJ: Neighborhood environmental factors correlated with walking near home: Using SPACES. Med Sci Sports Exerc. 2006, 38: 708-714. 10.1249/01.mss.0000210189.64458.f3.CrossRefPubMed Pikora TJ, Giles-Corti B, Knuiman MW, Bull FC, Jamrozik K, Donovan RJ: Neighborhood environmental factors correlated with walking near home: Using SPACES. Med Sci Sports Exerc. 2006, 38: 708-714. 10.1249/01.mss.0000210189.64458.f3.CrossRefPubMed
37.
go back to reference Sallis JF, Bowles HR, Bauman A, Ainsworth BE, Bull FC, Craig CL, Sjöström M, De Bourdeaudhuij I, Lefevre J, Matsudo V, Matsudo S, Macfarlane DJ, Gomez LF, Inoue S, Murase N, Volbekiene V, McLean G, Carr H, Heggebo LK, Tomten H, Bergman P: Neighborhood environments and physical activity among adults in 11 countries. Am J Prev Med. 2009, 36: 484-490. 10.1016/j.amepre.2009.01.031.CrossRefPubMed Sallis JF, Bowles HR, Bauman A, Ainsworth BE, Bull FC, Craig CL, Sjöström M, De Bourdeaudhuij I, Lefevre J, Matsudo V, Matsudo S, Macfarlane DJ, Gomez LF, Inoue S, Murase N, Volbekiene V, McLean G, Carr H, Heggebo LK, Tomten H, Bergman P: Neighborhood environments and physical activity among adults in 11 countries. Am J Prev Med. 2009, 36: 484-490. 10.1016/j.amepre.2009.01.031.CrossRefPubMed
Metadata
Title
Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS)
Authors
Rachel A Millstein
Kelli L Cain
James F Sallis
Terry L Conway
Carrie Geremia
Lawrence D Frank
Jim Chapman
Delfien Van Dyck
Lindsay R Dipzinski
Jacqueline Kerr
Karen Glanz
Brian E Saelens
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2013
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-13-403

Other articles of this Issue 1/2013

BMC Public Health 1/2013 Go to the issue