Preschool & child care Quality Rating and Improvement Systems (QRIS)
Evidence Ratings
Scientifically Supported: Strategies with this rating are most likely to make a difference. These strategies have been tested in many robust studies with consistently positive results.
Some Evidence: Strategies with this rating are likely to work, but further research is needed to confirm effects. These strategies have been tested more than once and results trend positive overall.
Expert Opinion: Strategies with this rating are recommended by credible, impartial experts but have limited research documenting effects; further research, often with stronger designs, is needed to confirm effects.
Insufficient Evidence: Strategies with this rating have limited research documenting effects. These strategies need further research, often with stronger designs, to confirm effects.
Mixed Evidence: Strategies with this rating have been tested more than once and results are inconsistent or trend negative; further research is needed to confirm effects.
Evidence of Ineffectiveness: Strategies with this rating are not good investments. These strategies have been tested in many robust studies with consistently negative and sometimes harmful results. Learn more about our methods
Strategies with this rating are likely to work, but further research is needed to confirm effects. These strategies have been tested more than once and results trend positive overall.
Evidence Ratings
Scientifically Supported: Strategies with this rating are most likely to make a difference. These strategies have been tested in many robust studies with consistently positive results.
Some Evidence: Strategies with this rating are likely to work, but further research is needed to confirm effects. These strategies have been tested more than once and results trend positive overall.
Expert Opinion: Strategies with this rating are recommended by credible, impartial experts but have limited research documenting effects; further research, often with stronger designs, is needed to confirm effects.
Insufficient Evidence: Strategies with this rating have limited research documenting effects. These strategies need further research, often with stronger designs, to confirm effects.
Mixed Evidence: Strategies with this rating have been tested more than once and results are inconsistent or trend negative; further research is needed to confirm effects.
Evidence of Ineffectiveness: Strategies with this rating are not good investments. These strategies have been tested in many robust studies with consistently negative and sometimes harmful results. Learn more about our methods
Strategies with this rating are likely to work, but further research is needed to confirm effects. These strategies have been tested more than once and results trend positive overall.
Health factors shape the health of individuals and communities. Everything from our education to our environments impacts our health. Modifying these clinical, behavioral, social, economic, and environmental factors can influence how long and how well people live, now and in the future.
Quality Rating and Improvement Systems (QRIS) are a framework for developing and assessing early child care and education systems. Complete QRIS include quality standards, support and infrastructure to meet standards, financial assistance and incentives, processes to monitor standards and ensure compliance, and public engagement and outreach efforts1, 2. QRIS vary, especially in the quality indicators used and the process for translating indicators into quality ratings. QRIS can be implemented at the local, regional, or state level; some states mandate program participation1, 3.
What could this strategy improve?
Expected Benefits
Our evidence rating is based on the likelihood of achieving these outcomes:
Improved child care quality
Improved preschool quality
What does the research say about effectiveness?
There is some evidence that Quality Rating and Improvement Systems (QRIS) lead to improvements in the quality of participating early child care and preschool programs4, 5, 6, 7, 8. However, additional research is needed to confirm effects.
QRIS appear to validly measure program quality6 and, over time, participating programs appear to improve6, 7, 8, 9. A Florida-based study suggests that teachers in QRIS programs score higher on classroom quality, instructional and emotional support, and literacy environment measures than peers in non-participating programs5. Coaching early educators can facilitate such improvements, especially when coaching programs use defined models and explicit coach selection criteria, support and monitor coaches, and closely link educator lessons to on-site practice10.
In some cases, QRIS is positively associated with increased cognitive skills11 and improved child outcomes12. A Virginia-based validation study of QRIS suggests that children in higher rated pre-kindergarten programs have greater literacy growth than children in programs with lower QRIS ratings; however, growth was not maintained over time13. A Los Angeles-based study suggests that QRIS quality measures are positively associated with children’s school-readiness; however, QRIS ratings computed using those measures are not associated with increases in cognitive, academic, or social child outcomes14. Some QRIS measures such as quality of the learning environment are modestly related to children’s skills; however, neither QRIS measure selection nor the composite rating process has been systematically studied with respect to children’s learning15. Overall, additional evidence is needed to understand the link between QRIS and child outcomes6, 16.
QRIS measures typically assess process oriented and structural indicators such as teachers’ qualifications; researchers suggest QRIS use (or weight more heavily) measures that have been linked to children’s learning such as the quality of teacher-child interactions15. The definitions of QRIS standards, selection of measures, and rating computation process all influence whether program improvements can change the overall QRIS score4. Researchers suggest that QRIS also can become more effective with time as its systemic processes develop and mature5, 8.
QRIS programs are a suggested strategy to incorporate obesity prevention standards into state early childhood care and education systems17.
How could this strategy impact health disparities? This strategy is rated no impact on disparities likely.
Implementation Examples
As of 2017, 38 states have statewide Quality Rating and Improvement Systems (QRIS). In addition, Washington, D.C. has a district wide QRIS program, one state and three U.S. territories have launched pilot programs, seven states are planning such programs, and three have regional QRIS programs18. As of 2016, 29 states with QRIS programs also include obesity prevention efforts in their state QRIS standards19, and 20 states have at least one QRIS standard that aligns with high-impact obesity prevention components, typically related to physical activity, screen time, or nutrition17.
Some states have evaluated their QRIS, but evaluation breadth and focus varies greatly16. A Colorado-based study indicates that classrooms in the same center can vary significantly in quality. Researchers therefore recommend that QRIS administrators consider evaluating multiple classrooms in the same center, balancing the benefits of more accurate ratings against the cost of additional evaluation20.
Implementation Resources
QRIS - National Center on Early Childhood Quality Assurance, U.S. Department of Health and Human Services, Administration for Children and Families. Quality Rating and Improvement System (QRIS) resource guide.
Quality Compendium-QRIS - Quality Compendium, Build Initiative. A catalog and comparison of quality initiatives like Quality Rating and Improvement Systems (QRIS).
OPRE-Tout 2013 - Tout K, Starr R. Key elements of a QRIS validation plan: Guidance and planning template. OPRE 2013-11. Washington, D.C.: Office of Planning, Research and Evaluation (OPRE), Administration for Children and Families (ACF), U.S. Department of Health and Human Services (U.S. DHHS); 2013.
OPRE-Kirby 2011 - Kirby G, Boller K, Zaveri H. Child care quality rating and improvement systems: Approaches to integrating programs for young children in two states. OPRE Report 2011-28. Washington, D.C.: U.S. Department of Health and Human Services (U.S. DHHS), Administration for Children and Families (ACF), Office of Planning, Research and Evaluation (OPRE); 2011.
Faria 2016 - Faria AM, Greenberg A, Hawkinson L, Metzger I. Development and implementation of quality rating and improvement systems in Midwest Region states (REL 2016–143). Washington, D.C.: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Midwest. 2016.
Footnotes
* Journal subscription may be required for access.
1 QRIS - National Center on Early Childhood Quality Assurance, U.S. Department of Health and Human Services, Administration for Children and Families. Quality Rating and Improvement System (QRIS) resource guide.
2 Child Trends 2010 - Child Trends-QRIS 2010. Quality rating and improvement systems (QRIS) for early care and education. Child Trends: Early Childhood Highlights. 2010;1(1):1–4.
3 Hallam 2017 - Hallam R, Hooper A, Bargreen K, Buell M, Han M. A two-state study of family child care engagement in quality rating and improvement systems: A mixed-methods analysis. Early Education and Development. 2017;28(6):669-683.
4 Boller 2015 - Boller K, Paulsell D, Grosso PD, et al. Impacts of a child care quality rating and improvement system on child care quality. Early Childhood Research Quarterly. 2015;30(Part B):306-315.
5 Jeon 2014 - Jeon L, Buettner CK, Hur E. Examining pre-school classroom quality in a statewide quality rating and improvement system. Child & Youth Care Forum. 2014;43(4):469-487.
6 OPRE-Tout 2010 - Tout K, Starr R, Soli M, et al. Compendium of quality rating systems and evaluations. Washington, D.C.: Office of Planning, Research and Evaluation (OPRE), Administration for Children and Families (ACF), U.S. Department of Health and Human Services (U.S. DHHS); 2010.
7 Tout 2011 - Tout K, Starr R, Isner T, et al. Evaluation of parent aware: Minnesota’s quality rating and improvement system pilot. Washington, D.C.: Child Trends; 2011.
8 Ma 2011 - Ma X, Shen J, Kavanaugh A, et al. Effects of quality improvement system for child care centers. Journal of Research in Childhood Education. 2011;25(4):399-414.
9 RAND-Zellman 2008 - Zellman GL, Perlman M, Le V-N, Setodji CM. Assessing the validity of the Qualistar Early Learning quality rating and improvement system as a tool for improving child-care quality. Santa Monica: RAND Corporation; 2008.
10 OPRE-Zaslow 2012 - Zaslow M, Tout K, Halle T. On-site approaches to quality improvement in quality rating and improvement systems: Building on the research on coaching, research-to-policy, research-to-practice brief OPRE 2012-40. Washington, D.C.: Office of Planning, Research and Evaluation (OPRE), Administration for Children and Families (ACF), U.S. Department of Health and Human Services (U.S. DHHS); 2012.
11 Jeon 2015 - Jeon L, Buettner CK. Quality rating and improvement systems and children’s cognitive development. Child & Youth Care Forum. 2015;44(2):191-207.
12 Hestenes 2015 - Hestenes LL, Kintner-Duffy V, Wang YC, et al. Comparisons among quality measures in child care settings: Understanding the use of multiple measures in North Carolina’s QRIS and their links to social-emotional development in preschool children. Early Childhood Research Quarterly. 2015;30(Part B):199-214.
13 Sabol 2015 - Sabol TJ, Pianta RC. Validating Virginia’s quality rating and improvement system among state-funded pre-kindergarten programs. Early Childhood Research Quarterly. 2015;30(Part B):183-198.
14 Hong 2015 - Hong SLS, Howes C, Marcella J, Zucker E, Huang Y. Quality rating and improvement systems: Validation of a local implementation in LA County and children’s school-readiness. Early Childhood Research Quarterly. 2015;30(Part B):227-240.
15 Sabol 2013 - Sabol TJ, Soliday Hong SL, Pianta RC, Burchinal MR. Can rating pre-K programs predict children’s learning? Science. 2013;341(6148):845-846.
16 Tout 2013 - Tout K. Look to the stars: Future directions for the evaluation of quality rating and improvement systems. Early Education & Development. 2013;24(1):71–8.
17 Geary 2017 - Geary NA, Dooyema CA, Reynolds MA. Supporting obesity prevention in statewide quality rating and improvement systems: A review of state standards. Preventing Chronic Disease. 2017;14(E129):160518.
18 QRIS-State information - National Center on Early Childhood Quality Assurance, U.S. Department of Health and Human Services, Administration for Children and Families. Quality Rating and Improvement System (QRIS) resource guide: State information.
19 CDC-ECE state 2016 - Centers for Disease Control and Prevention (CDC). Early Care and Education (ECE) State Indicator Report 2016.
20 Karoly 2013 - Karoly LA, Zellman GL, Perlman M. Understanding variation in classroom quality within early childhood centers: Evidence from Colorado’s quality rating and improvement system. Early Childhood Research Quarterly. 2013;28(4):645–57.
To see citations and implementation resources for this strategy, visit:
countyhealthrankings.org/strategies-and-solutions/what-works-for-health/strategies/preschool-child-care-quality-rating-and-improvement-systems-qris
To see all strategies:
countyhealthrankings.org/whatworks