Frequently Asked Questions
When printing county snapshots with the "Areas to Explore" highlighting turned on, you may find that the colors used to highlight these areas don't print. This is a browser specific issue for Internet Explorer and Firefox. These browsers will not print background colors or images by default, as these frequently take much more ink and can serve to obscure the foreground text on a black-and-white printout. Here are the steps you can take to resolve this:
- Open either Internet Explorer or Firefox
- Press "ALT" to display the File menu.
- Click "File" then "Page Setup."
- Place a checkmark in the "Print Background Colors and Images" in the dialog.
- Click "OK" and print the Web page.
We are happy to provide copies of both of these graphics for your use: County Health Rankings model and our Take Action graphic. If you use these images in a publication, please use the following citation:
University of Wisconsin Population Health Institute. County Health Rankings & Roadmaps 2016. www.countyhealthrankings.org.
- Raising awareness in the general community about the multiple factors that influence health via media interviews and follow-up conversations.
- Initiating community health assessment and planning efforts where none previously existed.
- Celebrating successes and promoting existing community health improvement efforts.
- Informing policy makers, particularly Local Boards of Health, about the many factors that affect a community's health and about community health improvement planning.
- Revitalizing or refining existing community health assessment and improvement plans.
- Citing the County Health Rankings as justification in securing grant funding to conduct community health improvement efforts and/or to address the determinants of health.
Visit the Community Stories section to learn more.
There is not one formula for where communities should put their efforts. Because the County Health Rankings are based on broad measures and include multiple years of data, it is important for communities to look at further information prior to making a decision about next steps. Learn more about how to assess your community's needs and resources via the Roadmaps to Health Action Center.
America’s Health Rankings ranks the health of states -- we have tried to align our measures as closely as possible with these Rankings.
The purpose of the County Health Rankings is to compare counties within states. We discourage comparisons between states for several reasons:
- The County Health Rankings are not intended to be a national report that finds the 10 or 15 least healthy counties in the nation and focuses only on that. The Rankings are intended to provide a tool for communities in each state as a call to identify opportunities for improvement
- We focus on state-specific county rankings, and we do not provide any county rankings across state boundaries.
- A few of the measures that we use are state-specific and make comparisons across state boundaries difficult.
The County Health Rankings are designed as a call to action – the use of ranks can often serve as a more effective tool for drawing attention to community health issues than lengthy listings of indicators. We encourage any community that has not already done so to use the Rankings as a stimulus to engage community members in a more detailed community health assessment, using whatever additional data sources they have available. The Rankings can be used as a pointer to suggest areas where more in-depth analysis might be helpful.
We believe that there are two separate sets of messages to convey. One set (Health Outcomes) addresses how healthy a county currently is and the other (Health Factors) addresses how healthy a county might be in the future based on the many factors that influence health. However, when a single ranking of the “healthiest” counties is desired, we use the Health Outcomes rank.
To serve as a call to action for communities to:
- Understand the health problems in their community
- Get more people involved in improving the health of communities
- Recognize that factors outside medical care influence health
Ranking the health of counties using not only traditional health outcomes, but also the broad range of health factors, can mobilize action on the part of governmental public health and in many other sectors that can influence and are affected by health.
The county-level estimates based on BRFSS data are calculated for the County Health Rankings by staff at the Centers for Disease Control and Prevention.
The Behavioral Risk Factor Surveillance System (BRFSS) is a state-based random digit dial (RDD) telephone survey that is conducted annually in all states, the District of Columbia, and U.S. territories. Data obtained from the BRFSS are representative of each state’s total non-institutionalized population over 18 years of age and has included more than 400,000 annual respondents with landline telephones or cellphones since 2011. Data are weighted using iterative proportional fitting (also called "raking") methods to reflect population distributions. For the County Health Rankings, data from the BRFSS are used to measure various health behaviors and health-related quality of life (HRQoL) indicators. HRQoL measures are age-adjusted to the 2000 U.S. standard population.
Prior to the 2016 County Health Rankings, up to seven survey years of landline only BRFSS data were aggregated to produce county estimates. However, even with multiple years of data, these did not provide reliable estimates for all counties, particularly those with smaller respondent samples. For the 2016 County Health Rankings, the CDC produced 2014 county estimates using single-year 2014 BRFSS data and a multilevel modeling approach based on respondent answers and their age, sex and race/ethnicity, combined with county-level poverty and county and state level contextual effects1. To produce estimates for those counties where there was no or limited data, the modeling approach borrowed information from the entire BRFSS sample as well as Census Vintage 2014 population estimates. CDC used a parametric bootstrapping method to produce standard errors and confidence intervals for those point estimates. This estimation methodology was validated for all U.S. counties, including those with no or small (<50 respondents) samples2.
One limitation of the BRFSS is that all measures are based on self-reported information, which cannot be validated with medical records. Another limitation is that these model-based estimates were created by borrowing information from the entire BRFSS, which may or may not accurately reflect those counties’ local intervention experiences. Additionally, the confidence intervals constructed from these methods appear much smaller than confidence intervals reported for direct survey methods in previous years.
- Zhang X, Holt JB, Lu H, Wheaton AG, Ford ES, Greenlund K, Croft JB. Multilevel regression and poststratification for small-area estimation of population health outcomes: a case study of chronic obstructive pulmonary disease prevalence using the Behavioral Risk Factor Surveillance System. American Journal of Epidemiology 2014;179(8):1025–1033.
- Zhang X, Holt JB, Yun, S, Lu H, Greenlund K, Croft JB. Validation of multilevel regression and poststratification methodology for small area estimation of health outcomes. American Journal of Epidemiology 2015;182(2):127-137.
CDC’s decision to move to this new method for the BRFSS was based on their desire to provide more reliable and current county-level estimates (due to the inclusion of cell phone only users) for all counties. (Previously, even using seven years of data, there were many counties where there were not enough BRSS respondents to provide any estimates). We knew that this might lead to differences in estimates of varying size. Our best advice for counties with unexpectedly large changes is to look to other sources of estimates of people’s quality of life and health behaviors and examine all the results together. You may want to look at the Premature Death data included in your snapshot to understand how trends in mortality align with your new estimates of quality of life. Counties might also want to consider consulting any existing locally based data sources, e.g., hospitals or health care systems that conduct their own surveys or gather information in electronic health records. One area of last resort might be to conduct your own survey – although web-based or text-based surveys come with their own limitations, they can be a relatively inexpensive way to gather data from residents.
Here are a few things we know about the new estimates that might help you interpret the changes you are seeing in the BRFSS measure estimates and your rank:
• The prior estimates did not include any survey responses from people who only use a cellphone. More than 2 in 5 households no longer have landline telephones. Research from the mid-2000s showed that cellphone only users exhibited different health behaviors than people using landline telephones.
• The new estimates rely both on responses from people surveyed in each county, but also draw on information from the state as whole (based on some demographic characteristics and the level of poverty). In this way, the new estimates help to address missing information by using data from similar geographic and demographic places. However, in doing so, the new estimates may mask the unique, local conditions that modify rates in your community, such as religious affiliations or smoking ordinances.
• Overall, this new method created fewer counties with extremely good and extremely bad values. Most county’s values are closer to the state average than they were using past estimates. Many of the counties that see more variability in estimates from year to year are rural, with the variability being due, in part, to low sample sizes. Our analysis affirms this showing that more rural counties are seeing large changes in their BRFSS estimates this year.
This year, your county may have seen substantial changes in the rankings for Health Outcomes, Health Factors, or both as compared to last year. We anticipated that these changes might occur because one of the sources of information used to determine rankings has changed their methods. The Centers for Disease Control and Prevention (CDC) provides information from a survey called the Behavioral Risk Factor Surveillance System (BRFSS). The BRFSS informs the following Rankings measures: Health Outcomes (fair or poor health, mentally unhealthy days, and physically unhealthy days) and Health Factors (adult smoking and excessive drinking) measures. The CDC is using a new method to estimate these measures for your county. If you are interested in the technical aspects of this method, please see this article. This new method may lead to different estimates and ultimately may be what is driving the changes you see in your rank.
You may be wondering which estimates are “right” – the estimates from the 2015 rankings or the new estimates? Does the new method give us better estimates than before? The reality is that we can never truly know the right answers unless we could observe the behavior of every adult in the county. For example, to know the true percentage of adult smokers, we would need to determine the smoking status of every single adult in your area. This, however, would be difficult and costly. So, statistical methods are used to estimate the percentage of adult smokers in the community based on the information that is available. Each method used has benefits and drawbacks that are carefully considered in the context of the population sampled. It is most likely that the real numbers of your measures are somewhere in between last year’s and this year’s estimates.
Our trends are estimated using linear regression for all of the years of data included in the graph. This sometimes creates unusual situations, particularly when a measure both improves and worsens over the time period. For example, in many counties, unemployment increased dramatically between 2007 and 2011. Since then, in many counties, unemployment rates have been improving. However, the overall trend for the county depends on the relative magnitude of worsening to improvement. For example, even if your county has had improving rates over the past 3 years, but had higher rates of worsening in the years prior, it might show a worsening trend.
The Areas to Explore and Areas of Strength features highlight measures that, respectively, are potential challenges your community may want to examine more closely and measures that are assets in your community already. Accounting for the relative influence of each measure on health outcomes, the County Health Rankings team used a variety of techniques to identify the Health Factor measures for your county that seem to have the greatest potential opportunity for improvement or are the assets your community might want to build on. We identified measures where there are meaningful differences between your county's values and either your state average, the national benchmark, or the state average in the best state.
As with your county’s ranks, these Areas to Explore are just one starting point for you to consider in your journey toward improving health in your community. Using the Rankings Data provides suggestions for other sources of state and local data that you can use to examine these measures more closely.
No, many of the measures were calculated for the County Health Rankings by other organizations. For example, measures from the National Vital Statistics System and the Behavioral Risk Factor Surveillance System were calculated by staff at the National Center for Health Statistics/Centers for Disease Control and Prevention. Similarly, the health care quality measures were calculated for us by the Dartmouth Institute.
The most frequent reason why numbers of the Rankings web site may not match other numbers that states have will be due to different definitions of measures, different time periods, or different samples or denominators. Communities should rely on their own state's data for their own more detailed community health assessments.
Each year's data are weighted equally.
Some counties in the nation are too small to have reliable measurements for health outcome measures. Those counties are not ranked. If a county has data for enough measures to be ranked but is missing data for any individual measure, we assign the county the same value as the state mean for that measure. One way to overcome unstable and unreliable estimates due to small numbers, such as with the measures from the Behavioral Risk Factor Surveillance System (BRFSS), is to combine multiple years of data. This means that although the Rankings are useful for differentiating between places that are and are not healthy, they are not a good tool for setting objectives and tracking progress from year to year.
In part, the County Health Rankings aim to show that where you live matters to your health and that disparities exist within every state. But disparities exist within most counties as well. We encourage communities to use the Rankings as a starting point to delve more deeply into data that may highlight disparities within counties. Communities can do this by initiating a community health assessment or using the Rankings to draw attention to thorough assessments that have already been done. We have provided information in our guide to Using the Rankings Data for communities that need help getting started.
Each county's ranks are calculated within a specific state so you cannot compare your county's ranks with those for a county in a different state. However, you can compare the values for the Health Outcomes measures from one state to another. We advise caution in comparing the Health Factors measures across states because our measures for Health Factors are only uniform within states not across states. Users should refer to our guidelines for comparing measures across states to find the differences that occur for some measures (such as high school graduation rates and violent crime). Although the County Health Rankings data tool does not include an online feature for comparing counties in different states, users can print out the “snapshots” for adjoining counties in different states to look for similarities and differences in the measures across the counties.