COVID-19 Guidance and Resources


IHI has cultivated COVID-19 guidance and resources that we hope will be helpful for hospital and health system leaders and health care providers.

COVID-19 Data Tracker

​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​Using Shewhart Charts to Understand Variation in COVID-19 Reported Deaths​


​IHI and our colleagues have developed a COVID-19 Data Tracker application showing the reported deaths from COVID-19 globally using Shewhart charts.

Because the Shewhart charts, a cornerstone of improvement methods, are designed to distinguish between common cause (random) and special cause (non-random) variation, they are ideally suited to help decision makers understand if the reported number of daily deaths is predictable within limits or unpredictable (i.e., special cause variation).​

The IHI COVID-19 Data Tracker has Shewhart charts for​: 1) individual countries and 2) US states and territories. 

Shewhart charts are updated daily for each country and each US state and territory. The model tracking the trajectory of COVID-19 reported deaths detects when the number of deaths by geographic location is entering ​rapid exponential growth (Epoch 2) and when exponential growth has ended. We believe that the Shewhart chart approach will prove to be useful to subject matter experts, decision makers, care providers, and the public as they address COVID-19 challenges.


Instructions​

  • View the detailed instructions for the COVID-19 D​ata Tracker to learn how the Data Tracker is organized, key terms used to display the data, and gu​idance on how to navigate the various screens.
  • It is important to understand the key terms used to create and interpret the Shewhart charts​:

     

    • Epochs: Pre-Exponential Growth (Epoch 1); Exponenti​al Growth (Epoch 2); Post-Exponential Growth with flat trajectory or exponential decline (Epoch 3); Stability after descent (Epoch 4)
    • Extensions: When a phase is “active” the upper and lower control limits and center line are extended as reference markers for 10 days
    • Adjusted versus Unadjusted Data: The raw data (unadjusted) reflect the number of deaths submitted by numerous sources tracking COVID-19 deaths, which include “spikes” or extreme data points that do not typify the general historical patterns in the reported data; the Adjusted data attempt to create a more stable stream of data from the various data sources
    • Ghosting unusually large data values: Each daily record is examined to assess if the record is unusually large compared to days preceding and following the record; on the Shewhart charts these unusually large data points are referred to as being “ghosted”
  • Use the Full Screen mode (click arrow icon, bottom right) to see the charts in a full browser window.


Charts for Individual Countries​: COVID-19 Reported Deaths by Country

Select Country: On the far left, click ​the circle to the left of the country name. (Use Full Sc​reen mode to view larger.)

  • Countries are listed in alphabetical order on the left side. Note that the screen opens with the United States ​as a default.
  • The data shown on the chart are Adjusted Data. To view the chart with Unadjusted Data, click on the box in the lower left corner labeled “Click for Unadjusted Daily Deaths.”
  • You can also view the Unadjusted number of reported deaths by clicking on the “2” in the label at the bottom center of the chart that looks like this: <1 of 2>​
  • To view a specific date range on a chart, use the “s​lider” (located along the bottom of the chart) to select the date range you wish to review.​
  • Download detailed instructions

​​

​​​Charts for ​​United States​: COVID-19 Reported Deaths by US ​State and ​Territory

Scroll Through Pages: Use the left/right arrows in the gray area at the bottom to scroll through pages: Summary chart, Adjusted Deaths charts, Unadjusted Deaths charts, and Credits.​ (Use Full Sc​reen mode to view larger.)

  • The charts for the US States and Territories follow a similar layout as outlined above for the Individual Countries, but there are a few additional options​​.
  • Summary: The US Summary chart provides a “system view” of the states and territories that are in each Epoch over time.
  • State/Territory Adjusted and State/Territory Unadjusted: Selecting either option automatically activates a chart showing the states and territories i​n Epoch 1; you can select a specific state's data to review from this screen, and you can also select which Epoch to view​.
  • “What Are Epochs?” (in the lower left corner): Definitions of the four Epochs
  • ​Use the “slider” ​to revise the dates along the horizontal axis and zoom in on a particular time period.​
  • Use the forward (>) or back (<) arrows to switch between the Summary chart (Page 1), Adjusted Deaths charts (Page 2), Unadjusted Deaths charts (Page 3), and Credits (Page 4).
  • Download detailed instructions
​​ ​

​Data Sources

The IHI Data Tracker uses COVID-19 data from the New York Times GitHub site for the US states and territories charts and the Our World in Data site​ for the country-specific data.


Additional Resources

  • Read a more detailed explanation of the methodology behind the Shewhart charts used in this application on the New York Times GitHub site.
  • Read an article that provides a description of initial development of the Shewhart chart application: Understanding variation in reported COVID-19 deaths with a novel Shewhart chart application​ [Perla RJ, Provost SM, Parry GJ, Little K, Provost LP. International Journal for Quality in Health Care. 2021;33(1).]
  • Watch the Science of Improvement Whiteboard videos​ on the IHI website which describe Shewhart charts and their use.
  • For those interested in the details behind Shewhart chart construction and use:
    • The Health Data Guide (Provost L, Murray S. Jossey-Bass Publishers; 2011)
    • Quality Health Care: A Guide to Developing and Using Indicators, 2nd Edition (Lloyd R. Jones & Bartlett Learning; 2019)​

    ​​IHI COVID-19 Data Tracker Team

    Lloyd Provost, Principal Statistician, Associates in Process Improvement​

    Shannon Provost, Lecturer, The University of Texas at Austin

    Rocco Perla, Co-Founder, The Health Initiative

    Kevin Little, Improvement Advisor, Informing Ecological Design, LLC

    Neel Vora, Vice President, Information Technology, Institute for Healthcare Improvement

    Robert Lloyd, Vice President Improvement Science and Senior Improvement Advisor, Institute for Healthcare Improvement

    ​ ​


    For inquiries about navigating and using the IHI COVID-19 Data Tracker, email Robert Lloyd (rlloyd@ihi.org​).

     


    How to Cite This Content: ​COVID-19 Data Tracker: Using Shewhart ​Charts to Understand Variation in COVID-19 Reported Deaths. Boston: Institute for Healthcare Improvement; 2021. (Available on ihi.org)


    For media inquiries, please email Joanna Clark (joanna@cxocommunication.com)