Refrigerator Door Opening Field Study
We are requesting your help in gathering real-world data about the vaccine storage needs of providers. Vaccine providers face a diverse range of conditions at clinics, private practices, and hospitals around the country. Before we can prescribe realistic criteria for grading and testing vaccine storage equipment at the manufacturer-level, we need to understand how vaccine storage units are used on a daily basis.
Currently, vaccine providers and program administrators face significant challenges as they navigate the selection and purchase of effective vaccine storage equipment. It is not always clear whether a particular refrigerator or freezer will meet a provider’s needs. The creation of an NSF standard for vaccine storage equipment will serve to demystify this process for end-users.
The goal of this study is to record the frequency and duration of refrigerator door opening at a sampling of pharmacies and provider office locations. This will provide concrete data on real-world usage of vaccine storage units. The study does not involve temperature monitoring of vaccine refrigerators. The results of the study will be used to draft an equipment testing protocol for the new NSF vaccine storage equipment standard. The outcome will not impact routine policies or requirements for providers. Ultimately, this standard will drive future market developments and emerging technologies in the field of provider-level vaccine cold chain maintenance.
- Study Guidelines (PDF)
- Participant Questionnaire (PDF)
- Contacts: Michal Chojnacky and Alexandra Rodriguez
The efficacy of stored vaccine is critically dependent on storage and handling practices, including the use of reliable temperature monitoring methods and properly controlled storage systems. The absence of those protections can result in substantial waste, diminished vaccine potency, and the need for revaccination.
NIST's Thermodynamic Metrology Group evaluated the Centers for Disease Control and Prevention (CDC) cold-chain management systems and methods for the Vaccines for Children Program (VFC) under conditions that replicate typical practices of vaccine providers.
The NIST scientists systematically uncovered key factors causing widespread problems. They identified suitable commercial refrigerators for vaccine storage; evaluated the impact of operating conditions on refrigerator performance; determined proper placement of thermometers to monitor temperature; utilized continuous temperature data collection to detect previously unrecognized thermal excursions; and developed improved cold-chain management practices.
The project began in 2009 when CDC officials approached NIST to investigate storage and temperature monitoring issues that were causing significant losses from discarded and potentially ineffective VFC vaccines -- a program that distributes approximately $4 billion worth of vaccines annually to low-income families via more than 44,000 VFC providers.
Refrigerator temperature control, proper storage methods, and effective continuous temperature monitoring systems are critical to maintaining vaccine potency. Temperature excursions outside the normal range of 2 °C to 8 °C render many vaccines ineffective. A meta-analysis published in the journal Vaccine, including studies published in more than 20 countries, estimated that 14% to 35% of vaccines are subjected to accidental freezing – the largest source of vaccine loss. Additional, undocumented temperature excursions may also occur, creating the potential for ineffective vaccines to be unknowingly passed on to patients.
Future activities in the NIST project include: evaluating different types of freezer systems used to store vaccines at temperatures below –15 °C; examining the kinetic temperature of vaccine fluid (contained in vials and syringes) to determine the optimal amount of glycol or other non-toxic buffer medium needed to mimic vaccine fluid temperature; and characterizing the different types of digital thermometers needed for vaccine cold chain management.
- Optimizing Data Logger Setup and Use for Refrigerated Vaccine Temperature Monitoring NCSLI Measure 1, Meas. Sci. (2015)
- NIST Interagency Report 7753 – Thermal Analysis of Household Refrigerator/Freezer and Pharmaceutical Refrigerator for Vaccine Storage
- NIST Interagency Report 7656 – Thermal Analysis of a Dorm-style Refrigerator and Freezerless Refrigerator for Vaccine Storage
- Guidelines for Storage and Temperature Monitoring of Refrigerated Vaccines
- Covers the selection, setup, and proper use of a vaccine storage refrigerator and temperature monitoring device (e.g., data logger).
- Ice Melting Point Validation Method for Data Loggers
- An inexpensive, fast, and easy way to validate a digital data logger for temperature measurement with an uncertainty of ±0.01 °C. Step-by-step photos and instructions are provided.
- NIST Interagency Report 7899 - Data Logger Thermometers for Vaccine Temperature Monitoring
- NIST Interagency Report 7900 - Thermal Analysis of a Small Pharmaceutical Refrigerator for Vaccine Storage
- Assessing the Use of Infrared Thermometers for Vaccine Temperature Determination
- Video Tutorial: Ice Melting Point Validation Method for Data Loggers
- National Immunization Conference (NIC) Online 2012 – Accurate Cold Chain Temperature Monitoring Using Digital Data Logger Thermometers
- CDC video presentation. Raymond Strikas discusses appropriate storage and handling of vaccines.
- NIC Online 2012 – NIST Case Study: Dual-zone Unit for Simultaneous Refrigerated and Frozen Vaccine Storage
- NIC 45 – Cold Chain Management: Temperature Monitoring Solutions
- NIC-44 – Thermal Analysis of Refrigeration Systems Used for Vaccine Storage
- Vaccine University 2010
The documents, presentations, and tutorials developed for the CDC VFC program and listed above provide a basic understanding of proper cold chain management designed to reduce vaccine waste and prevent ineffective inoculations.