Evaluating effectiveness of various COVID-19 vaccine doses after primary vaccination

First boosters, second boosters, monovalent, bivalent. Just like the SARS-CoV-2 virus strain, the vaccines to combat the virus are always changing—and perhaps confusing.

With the goal of better understanding the variety of vaccines, their effectiveness and take a look at the methods used globally to study vaccines’ effectiveness, a group of University of Michigan researchers, led by Sabir Meah and Bhramar Mukherjee, evaluated some 80 studies and 150 million observations from patient datasets across the world to understand the various designs and methods that were used to study effectiveness of COVID-19 vaccine doses following the primary series vaccination.

They then applied all the methods used in those studies to patient data from Michigan Medicine.

Meah is a School of Public Health alumnus with a master’s degree in biostatistics and currently a biostatistician in urology at Michigan Medicine. Mukherjee is the John D. Kalbfleish Distinguished University Professor of Biostatistics, the Sioban Harlow Collegiate Professor of Public Health, and assistant vice president for research in the Office of the Vice President for Research.

“What we have been able to create is a repository of methods that can be applied for future annual vaccines,” Mukherjee said. “It is important to have robust and reproducible results and reliable estimates of vaccine effectiveness to solidify public trust and fight misinformation.”

Their full study is available in Science Advances. Meah explains more.

From the patient data you reviewed, could you explain your findings around bivalent and monovalent boosters?

In our study, we evaluated three different vaccination regimens: 1) the monovalent booster targeting the original strain, 2) the second monovalent booster also with the original formulation, and 3) the new bivalent vaccine updated in fall 2022 to target newer Omicron variants. We saw that all sequential doses provided a substantial benefit in terms of preventing hospitalization and death, and the estimates from the fall 2022 Omicron specific vaccine dose were stronger from worldwide studies we looked at.

These findings support the practice of periodically updating the COVID-19 vaccines for currently circulating variants. Fortunately, it appears that in the U.S. and many other countries, such as those in the European Union, we will be getting updated COVID-19 vaccines on an annual frequency. The fall 2022 vaccine has already been succeeded by a new updated vaccine in fall 2023, which you can still get now in early 2024, if you haven’t already, targeting the even newer XBB1.5 Omicron variant.

We expect that our conclusions on the utility of updating vaccines should generalize to any updated COVID-19 vaccine, not just the fall 2022 bivalent vaccine, but additional monitoring and study of the real-world effectiveness of an annual vaccine is still necessary, and we hope that the findings of our research can aid these studies. What we have been able to do is to establish an analytic pipeline where researchers can study the vaccine effectiveness of future annual vaccine formulations.

Could you describe what biostatistics brings to the table on this topic?

Biostatistics and epidemiology provide a toolbox for the complex process of evaluating vaccine effectiveness in scientific observational studies. However, there are quite a number of different approaches-both in study design and methods that researchers have employed in vaccine effectiveness studies conducted all over the world, which is what motivated us to conduct our review of their methodology and results and subsequent case study of these methods using Michigan Medicine data.

Quite fortunately, a key finding of our study was that vaccine effectiveness estimates remain relatively stable and do not depend heavily on choice of methods for the outcomes of hospitalization and mortality. We did not observe this advantageous property for infection outcomes, but hospitalization and death are arguably much more important points of study as we advance further into the endemic stage of the pandemic.

Given what your research says about the power of COVID-19 boosters to prevent severe illness and hospitalization, what would you like this study to convey to the public?

COVID-19 vaccines examined in our study, including the fall 2022 bivalent vaccine, provided strong protection against hospitalization and death. We expect this pattern to continue with additional annual vaccines approved by the FDA, but continued study of future vaccines is warranted, and our findings provide some important points of consideration for these future studies.

Co-authors: Xu Shi, Lars Fritsche, Maxwell Salvatore, Abram Wagner, Emily Martin, all of U-M. Their cross-discipline collaboration is part of the School of Public Health’s IDEAS, Interdisciplinary Discovery, Engagement + Actions for Society initiative.