A Review and Autopsy of Two COVID Immunity Studies

A Review and Autopsy of Two COVID Immunity Studies

How effective is immunity after COVID recovery relative to vaccination? An Israeli study by Gazit et al. found that the vaccinated have a 27 times higher risk of symptomatic infection than the COVID recovered. At the same time, the vaccinated were nine times more likely to be hospitalized for COVID. In contrast, a CDC study by Bozio et al. claims that the COVID recovered are five times more likely to be hospitalized for COVID than the vaccinated. Both studies cannot be right.

I have worked on vaccine epidemiology since I joined the Harvard faculty almost two decades ago as a biostatistician. I have never before seen such a large discrepancy between studies that are supposed to answer the same question. In this article, I carefully dissect both studies, describe how the analyses differ, and explain why the Israeli study is more reliable.

The Israeli Study

In the Israeli study, the researchers tracked 673,676 vaccinated people who they knew not to have had COVID and 62,833 unvaccinated COVID-recovered individuals. A simple comparison of the rates of subsequent COVID in these two groups would be misleading. The vaccinated are likely older and, hence, more prone to have symptomatic disease, giving the Covid recovered group an unfair advantage. At the same time, the typical vaccinated patient received the vaccine long after the typical COVID-recovered patient got sick. Most COVID recovered patients got the infection before the vaccine was even available. Because immunity wanes over time, this fact would give an unfair advantage to the vaccinated group.

To make a fair and unbiased comparison, researchers must match patients from the two groups on age and time since vaccination/disease. That is precisely what the study authors did, matching also on gender and geographical location.

For the primary analysis, the study authors identified a cohort with 16,215 individuals who had recovered from COVID and 16,215 matched individuals who were vaccinated. The authors followed these cohorts over time to determine how many had a subsequent symptomatic COVID disease diagnosis.

Ultimately, 191 patients in the vaccinated group and 8 in the COVID recovered group got symptomatic COVID disease. These numbers mean that the vaccinated were 191/8=23 times more likely to have subsequent symptomatic disease than the COVID recovered. After adjusting the statistical analysis for comorbidities in a logistic regression analysis, the authors measured a relative risk of 27 with a 95 percent confidence interval between 13 and 57 times more likely for the vaccinated.

The study also looked at COVID hospitalizations; eight were in the vaccinated group, and one among the COVID recovered. These numbers imply a relative risk of 8 (95 percent CI: 1-65). There were no deaths in either group, showing that both the vaccine and natural immunity provide excellent protection against mortality.

This is a straightforward and well-conducted epidemiological cohort study that is easy to understand and interpret. The authors addressed the major source of bias through matching. One potential bias they did not address (as it is challenging to do) is that those with prior COVID may have been more likely to be exposed in the past through work or other activities. Since they were more likely to be exposed in the past, they may also have been more likely exposed during the follow-up period. That would lead to an underestimate of the relative risks in favor of vaccination. There may also be misclassification if some of the vaccinated unknowingly had COVID. That would also lead to an underestimate.

The CDC Study

The CDC study did not create a cohort of people to follow over time. Instead, they identified people hospitalized with COVID-like symptoms, and then they evaluated how many of them tested positive versus negative for COVID. Among the vaccinated, five percent tested positive, while it was nine percent among the COVID recovered. What does this mean?

Though the authors do not mention it, they adopt a de facto case-control design. While not as strong as a cohort study, this is a well-established epidemiological design. The first study to show that smoking increases the risk of lung cancer used a case-control design. They compared hospitalized patients with lung cancer and found more smokers in that group compared to non-cancer patients, who served as controls. Note that if they had restricted the control group to people with (say) heart attacks, they would have answered a different question: whether smoking is a larger risk factor for lung cancer than it is for heart attacks. Since smoking is a risk factor for both diseases, such a risk estimate would differ from the one they found.

In the CDC study on COVID immunity, the cases are those patients hospitalized for COVID disease, having both COVID-like symptoms and a positive test. That is appropriate. The controls should constitute a representative sample from the population from which the COVID patients came. Unfortunately, that is not the case since COVID-negative people with COVID-like symptoms, such as pneumonia, tend to be older and frailer with comorbidities. They are also more likely to be vaccinated.

Suppose we wanted to know whether the vaccine rollout successfully reached not only the old but also frail people with comorbidities. In that case, we could conduct an age-adjusted cohort study to determine if the vaccinated were more likely to be hospitalized for non-COVID respiratory problems such as pneumonia. That would be an interesting study to do.

The problem is that the CDC study answers neither the direct question of whether vaccination or COVID recovery is better at decreasing the risk of subsequent COVID disease, nor whether the vaccine rollout successfully reached the frail. Instead, it asks which of these two has the greater effect size. It answers whether vaccination or COVID recovery is more related to COVID hospitalization or if it is more related to other respiratory type hospitalizations.

Let’s look at the numbers. Of the 413 cases (i.e., COVID positive patients), 324 were vaccinated, while 89 were COVID recovered. That does not mean that the vaccinated are at higher risk since there may be more of them. To put these numbers in context, we need to know how many in the background population were vaccinated versus COVID recovered. The study does not provide or utilize those numbers, although they are available from at least some of the data partners, including HealthPartners and Kaiser Permanente. Instead, they use COVID-negative patients with COVID like symptoms as their control group, of which there were 6,004 vaccinated, and 931 COVID recovered. With these numbers in hand, we can calculate an unadjusted odds ratio of 1.77 (not reported in the paper). After covariate adjustments, the odds ratio becomes 5.49 (95 percent CI: 2.75-10.99).

Ignoring covariates for the moment, we will look at the unadjusted numbers in more detail for illustrative purposes. The paper does not report how many vaccinated and COVID recovered people there are in the population at risk for hospitalization with COVID-like symptoms. If there were 931,000 COVID recovered and 6,004,000 vaccinated (87 percent), then the proportions are the same as among the controls, and the results are valid. If, instead, there were (say) 931,000 COVID recovered and 3,003,000 vaccinated (76 percent), then the odds ratio would be 0.89 instead of 1.77. There is no way to know the truth without those baseline population numbers unless one is willing to assume that those hospitalized for COVID-like symptoms without having COVID are representative of the background population, which they are unlikely to be.

With a background population to define a cohort, one must still adjust for age and other covariates as in the Israeli study. Some may argue that the COVID negative hospitalized patients with COVID-like symptoms are a suitable control group because they provide a more representative sample of the population at risk of COVID hospitalization. That may be partially true compared to an unadjusted analysis, but the argument is incorrect as it does not address the key issue of the relevant medical question being asked. There is both a relationship between being vaccinated/recovered and COVID hospitalization and a relationship between being vaccinated/recovered and non-COVID hospitalization. Rather than evaluate the first one, which is of intense interest for health policy, the CDC study evaluates the contrast between the two, which is not particularly interesting.

The CDC study adjusts for covariates such as age, but the procedure does not resolve this fundamental statistical issue and may even exacerbate it. Frail people are more likely to be vaccinated, while active people are more likely to have been COVID recovered, and neither of those are properly adjusted for. With the contrast analysis, there is also more confounding that must be adjusted for: both the confounding related to the exposures and COVID hospitalizations and the confounding related to the exposures and non-COVID hospitalizations. This increases the potential for biased results.

While not the main problem, there is one other curious fact about the paper. Covariate adjustments will typically change the point estimates somewhat, but it is unusual to see a change as large as the one from 1.77 to 5.49 that was observed in the CDC study. How can this be explained? It must be because some covariates are very different between the cases and controls. There are at least two of them. While 78 percent of the vaccinated are older than 65, 55 percent of the COVID recovered are younger than 65. Even more concerning is the fact that 96 percent of the vaccinated were hospitalized during the summer months of June to August, while 69 percent of the COVID recovered were hospitalized in the winter and spring months from January to May. Such unbalanced covariates are usually best adjusted for using matching as in the Israeli study.

Epidemiologists typically rely on case-control studies when data are unavailable for a whole cohort. For example, in nutritional epidemiology, researchers often compare the eating habits of patients with a disease of interest versus a sample of representative healthy controls. Following the eating habits of a cohort over long periods is too unwieldy and costly, so a questionnaire-based case control study is more efficient. For this immunity study, there is no rationale for a case-control study since cohort data are available from multiple CDC data partners. It is surprising that CDC chose this case-control design rather than the less biased cohort design selected by the Israeli authors. Such an analysis would answer the question of interest and may have given a different result more in line with the Israeli study.

Should the Covid Recovered be Vaccinated?

The Israeli study also compared COVID recovered with and without the vaccine. Both groups had very low COVID risk, but the vaccinated had a 35 percent lower risk for symptomatic disease (95 percent CI: 65 percent lower to 25 percent greater), which could be indicative that there is also a lower risk for hospitalizations. While not statistically significant, vaccines may provide some additional protection above the already strong protection from natural immunity. If confirmed by other studies, it is then a question of benefits and risks, also taking vaccine adverse reactions into account. For a high-risk person, a 35 percent reduction is a significant benefit, although much less than the efficacy of the vaccine for those that have not had COVID. For a low-risk person, which includes most people with natural immunity, a 35 percent risk reduction is more marginal in terms of absolute risk.

As an illustration of this concept, a daily concoction that reduced cancer risk by 35 percent would be a miracle drug of enormous importance that everyone should take even if it tasted terrible. On the other hand, a cumbersome walking device that reduced the risk of being killed by lightning by 35 percent would not be appealing. The risk is already minuscule without the device. This example illustrates the importance of not only looking at relative risks but also at absolute and attributable risks.

Conclusions

Concerning the COVID recovered, there are two key public health issues. 1. Would the COVID recovered benefit from also being vaccinated? 2. Should there be vaccine passports and mandates that require them to be vaccinated in order to work and participate in society?

The CDC study did not address the first question, while the Israeli study showed a small but not statistically significant benefit in reducing symptomatic COVID disease. Future studies will hopefully shed more light on this issue.

Based on the solid evidence from the Israeli study, the COVID recovered have stronger and longer-lasting immunity against COVID disease than the vaccinated. Hence, there is no reason to prevent them from activities that are permitted to the vaccinated. In fact, it is discriminatory.

Many of the COVID recovered were exposed to the virus as essential workers during the height of the pandemic before vaccines were available. They kept the rest of society afloat, processing food, delivering goods, unloading ships, picking up garbage, policing the streets, maintaining the electricity network, putting out fires, and caring for the old and sick, to name a few.

They are now being fired and excluded despite having stronger immunity than the vaccinated work-from-home administrators that are firing them.


This article was reprinted with the author’s permission. It was originally published by the Brownstone Institute. Martin Kulldorff, Senior Scholar of Brownstone Institute, is a professor of medicine at Harvard Medical School.

If you would like to receive an e-mail notice of the most recent articles published in The Vaccine Reaction each week, click here.

Note: This commentary provides referenced information and perspective on a topic related to vaccine science, policy, law or ethics being discussed in public forums and by U.S. lawmakers.  The websites of the U.S. Department of Health and Human Services (DHHS) provide information and perspective of federal agencies responsible for vaccine research, development, regulation and policymaking.

...

10 Responses to "A Review and Autopsy of Two COVID Immunity Studies"

  1. Stephen Joseph Sanborn   November 8, 2021 at 4:03 pm

    Before anyone gets this vaccine,they should ask the medical person,”what is the ingredient in this vaccine that prevents me from getting the coronavirus”?
    The reason you won’t get an answer is because there isn’t any.

    Reply
    • Tom   November 8, 2021 at 5:26 pm

      How true. There is no informed consent because there is nothing to consent to other than a quicker death by injection.

      Reply
  2. SH   November 8, 2021 at 6:51 pm

    Dr. Kulldorff, you have contributed to the current situation and continue to do so in stating reduced childhood vaccinations are a negative result of the lockdowns. It takes very little effort to research the same censored science there, that allowed us to get here. Please do due diligence and consider this has been a long game you were a participant in playing.

    Reply
  3. TH   November 9, 2021 at 12:40 am

    Well done, someone else is taking this serious and not just taking what is being force fed to us. I just looked at two regions in India, one is using a trace and early treatment protocol and the other is using the mRNA injection as it’s focus.

    Kerala, approximately 35 million people, 28 day count (from John’s Hopkins) 220,705 cases 7458 deaths. mRNA

    Uttar Pradesh approximately 240 million people 28 day count (from John’s Hopkins) 250 cases and 7 deaths. Early treatment protocol with home kit.

    Each home kit contained the following: Paracetamol tablets [tylenol], Vitamin C, Multivitamin, Zinc, Vitamin D3, Ivermectin 12 mg [quantity #10 tablets], Doxycycline 100 mg [quantity #10 tablets]. Other non-medication components included face masks, sanitizer, gloves and alcohol wipes, a digital thermometer, and a pulse oximeter.

    Reply
  4. April   November 9, 2021 at 9:39 am

    I had the SARS virus with SARS symptoms in March of 2020 when my patients had it in Seattle WA. I have worked with it since that time, after then leaving the locked down masked state of Bill Gates’ flock of sheep. I attend large events, travel, care for active covid in a non-hospital setting where no one is watching to observe my mask protocol (let’s just say it is lacking intentionally). Why have I not had Covid again? Oh that’s right- T cell memory! It lasts a lifetime, does NOT wane and adapts to new mutations so that some of these minor 24 hour colds I’ve had in the last 20 months… were probably “covid.” There will not be a pseudoscience pharma product going into my body EVER and I have just started a new job that will use a loophole on the mandates because they don’t buy into any of it either.
    Good luck to all. Avoid the shot like your life depends on it. I have seen more heart attacks, heart failure, new afib, strokes, PEs, clots that open up as stasis wounds, seizures or new tremors, confusion and decline over the shots than I ever saw death from Covid. And we changed death reporting in 2020. I used to report from the state I left so I dealt with that. But you all knew it was fishy…

    Reply
  5. Ram   November 9, 2021 at 2:52 pm

    Why is natural immunity not considered when mandating vaccines?

    Reply
    • LINDA   November 9, 2021 at 7:06 pm

      Because there is something bigger going on here; they should have pulled these vaccines off the market a long time ago with all these side effects. What other vaccine on the market has all these terrible side effects? That would be 0.

      Reply
  6. linda   November 9, 2021 at 7:04 pm

    I am sooo angry over this COVID vaccine!!!! Its criminal what the government is trying to do; this is more than helping people NOT to get COVID, this is something bigger. Now that they want to vaccinate children????? Are these parents crazy??? The thing that angers me the most is when you see a commercial or article they are saying that it’s “safe”. How the hell can they make that assumption? no one knows what will transpire down the road, and people are believing this nonsense.

    Reply
    • Jo   November 9, 2021 at 11:17 pm

      In reality, there are plenty of people who know what will transpire and they’re counting on it.

      Reply
  7. Ron S   November 13, 2021 at 6:07 am

    So the CDC study showed that in Covid recovered pacents respotory illness was more likely to be COVID?

    It didn’t show that COVID recovery people were more likely to get COVID than vaccinated people ?

    Did the COVID recovery people really have COVID or just any respotory illness?

    Looks like CDC study isn’t worth much.
    Are the people reference the study just trying to confuse us?

    Reply

Leave a Reply

Your email address will not be published.