I believe it was Mark Twain who said, “There are lies, damn lies and statistics”.
From Monday’s New York Times:
THE BOOSTER INDUSTRIAL COMPLEX
|Late last month, researchers in Israel released some alarming new Covid-19 data. The data showed that many Israelis who had been among the first to receive the vaccine were nonetheless catching the Covid virus. Israelis who had been vaccinated later were not getting infected as often.
|The study led to headlines around the world about waning immunity — the idea that vaccines lose their effectiveness over time. In the U.S., the Israeli study accelerated a debate about vaccine booster shots and played a role in the Biden administration’s recent recommendation that all Americans receive a booster shot eight months after their second dose.
|But the real story about waning immunity is more complex than the initial headlines suggested. Some scientists believe that the Israeli data was misleading and that U.S. policy on booster shots has gotten ahead of the facts. The evidence for waning immunity is murky, these scientists say, and booster shots may not have a big effect.
|After returning from an August break last week, I have spent time reaching out to scientists to ask for their help in understanding the current, confusing stage of the pandemic. How worried should vaccinated people be about the Delta variant? How much risk do children face? Which parts of the Covid story are being overhyped, and which deserve more attention?
|I will be trying to answer these questions in the coming weeks. (I’d also like to know what questions you want answered; submit them here.)
|One of the main messages I’m hearing from the experts is that conventional wisdom about waning immunity is problematic. Yes, the immunity from the Covid vaccines will wane at some point. But it may not yet have waned in a meaningful way.
|“There’s a big difference between needing another shot every six months versus every five years,” Dr. David Dowdy, an epidemiologist at Johns Hopkins University, told me. “So far, looking at the data we have, I’m not seeing much evidence that we’ve reached that point yet.”
Simpson strikes again
|At first glance, the Israeli data seems straightforward: People who had been vaccinated in the winter were more likely to contract the virus this summer than people who had been vaccinated in the spring.
|Yet it would truly be proof of waning immunity only if the two groups — the winter and spring vaccine recipients — were otherwise similar to each other. If not, the other differences between them might be the real reason for the gap in the Covid rates.
|As it turns out, the two groups were different. The first Israelis to have received the vaccine tended to be more affluent and educated. By coincidence, these same groups later were among the first exposed to the Delta variant, perhaps because they were more likely to travel. Their higher infection rate may have stemmed from the new risks they were taking, not any change in their vaccine protection.
|Statisticians have a name for this possibility — when topline statistics point to a false conclusion that disappears when you examine subgroups. It’s called Simpson’s Paradox.
|This paradox may also explain some of the U.S. data that the C.D.C. has cited to justify booster shots. Many Americans began to resume more indoor activities this spring. That more were getting Covid may reflect their newfound Covid exposure (as well as the arrival of Delta), rather than any waning of immunity over time.
‘Where is it?’
|Sure enough, other data supports the notion that vaccine immunity is not waning much.
|The ratio of positive Covid tests among older adults and children, for example, does not seem to be changing, Dowdy notes. If waning immunity were a major problem, we should expect to see a faster rise in Covid cases among older people (who were among the first to receive shots). And even the Israeli analysis showed that the vaccines continued to prevent serious Covid illness at essentially the same rate as before.
|“If there’s data proving the need for boosters, where is it?” Zeynep Tufekci, the sociologist and Times columnist, has written.
|Part of the problem is that the waning-immunity story line is irresistible to many people. The vaccine makers — Pfizer, Moderna and others — have an incentive to promote it, because booster shots will bring them big profits. The C.D.C. and F.D.A., for their part, have a history of extreme caution, even when it harms public health. We in the media tend to suffer from bad-news bias. And many Americans are so understandably frightened by Covid that they pay more attention to alarming signs than reassuring ones.
The bottom line
|Here’s my best attempt to give you an objective summary of the evidence, free from alarmism — and acknowledging uncertainty:
|Immunity does probably wane modestly within the first year of receiving a shot. For this reason, booster shots make sense for vulnerable people, many experts believe. As Dr. Céline Gounder of Bellevue Hospital Center told my colleague Apoorva Mandavilli, the C.D.C.’s data “support giving additional doses of vaccine to highly immunocompromised persons and nursing home residents, not to the general public.”
|The current booster shots may do little good for most people. The vaccines continue to provide excellent protection against illness (as opposed to merely a positive Covid test). People will eventually need boosters, but it may make more sense to wait for one specifically designed to combat a variant. “We don’t know whether a non-Delta booster would improve protection against Delta,” Dr. Aaron Richterman of the University of Pennsylvania told me.
|A national policy of frequent booster shots has significant costs, financially and otherwise. Among other things, the exaggerated discussion of waning immunity contributes to vaccine skepticism.
|While Americans are focusing on booster shots, other policies may do much more to beat back Covid, including more vaccine mandates in the U.S.; a more rapid push to vaccinate the world (and prevent other variants from taking root); and an accelerated F.D.A. study of vaccines for children.
|As always, we should be open to changing our minds as we get new evidence. As Richterman puts it, “We have time to gather the appropriate evidence before rushing into boosters.”
Based on the data, vaccines have limited the number of severe cases in vaccinated vs. non-vaccinated groups, but the trend only becomes apparent when you aggregate the data based on age groups to account for the fact that severe cases occur more frequently among older adults.
Beware statistical aberrations!