Skip to main content

Respecting Choices or penalizing them: do DNR orders affect quality ratings?

by: Lena Makaroun, @LenaKMakaroun

Since 2010, the Center for Medicaid and Medicare Services (CMS) has been reporting hospital quality measures for a number of common medical conditions. Intended to provide health care consumers (patients and their families) with information that may guide where they seek care, these measures have undergone multiple iterations in attempts to inch closer and closer to measuring true “quality”. Mortality, a measure as inherently basic as it is complex, has remained a core measure throughout the past decade, and is showing no signs of retreat. With both US hospitals and the patient populations they serve being hugely diverse, efforts to identify factors contributing to mortality statistics independent of the medical care delivered are important and ongoing. In a recent article in JAMA Internal Medicine this past January, Walkey et al. ask a probing question – are hospitals being penalized on mortality quality measures for valuing patient preferences for those who have do-not-resuscitate (DNR) orders? In other words, are hospitals with higher proportions of patients with DNR orders doing worse on mortality quality measures? And if so, should they be?

The authors collected data for one year from 303 California hospitals caring for a total of 90,644 cases of pneumonia (a common disease for which quality measures are collected and reported by CMS). They gathered information on rates of early DNR orders (within 24 hours of hospitalization), mortality rates and co-morbidities among others. When the researchers looked at the association with mortality, they found that while it may have originally looked like a lower percentage of patients being admitted to the lower-DNR rate hospitals were dying, when adjusted for DNR status, this pattern reversed. When separated into patients who had DNR orders and those that did not, patients in both groups admitted to lower-DNR rate hospitals were more likely to die than patients from both groups who were admitted to higher-DNR rate hospitals.

If it seems confusing, that’s because it is. Numbers can be deceiving, and this may in fact be one of the most important take away points from this study. When numbers are being presented to the public to reflect a truth about the “product” they are consuming, the responsibility is on us to make sure those numbers in fact reflect at least some version of the truth. So what is the truth behind these numbers? In short, it’s too soon to say. Another way of presenting the data is that 84% of the patients who died at the lowest DNR rate hospitals were not themselves DNR, compared to only 44% of those dying at the highest DNR rate hospitals. The authors did not find significant differences between the pneumonia related care that patients received or how sick patients were between the two quartiles. If we are to make the value judgment, as we often do in the geriatrics/palliative world of medicine, that dying in the hospital without a DNR order is worse than dying with one, then the high DNR rate quartile hospitals may be being penalized for higher mortality rates while in fact delivering good quality, patient- centered care.

This, however, may be a dangerous conclusion to draw at this point. The descriptive results of this study paint another layer of the picture. When compared to the high DNR rate quartile hospitals, the lowest quartile hospitals served a poorer, more diverse (49% non-white v 22% non-white for the highest quartile) and higher Medicaid insured population. So perhaps the discrepancy we are seeing in rates of DNR status in fact reflect the distinct preferences of a specific patient population based on cultural and socioeconomic factors, rather than the processes of the health systems and hospitals caring for them. While the authors conclude that we should consider adjusting for DNR rates when measuring hospital mortality as a quality measure, there may be danger in this in inadvertently penalizing hospitals that care for poorer, more diverse patient populations. It seems that what we really should be aiming for is incentivizing the process – actually having good, meaningful goals of care discussions, documenting them and then carrying out care that is in line with patient preferences. As our definition of “quality” continues to evolve, we must strive for a definition that involves understanding and respecting patients’ values and preferences.


Pam Campbell said…
Excellent question! This is exactly the type of inquiry we need to be engaged with and researching, as the definition of true quality of life deepens and evolves away from the mono ($$) focus of the medical industrial complex.
Joanne Lynn said…
I have come to believe that we need to advocate for a different set of quality measures for persons living with eventually fatal illnesses and disabilities. In Britain, persons coming toward the end of life (as defined in part by the "no surprise question" )get onto the primary care trust's gold standard registry and get some advantages - easier access to caregiver financial support, first in line in emergency department, visited by the district nurse, etc. If we had a way to identify Medicare beneficiaries (4 out of 5 of us die covered by Medicare) who are living with advanced illness (a Gold Standard designation in their record?), then these patients could be left out of the denominator for many metrics, like cancer screening and mortality rates. Instead, we could develop much more appropriate metrics that matter to the persons involved - services aligned with preferences, caregiver support, and falls prevention, for example. And they could get some added support from long-term care and palliative care. Maybe the social arrangements could guarantee them food and supportive housing as a start!
As public health measures, most countries do not measure mortality past a certain age, but they do measure years lost before that age. We in the US keep up the rather silly habit of tallying all deaths as equally important to prevent. So, we are fond of saying that X illness is the "leading cause of death" and therefore should have lots of investment in cures and prevention. But it DOES matter if most of those deaths are among people old enough to have competing causes of death in the near future. Maybe eventually it will even matter if the mode of dying tends to be merciful or difficult, though no one will proffer that argument at the present.
The CMS mortality metrics are misleading on many fronts, starting with the assumption that the aim is always to survive. Not only does the rate of DNR matter, but so does the rate of hospitalization. An area with widespread use of hospice (including inpatient), ample home-based primary care, and well-supported nursing homes will have many people who do not show up in the hospital with their exacerbations. Thus, the persons who are in the hospital will be a very different set of people, compared with persons hospitalized in an area that has generated very few other options -- even when compared with adjustment for available measures of severity. We need to detect serious outliers on mortality and help them improve, of course. But we also need to see mortality and other common measures in a public health perspective, illuminating how our systems work and where are the levers for change.
Eric Widera said…
Well said Joanne! Do you know if there is anything in the works in the US to do something similar as Britain?
Lena said…
This comment has been removed by the author.
Lena said…
Couldn't agree more Joanne! I recently heard about a US medical center that routinely transfers terminally ill patients out of the hospital to inpatient hospice within hours of death, after days to weeks of aggressive care, purportedly so that they do not get counted as dying in the hospital. Having separate metrics for measuring quality of care for terminally ill patients (as you suggest) would certainly help avoid such burdensome, non-patient-centered care in the end of life.

Popular posts from this blog

Geroscience and it's Impact on the Human Healthspan: A podcast with John Newman

Ok, I'll admit it. When I hear the phrase "the biology of aging" I'm mentally preparing myself to only understand about 5% of what the presenter is going to talk about (that's on a good day).  While I have words like telomeres, sirtuins, or senolytics memorized for the boards, I've never been able to see how this applies to my clinical practice as it always feels so theoretical.  Well, today that changed for me thanks to our podcast interview with John Newman, a "geroscientist" and geriatrician here at UCSF and at the Buck Institute for Research on Aging.

In this podcast, John breaks down what geroscience is and how it impacts how we think about many age-related conditions and diseases. For example, rather than thinking about multimorbidity as the random collection of multiple different clinical problems, we can see it as an expression of the fundamental mechanisms of aging. This means, that rather than treating individuals diseases, targeting …

The Dangers of Fleet Enemas

The dangers of oral sodium phosphate preparations are fairly well known in the medical community. In 2006 the FDA issued it’s first warning that patients taking oral sodium phosphate preparations are at risk for potential for acute kidney injury. Two years later, over-the-counter preparations of these drugs were voluntarily withdrawn by the manufacturers.  Those agents still available by prescription were given black box warnings mainly due to acute phosphate nephropathy that can result in renal failure, especially in older adults. Despite all this talk of oral preparations, little was mentioned about a sodium phosphate preparation that is still available over-the-counter – the Fleet enema.

Why Oral Sodium Phosphate Preparations Are Dangerous 

Before we go into the risks of Fleet enemas, lets spend just a couple sentences on why oral sodium phosphate preparations carry significant risks. First, oral sodium phosphate preparations can cause significant fluid shifts within the colon …

Length of Stay in Nursing Homes at the End of Life

One out of every four of us will die while residing in a nursing home. For most of us, that stay in a nursing home will be brief, although this may depend upon social and demographic variables like our gender, net worth, and marital status. These are the conclusions of an important new study published in JAGS by Kelly and colleagues (many of whom are geripal contributors, including Alex Smith and Ken Covinsky).

The study authors used data from the Health and Retirement Study (HRS) to describe the lengths of stay of older adults who resided in nursing homes at the end of life. What they found was that out of the 8,433 study participants who died between 1992 and 2006, 27.3% of resided in a nursing home prior to their death. Most of these patients (70%) actually died in the nursing home without being transferred to another setting like a hospital.

 The length of stay data were striking:

the median length of stay in a nursing home before death was 5 months the average length of stay was l…