Skip to main content

Prognostic Indices In Patient Care: Useful or Waste of Time?

Many clinical decisions in older persons are dependent on life expectancy. For example, as life expectancy declines, cancer screening is likely to do more harm than good. Also, persons who have limited life expectancy may want to plan, discuss their values, and consider palliative care approaches of care in addition to care focused on living as long as possible.

But can one actually predict life expectancy accurately in an individual patient? In an oustanding review of prognostic indices to predict life expectancy in older persons just published in JAMA, Dr. Lindsey Yourman suggests the glass may be more then half empty. Dr. Yourman is an internal medicine resident at Scripps Mercy Hospital in San Diego. Other authors include Alex Smith (senior author), Sei Lee, and Eric Widera of UCSF and Mara Schonberg of Beth Israel Hospital.

So what are the problems with prognostic indices? Well first, at least when applied to an individuals, they are of limited accuracy. For example, lets say you apply a prognostic index to 2 patients. If the index were perfect, it would always assign a lower life expectancy to the patient who dies first. However, Yourman found the best indices identified the patient who dies first no more than 85% of the time. Many indices identify the right patient less than 70% of the time. When you consider that flipping a coin will be correct 50% of the time, this does not sound so great.

But it is even worse than that. The accuracy of prognostic indices is often tested under ideal and controlled conditions. When you see a research report of a prognostic index, you see how well it did in a group of patients specified by the researchers. But how accurate will the index be in your patient? Invariably, the answer is less accurate. This is because your patients are never quite the same as the patients in the research study. Further, you will probably measure the risk elements in a somewhat different way than the researchers.

The answer to this seems simple enough. If we want to know the accuracy of the prognostic index, it should be tested by a new group of investigators in completely new patients. But as Yourman reports, this is almost never done.

So, does this mean we should do away with prognostic indices? No. It just means we should use them intelligently. Prognostic indices are ultimately not that different from any other clinical tool or diagnostic test. Just like you should never look at a test result in isolation, you should never look at a prognostic estimate in isolation. You think about the extent to which it is likely to apply to the patient right in front of you. You think about whether there are characteristics of your patient that were not considered in the prognostic index. And you use it as an additional tool in decision making--integrating the information with knowledge about the patient's clinical circumstances, and their values and care preferences.

As an additional source of information, prognostic indices can be quite valuable, if used to supplement clinical judgement. But clinicians who use them in isolation, to supplant clinical judgement are probably better served by avoiding prognostic indices.

Clinicians (and patients too) now have easy access to these prognostic indices. The authors of the JAMA article have developed a website, ePrognosis, that has converted all the indices reviewed in the article to easy calculators. It is a great tool, that will improve access to prognostic information. But perhaps the danger of ePrognosis is that it is too easy. In a matter of minutes, you can input a few elements of patient data and the calculator will spit out a probability of survival.

Using ePrognosis intelligently will take much more work. Whether that number is actually accurate for your patient, and how you should apply it to their care is as much medical art as science.

by: Ken Covinsky

Comments

Carol Levine said…
From Carol Levine: The comments to the New Old Age blog on this (based on NYT article) suggests that people are going to use this as a sort of parlor game. Not at all what the creators intended, I assume but a risk that comes with the territory.
Maggie said…
Some of us who read the New Old Age blog are not thinking 'parlor game,' honest. I, for one, want to use it to help me evaluate the advice I receive from the young whippersnapper doctor who, at half my age, is at the top of his game in private practice -- but is NOT dealing with his personal old age. And is not the person suffering the so-called 'mild' side effects of the medication he recommends that I 'may not need, but to be on the safe side ...'

I will admit that it is mildly amusing to see that I have a 79% chance of living another decade ... which is much higher than I would personally have supposed.
George Thomas said…
Has anyone ever looked at the margin of error for clinical judgments in estimating prognoses with or without more formalized prognostic tools?
BWWC said…
How about we who are in our early nineties?
Herbert Willard said…
One thing I've always thought about end-of-life care is that it was never composed of precise numbers. Considering how death statistics are always changing, assigning precise numbers to succeeding cases would only be overdoing things without accomplishing anything.

Popular posts from this blog

Caring, and the Family Caregivers We Don’t See

Over lunch at a restaurant in Manhattan, my father and I talked about long-term care insurance and the emergence of senior centers and nursing homes across the U.S. that offer a variety of ethnic cuisines and cultural events, catering not only to a growing population of adults over 65, but also, to an increasingly diverse population of adults who call the U.S. their home. This conversation was different from many similar ones before it – we weren’t talking about my research; we were talking about our own lives.
My parents immigrated to the U.S. in the late ‘70s and early ‘80s, following their parents’ advice on professional opportunities that seemed unimaginable in India at the time. Although they considered moving back soon after to care for their aging parents and to raise children, they ultimately decided to stay in the U.S. As I chronicled earlier, my paternal grandparents lived with us until I completed middle school, at which point they returned to India and lived with my mater…

Practical Advice for the End of Life: A Podcast with BJ Miller

This week we talk with BJ Miller, hospice and palliative care physician, public speaker, and now author with Shoshana Berger of the book "A Beginner's Guide to the End."

As we note on the podcast, BJ is about as close as we get to a celebrity in Hospice and Palliative Care.  His TED Talk "What Really Matters at the End of Life" has been viewed more than 9 million times.  As we discuss on the Podcast, this has changed BJ's life, and he spends most of his working time engaged in public speaking, being the public "face" of the hospice and palliative care movement.

The book he and Berger wrote is filled to the brim with practical advice.  I mean, nuts and bolts practical advice.  Things like:
How to clean out not only your emotional house but your physical house (turns out there are services for that!)Posting about your illness on social media (should you post to Facebook)What is the difference between a funeral home and mortuaryCan I afford to die?  …

Top 25 Studies in Hospice and Palliative Care (#HPMtop25)

by: Kara Bishoff (@kara_bischoff )

Back in 2015 we wrote a post asking for input on what articles should belong on a list of the top 25 articles in hospice and palliative care.   We decided to focus on hospice palliative care studies and trials - as opposed to review articles, consensus statements and opinion pieces.

Here’s what we came up with. It was hard to pick just 25! We highly prioritized clinical utility and tried to achieve diversity & balance. Many others are worthy of inclusion. Take a look and let us know if you have suggested changes for next year.

Module 1: Symptom Management
Randomized, Double-Blind, Placebo-Controlled Trial of Oral Docusate in the Management of Constipation in Hospice Patients. Tarumi Y et al. JPSM, 2013.Once-Daily Opioids for Chronic Dyspnea: A Dose Increment and Pharmacovigilance Study. Currow DC et al. JPSM, 2011.Effect of palliative oxygen versus room air in relief of breathlessness in patients with refractory dyspnoea: a double-blind, randomise…