Conflicts of interest in HIV medicine: The 2012 revised DHHS HIV treatment guidelines and what’s wrong with expert opinion
The most recent revision of the DHHS guidelines on the use of antiretrovirals in HIV infected adults and adolescents now recommends starting therapy at a CD4 lymphocyte count greater than 500/ mm3.,
For those with greater than 500 CD4 lymphocytes the recommendation is only supported by expert opinion – the opinions of the experts on the DHHS panel. Almost all of the non-governmental researchers on the panel have financial arrangements with entities that stand to gain from the decisions they make. There are plenty of other experts who are not members of the DHHS panel who are not so certain that starting treatment above 500 CD4 lymphocytes will confer a net benefit to the patient..
This particular recommendation is unlike those made for individuals with lower CD4 numbers where more reliable evidence from clinical trials clearly demonstrates a benefit to the patient
Evidence based medicine has brought us a long way from the days when clinical decisions were based on authority and tradition (“expert opinion”); it attempts to use the best available evidence on which to base clinical recommendations. The term “best available evidence “means that not all types of evidence are of equal quality. There are several systems that grade the relative strengths of evidence derived from different sources. All agree that evidence provided by randomized controlled clinical trials is of the highest quality and therefore the most reliable. Applied to HIV medicine, a strong recommendation that antiviral treatment be initiated at 350 or fewer CD4s can be confidently made because the evidence of substantial benefit is derived from a randomized controlled clinical trial.
At the other end of the scale rating the quality of evidence, is evidence based on “expert opinion”. This may not even be a marginal improvement on the bad old days when the doctor knew best; when there was no need to justify a recommendation other than by the authority of the doctor or by tradition.
The rating of the recommendation that people with more than 500 CD4 lymphocytes start treatment, according to the system used by DHHS is B III. It’s a moderate recommendation supported only by the opinion of experts.
But when expert opinion is the basis for a recommendation, this does not even mean that the opinion represents a consensus of all experts. It only represents the opinion of those experts chosen by the organization making the recommendation.
Making a recommendation based solely on expert opinion is particularly troublesome when the means exist to obtain evidence of the highest quality. The START trial that directly addresses the question of when it’s best to begin antiviral treatment is enrolling, and one must wonder why the panel did not defer making a recommendation concerning individuals with greater than 500 CD4 lymphocytes until the trial results become available. This is even more puzzling as individuals who have waited to start at CD4 numbers between 350 to 500 have in general done very well, so waiting to make a recommendation for some years until the START trial results are available seems to be a much more reasonable and prudent option than jumping the gun and making a recommendation based on evidence of the weakest quality.
Bur when we come to look at the associations of the experts on the DHHS panel, a recommendation based on expert opinion is even more problematic. We note that almost all of the non-governmental researchers have financial arrangements with entities that can benefit from the decisions they make. Some of these arrangements are quite extensive.
A conflict of interest becomes particularly troublesome when it’s only the opinion of the expert that supports a recommendation. Since people with greater than 500 CD4 lymphocytes represent a huge proportion of the HIV infected population, treating them will have an impact on expanding the market for antiviral drugs. With greater efforts to encourage testing, greater numbers of individuals with higher CD4 numbers will be identified, and now recommended to receive lifelong treatment with expensive and potentially toxic drugs whose benefit has not yet been proven to outweigh their harms.
The conflicts of interest of panel members are duly noted in the DHHS financial disclosures.
Early AIDS activists performed a great service for all individuals who must deal with illness, in asserting their right to make informed decisions concerning their care, and that the decisions are made free from coercion. Withholding information and supplying misinformation are forms of coercion.
Although the guidelines ask physicians to inform patients with high CD4 numbers that evidence for benefit is not conclusive I think it’s safe to conclude that individuals with greater than 500 CD4s will not always, and may only rarely informed be informed of this important caveat. As to informing patients of the conflicts of interest noted above, this isn’t even a consideration. They are also unlikely to be told that the recommendation that they start treatment is based on the opinion of certain experts only, and that there are other experts with a different opinion. In fact, the DHHS guidelines may be the only ones in the world to make this recommendation.
Undoubtedly the DHHS panel members believe that people with higher CD4 numbers will receive a net benefit from treatment. But the recommendations would have greater authority if the non-governmental researchers on the panel were better balanced with respect to members who had no financial arrangements with entities that stand to benefit from their decisions; in fact many would agree that such conflicts of interest should be a disqualification for panel membership.
The recommendations also refer to the prevention benefit of treatment. The greatest prevention benefit will result from the treatment of individuals with lower CD4 numbers who will have the highest viral loads. These individuals need treatment. On this point there is no doubt or debate. For those with higher CD 4 numbers, not known at this time to benefit from treatment, the prevention benefit is likely to be much lower as their viral loads will also, on average be much lower than those with more advanced HIV disease.
Providing treatment to everybody who needs it to stay alive should surely be our first priority. It is here that treatment will also have its greatest prevention benefit.
Conflicts of interest are of course common among those making treatment recommendations. However HIV medicine seems to be unique in that these conflicts of interest, which may be among the most egregious, seem to go almost completely unnoticed. In every other field of clinical medicine they occasion extensive discussion. The apparent indifference to conflict of interest issues and the influence drug marketing practices in HIV medicine is unfortunate, as precedents in that field may go unnoticed but will have implications for other fields of clinical medicine. The rapid approval of zidovudine by the FDA in 1987 may be such an example.
Two years ago in a tribute to Michael Callen I responded to similar recommendations to treat all HIV infected individuals irrespective of CD4 numbers.
I cannot express my reservations more clearly than with the words I used then:
I miss Michael Callen. He was my patient when AIDS began, but soon became my collaborator and friend.
For a time, Michael and Richard Berkowitz, another patient collaborator, were able to work out of an office adjoining my practice on W 12th street in New York City. It was in this setting that Michael and Richard learned about the medical aspects of this new disease and participated in the creation of some of the earliest organized community responses to the epidemic.
Michael and Richard helped in the formation of the AIDS Medical Foundation; they wrote the very first publication to recommend condom use by gay men. Michael played a role in the first attempt to protect the confidentiality of people with AIDS, and he helped to create both the Community Research Initiative and the PWA Health group.
A thread running through all of these endeavours is the notion of self empowerment. This extends beyond the belief that individuals who are fighting a disease should actively participate with their doctors in making decisions about the care they receive. Empowerment also means the inclusion of affected individuals at all levels of the response to the disease, from research to the provision of services.
The Community Research Initiative was sponsored by the PWA Coalition of which Michael was President. This is the very embodiment of self empowerment. It is people with a disease sponsoring research into that disease themselves and not waiting for some benevolent institution to come to the rescue.
Michael understood that his interests and priorities as a person living with AIDS might sometimes be at odds with those of some scientists conducting research into this new disease. He knew very well that he was living in a world that was still capable of cruel and discriminatory behavior towards him. Who better to protect the interests of those who had the most to lose than people living with AIDS themselves?
Self empowerment found expression in the Denver Principles. Michael and Richard were both signatories to this historic document. Michael played a major role in crafting the words of the Denver Principles.
Almost thirty years later these Principles remain as important as when they were first articulated.
One of the Denver principles asserts the right to obtain full explanations of all medical procedures and risks.
I wish Michael Callen were here today to bring attention to the violation of this right.
This is happening with little protest in places like San Francisco where antiviral medications are now recommended for healthier HIV positive individuals for whom the benefits of treatment have not been shown to outweigh the risks.
As always, you can’t beat the truth, and the truth is that for people with more than 350 CD4 lymphocytes, the best time to start treatment is not known. This may seem surprising as potent antiretroviral drugs have been available for fifteen years.
We have not yet done the kind of study that would most reliably provide the information those HIV positive individuals with higher CD4 numbers and their doctors need to make the best decisions about when to start treatment.
With information provided by a properly designed and conducted prospective randomized trial, we could know with confidence when in the course of HIV infection the benefits of treatment absolutely outweigh the risks.
Some feel that a decision can be made with less reliable information. But surely all would agree that a decision to start treatment or to defer it must always be an informed one voluntarily made by the individual considering treatment.
It is here that the principle asserting the right to a full explanation of the risks of medical interventions is being violated.
The San Francisco Department of Public Health in advising all HIV infected individuals to receive treatment is in effect telling them that at all stages of HIV disease the benefits of treatment outweigh the risks. This may be so, but apart from those with 350 or fewer CD4 lymphocytes, we just do not have the most reliable evidence to support this contention.
People with higher CD4 numbers have the right to know not only what evidence there is that immediate treatment will have a net benefit compared to deferring it, but also the quality of that evidence. They surely should also be made aware that experts hold differing opinions on whether treatment should begin immediately or be deferred.
A physician in San Francisco who recommended that all HIV infected individuals should start treatment immediately was reported to have said:
“If I’m wrong, we’ll start people [on treatment] a couple years earlier than we otherwise would. But if I’m right and we don’t start early, there’s no going back,”
Others who are concerned about drug side effects might feel that more may be at stake for HIV positive individuals with higher CD4 numbers. This also includes the possibility that fewer options may be available when treatment is definitely known to be needed.
This doctor is also reported to have said:
“The old paradigm was that drugs are toxic so we should wait as long as possible. The new paradigm is that while today’s drugs are not totally benign, they are less toxic than the virus.”
“The” paradigm? Is it not misleading to give an impression that his views on drug toxicities represent a consensus?
How on earth can the longer term toxicities of the newer drugs be known?
Just a few days ago it was reported that AZT and 3TC based therapies produced a metabolic abnormality called hyperhomocysteinemia. This is a condition associated with vascular abnormalities including a greatly higher risk of heart attacks. We have been prescribing AZT and 3TC for about twenty years, so what information does the San Francisco doctor have that gives him such confidence that the drugs in use for only a few years are less toxic?
Empowerment means that HIV positive individuals make their own decisions to start or to defer treatment. They have the right to clear and honest information to enable them to make this decision. Those with higher CD4 counts have the right to know that there still is uncertainty about when it is best to start treatment.
The views of the San Francisco Department of Public health and those who share them are just opinions; healthier HIV positive individuals should also know that these opinions are not held by all experts. Respect for the autonomy of healthier HIV positive individuals requires that opposing views on when it’s best to start treatment be presented together with the evidence supporting these views, so those who have most at stake can decide for themselves.
There will continue to be opposing views on when it’s best to start antiviral therapy as long as the question has not been put to the test.
The best way to resolve uncertainty in clinical medicine is by conducting prospective randomized trials. A properly designed and conducted trial could reliably and safely answer the question of whether, on average, immediate or deferred treatment is better or worse or makes no difference.
HIV positive individuals deserve the most reliable information to inform them in making treatment decisions. The START trial is a randomized prospective study that directly asks the question about the best time to start antiviral medications. We could really finally know what’s best, and no longer rely on opinions based on data of inferior quality.
Is an immediate or deferred initiation of treatment better or worse, or does it make no difference? If knowledge is power a demand to complete the START trial is the embodiment of the self empowerment of HIV positive individuals. The very antithesis of self empowerment is to allow researchers to persuade us with evidence of inferior quality, such as their personal opinions, presented as if there were a consensus, or with the results of embarrassingly uninterpretable studies such as NA-ACCORD so often used to justify earlier starts to treatment. NA-ACCORD was not a prospective randomized trial. It was a review of a large number of medical records. Such retrospective observational studies are beset with interpretative difficulties because subjects are not randomly assigned to receive one or another kind of intervention, in this case, to start treatment early or to defer it. We don’t know why a particular course of action was chosen. The reasons why decisions were made to start treatment early or to defer it may have determined the outcome rather than the time treatment was started.
In situations where prospective randomized trials cannot be conducted for whatever reasons, then we have to do the best with data of inferior quality. But fortunately this is not the case with HIV infection.
I miss Michael Callen. He would have reminded us that HIV positive individuals must demand that the best evidence be obtained to inform their treatment choices.
The revised USPHS guidelines for the treatment of HIV/AIDS
Guidelines for the treatment of HIV/AIDS were first issued by the US Department of Health and Human Services (DHHS) in 1998. They have undergone numerous revisions since then; the most recent was in December 2009.
The first guidelines were issued shortly after potent antiviral medications became available. We knew very little about how best to use these drugs at that time, and with only a few years experience our knowledge of their adverse effects was understandably limited.
Perhaps the only reliable information we then had was that individuals with fewer than 200 CD4 lymphocytes received a life saving benefit from their use.
Despite such limited information the panel that had been convened to write the guidelines made firm recommendations for the use of antiviral drugs in groups of patients for whom evidence of a net benefit was lacking.
Even in the absence of experience with the newer antiviral agents, at least two probable problems associated with their use could have been anticipated in 1997. The propensity of just about any microorganism to develop resistance to antimicrobial agents was no mystery. Nor was it a surprise that adverse reactions to new drugs appeared as they were used for longer periods.
As might have been anticipated healthier HIV infected individuals have not infrequently had to deal with both of these problems.
Why then did the first HIV/AIDS treatment guidelines panel not propose and encourage the conduct of a randomized prospective clinical trial to answer the question of whether immediate or deferred treatment with antiviral drugs could or could not prolong life and improve its quality or made no difference apart from cost?
Since the problems that were to arise could have been anticipated, if not their extent, the guidelines committee must have accepted that whatever evidence existed was sufficient to reassure them that there would be a net benefit to starting treatment at 500 CD4 lymphocytes.
The most recent revision of the DHHS guidelines now propose, as the first guidelines did, that treatment be initiated at a CD4 count of 500. A prospective randomized trial that directly addresses the question of when treatment is best initiated has yet to be completed. In the absence of information from such a trial the committee has relied on evidence from some large retrospective observational studies.
In the next post John Falkenberg writes about some previous experiences where advice based on results of retrospective analyses of observational data had to be reversed when the results of randomized controlled studies became available.
I believe the biggest mistake made in 1997 by the guidelines committee was in not responding to the very real possibilities of dangers associated with early treatment initiation by encouraging the completion of a prospective randomized trial, such as START, that could by now have reliably provided an answer to the question of whether immediate or deferred treatment is better or worse or makes no difference that is, apart from cost.
It’s not the benefits of early treatment that are in question. Of course there are benefits, but the question we need an answer to is when in the course of HIV disease the benefits of treatment outweigh the risks.
Long term exposure to antiretroviral drugs can have harmful effects. It can take many years to recognize some of these adverse effects. For example we learned only in the last few months that under certain circumstances neurocognitive function improved in some people who stopped antiviral drugs (ACTG 5170).
So the challenge is to find out how best to use the drugs. Put another way, we must find ways to safely minimize exposure to the drugs, which until we have drugs without significant adverse effects, is what determining the optimal time to start treatment is all about. We don’t know if a person deferring treatment until a CD4 count of 350 will or will not live longer with an overall better or worse quality of life than someone starting at 800 or even 500 CD4s.
We do know that at 350 CD4s, benefits of treatment far outweigh risks. But no matter what NIH guidelines committee members may feel, we do not yet have the most reliable evidence that benefits of treatment will outweigh risks when starting at higher numbers.
The wording of the USPHS guidelines is such that depending on whose vote one goes with, I suppose might even be interpreted to mean a recommendation for every HIV positive individual to receive treatment irrespective of CD4 count.
A letter written to the DHHS panel in 1997 suggesting that a randomized prospective trial be encouraged to provide guidance for individuals with greater than 200 CD4 lymphocytes remained unanswered although received.
Sadly the repeated changes to the guidelines since their first appearance in 1998 appear to indicate a retreat from evidence-based recommendations. Maybe this should be stated as a retreat from attempting to find the most reliable evidence on which to base recommendations. The guidelines panel go to great lengths to reassure us that their recommendations are indeed evidence based.
But as they recognize, the quality of evidence can vary. They also recognize that evidence of the highest quality is derived from the results of prospective randomized trials. Yet not only do they not vigorously encourage the completion of such trials, their recommendations actually inhibit enrolment into START which is such a trial.
Unfortunately the DHHS recommendations while not binding have a huge influence. Remarkably they are even regarded by some as setting an ethical standard, so that fears have been expressed that enrolment into START might be considered unethical as the current guidelines revision recommend starting treatment at 500 CD 4 lymphocytes.
Thirteen years after the first guidelines were issued, the DHHS panel has now made revisions that continues to threaten enrolment into a randomized controlled trial that will provide clear guidance to HIV positive individuals and their doctors about when to initiate antiviral therapy.
Surely, when we recognize that reliable evidence is lacking to inform a very important clinical decision, is it not our obligation to seek the evidence, rather than settle for the uncertainties associated with evidence of inferior quality? This is not only for the benefit of our patients but also to affirm that our stated respect for evidence-based recommendations is more than lip service.
At this time the DHHS guidelines are the only ones that recommend a start to treatment at 500 CD4 lymphocytes.
The DHHS guidelines have been of benefit to people with HIV/AIDS. But on the issue of when to start antiviral therapy they have not best served the interests of HIV positive individuals.
We need a randomized controlled trial to answer this question, not the votes of a committee.
I believe that many health care providers would welcome the opportunity to be able to present an option to their patients with greater than 350 CD4s, to enrol in a study such as START.
At the end of the day, determining when it’s best to start is not something you vote on. It’s something so important that you nail it down with a trial such as START.