Evidence-Based Medicine Part 2: Who Decides What Gets Studied?

In Part One of this post I discussed the general background controversy of evidence-based medicine (EBM,) and some examples of how that is playing out in the pelvic pain world.

In Part Two - that's this one! - I bring up a big ol' red flag that is not being discussed in the EBM controversy.

In Part Three I'll break this mess down and discuss what it all means for you and the health of your lady parts.

* * *

The big ol' red flag: 

Who decides what gets studied?

Think about that...

 

 

 

 

It's complicated right? Someone has to get an idea, they have to convince other people it's a good idea, they then have to convince still more people to give them money to research this idea, and then after that study comes out, well, one study doesn't mean much, so lots of other people have to jump on the bandwagon and get money and research the same topic until there are hundreds of studies, most of which have the same result, at which point we have a body of evidence.

What could possibly be imperfect about this system? Some roadblocks:

(1) Problem Identification Bias: If someone is not aware of a problem, they cannot be expected to solve it. (This is why v-pain usually doesn't make it out of the gate.)

- You need demand to get supply.

(2) Idea Generation Bias: Good science comes from good scientists, who have been trained in western scientific methodology and know a lot about western science and western medicine. But they may not know anything about other healing traditions from beyond their cultural experience and training, thereby cutting them off from potential avenues for research. 

- Scientists aren't going to propose solutions based on something they don't know or understand.

Both the genesis of the question and the proposed solutions are inherently biased, therefore worthy problems and worthy solutions may never make it past this point. What happens to the ideas that do?

(3) Salesmanship Bias: To convince others to join them and give them money, scientists have to have clout, they have to be able to sell their ideas to other people. Just like anything else, there's gonna be horse-trading, office politics, personal and institutional agendas, competing financial priorities, personality differences, and a whole host of other human realities at play here. 

- The road to funding is paved with politics. 

(4) Funding Bias: Studies are expensive. The largest funder of medical research in the world is the National Institutes of Health (NIH,) which is funded by the US government. Pharmaceutical companies spend more than any other industry lobbying... the US government. How science gets funded is a post (actually, a library of books) in and of itself, but for now, you do the math.

- There are many agendas other than a patient's well-being that determine what studies get funded.

(5) Publication Bias: The study has to get published in a reputable medical journal. No one along the road to funding will greenlight a project that has little chance of publication, for whatever reason. 

- The road to publication is also paved with politics. 

The initial idea had to go through a lot of hoops in order to complete one study, but EBM requires many high quality studies.

(6) Repeat Studies Bias: Where's the professional acclaim and advancement for researchers, funders, or publishers to churn out endless studies looking at the same thing? No one gets credit for replicating a study for the 700th time, even though mundane grunt work is the foundation of solid evidence. 

- Ideas may not get the follow-through necessary to create a substantial body of evidence.

In short,

Equally good avenues for research may not get equally good support.

Even when a great idea makes it all the way past step (6), it still needs to be taught to doctors and translated into clinical practice before it can actually reach patients.

* * *

We as patients and medical providers need to discuss and understand the benefits and limitations of evidence-based medicine. It is not a panacea.

On the winding road outlined above, it is easy to see how problems and solutions worthy of research can get overlooked or left on the cutting room floor.

And yet people still have to make medical decisions regardless of whether or not research exists.

In Part 3, we'll discuss how to do just that.

 

Evidence-based Medicine Part 1: What the heck is this and why should I care?

"Evidence-based medicine" (EBM) is exactly what it sounds like: healthcare based on rigorous scientific evidence.

Call me crazy, but isn't that what we get any time we go to the doctor?

Turns out, no. The reality of clinical practice is more complicated than that, not everyone is on board with this concept, and due to the dearth of research on V pain, knowing about the pros and cons of EBM is very, very relevant to you.

* * *

Part One of this blog post discusses the general background controversy of EBM, and some examples of how that is playing out in the pelvic pain world.

In Part Two I'll bring up a big ol' red flag that is not being discussed in the EBM controversy.

In Part Three I'll break this mess down and discuss what it all means for you and the health of your lady parts.

Ready, set, go!

* * *

Here's a little background on the controversy...

Supporters say that EBM improves care by reducing the use of unproven treatments, variations in clinical practice, and the failure to follow consistent guidelines; i.e., it corrects the problem of doctors doing way too many different things for patients facing the same issue, including the use of treatments that may have no evidence to back them. Don't patients deserve to get the best treatment available and not be yanked around on wild-goose chases of potential quackery?

Opponents say that doctors need to respect patient preferences, that just because something works statistically doesn't mean it will work for a particular individual, that insurers will use EBM to deny patients care because there isn't enough evidence to support it, and - this is where it matters most for you - for little researched conditions like V pain, there often isn't any evidence anyway.

Also and ironically, as of the writing of this admittedly old article (2004), there isn't any evidence that evidence-based medicine works. (I tried to find more recent studies investigating this question, but was unable to. Doesn't mean they aren't out there. A lot of scientific evidence isn't available to the public as it is published in super expensive journals which are only found in libraries with restricted access - i.e., university libraries that are only open to students.)

If you want more information on the brou-ha-ha surrounding EBM, you can find various articles here, here, here, and here. The Center for Evidence-Based Medicine can be found here.

* * *

How is this playing out in the world of V pain?

At the International Pelvic Pain Society's annual fall meeting this past October, the keynote speaker implored the audience to launch and participate in studies on pelvic pain. He said it was the responsibility of all health care professionals to do so; failure to participate was failing one's patients. For the record, the speaker was Dr. Khalid Khan, the editor-in-chief of the British Journal of Obstetrics and Gynecology. (You can like BJOG on Facebook and follow them on Twitter.)

At the same event, Dr Christopher Payne at VistaUrology said "Evidence-based medicine is holding us back." (Thanks to Sara Sauder, DPT, for taking good notes and actually having that quote.)

On the surface it looks like these two doctors are on opposing sides, but they aren't. Dr Payne's point was that patients can't wait for trials and studies to be done; they need care now. Dr Khan was frustrated at the slow pace these studies were coming out.

In this blog post, you can read Sara Sauder's take on the problem of producing and relying on EBM, and on Dr Jen Gunter's blog you can get a perspective from someone who is whole-hog pro-EBM to the exclusion of everything else.

* * *

My two cents as a V pain patient is that EBM is not the gold standard.  

As a patient, I'd rather try something untested than not try something at all. I'm bummed Sara doesn't contribute to research when it's exactly her knowledge and experience we need. I appreciate Dr Gunter's generous sharing of her knowledge - a lot of us don't know how to interpret studies and are misled by the media as to what they mean - but at the same time in at least one post through flippant generalization she wrote off a treatment that I and, anecdotally, many other women have benefited from.  The tagline for her blog is "I wield the lasso of truth," but I don't buy it. A more accurate, but less catchy, tagline would be "I provide education on how to interpret scientific evidence, and point out inconsistencies and misinterpretations of said evidence in the media." But "truth?" Eh.

* * *

So that's the very brief overview of EBM in general and in the world of V pain. But wait, there was something missing here...

Who decides what gets studied?

We'll be looking at that can of worms in Part 2. Stay tuned.

 

PS Remember to tweet and FB post about my scholarship application!