What Advocates Should Know about Research

What we know about breast cancer evolves over time, as more research asks the important questions about how it develops, how we might prevent it, and which treatments are most effective for which patients.

Your gift is doubled through December 31.

Donate Now

We want breast cancer care—and all health care—to be based on the strongest evidence of what will work and what will be safe.

Research Changed How Breast Cancer Is Defined and Treated

As late as the 1980s, it was assumed all breast cancers were the same. However, laboratory studies began to indicate that breast cancer was not a single disease.

Researchers found subtypes of breast cancers could be identified by their differing expression levels of genes, known as molecular profiling. Identifying the subtype of breast cancer can be used to predict how a patient will respond to a particular treatment.

Instead of assuming a larger tumor will be more likely to metastasize and treating bigger tumors more aggressively, we now know different types of breast cancer need to be treated with different therapies—and that bigger doesn’t always indicate a more dangerous tumor.

Defining “Research”

Research is the search for knowledge, collecting information and establishing facts using the scientific method.

The scientific method is a way to ask and answer scientific questions by making observations and doing experiments. Research can be done in a laboratory, in a clinic, or even in a library looking through old records.

All research must follow the set of steps outlined in the scientific method to be considered reliable.

  1. Ask a question.
  2. Do background research.
  3. Construct a hypothesis.
  4. Test a hypothesis through an experiment.
  5. Analyze data and draw a conclusion.
  6. Communicate results.

When evaluating research, think about how the hypothesis was tested: was it done in a fair and unbiased way? Was only one factor different between the two groups, or could several differences explain the results?

Also check that the research is communicated in a peer-reviewed journal—meaning that other scientists have read and evaluated the research.

What Is Evidence?

Following the scientific method produces evidence, a collection of observations supporting or rejecting the hypothesis.

The scientific method collects evidence in a systematic way to avoid bias, or unreliable conclusions, such as those drawn from anecdotal evidence.

Scientists present their research and defend their claims at scientific meetings or by publishing their research in scientific journals. Research results must be reproducible, and new findings are often not accepted within scientific and medical communities until they have been replicated multiple times by different researchers.

Not all evidence is equal. Some evidence is considered stronger because the research methods make us more confident in the accuracy of the findings. Confidence in research results can vary based on the type of study and research design.

Types of Research Studies

Some studies are observational, while others are “experimental” and involve evaluating interventions. Each has a different design and methods, and each has its strengths and limitations. The type of research question helps determine the best type of study to conduct.

Comparative Effectiveness Research (CER)

CER is a direct comparison of existing options available for treating a particular condition. It may compare similar treatments, like competing drugs, or analyze very different interventions, such as surgery and drug therapy. It may also compare the effectiveness of how and when care is delivered, like different intervals of follow-up or dosing schedules.

CER can use a range of research tools and methods, including a systematic review of existing studies and evidence, modeling to simulate effects of interventions on different populations, or head-to-head clinical trials comparing one treatment with another.

Laboratory Studies

Laboratory studies can use cells from animals or humans, or animal models. Studies involving a controlled environment, such as cell cultures in a test tube or in a petri dish, are in vitro. Studies done on living organisms are in vivo.

Laboratory studies are also referred to as:

  • Bench science: They are often conducted on a long bench.
  • Basic research: They explore the fundamentals of how things work and interact.
  • Preclinical research: They are conducted prior to research in people in the clinic or in clinical trials.
Human Studies

Studies that involve humans include clinical trials and observational studies. Systematic reviews summarize the results of many different clinical trials and observational studies. Meta-analyses pool data collected from multiple smaller studies in addition to including a systematic review.

Clinical Trials

Clinical trials—experimental studies that test new treatments in humans—determine if new treatments work better, the same, or not as well as the standard treatment for the same disease.

Clinical trials of experimental treatments, sometimes called investigational treatments, are conducted in a series of steps called phases.

  • Phase I: Includes only a small number of people; designed to test a treatment’s safety and identify safe dosage levels and side effects.
  • Phase II: Involves a larger number of people to test whether a treatment may be effective and to further judge its safety.
  • Phase III: A randomized trial enrolling hundreds or even thousands of people to test whether a drug is more effective than a placebo or other drugs currently in use, and to monitor side effects and other safety concerns.
  • Phase IV: Also known as post-marketing surveillance studies; monitors the long-term safety and effectiveness of a new treatment among a general population.

Randomization and masking are important aspects of clinical trials. In some Phase II and most Phase III trials, patients are divided into at least two groups or arms:

  • One group of patients—the investigational group—gets the new investigational treatment.
  • Another group of patients, the control group, gets the standard treatment—what you would receive if you did not take part in the clinical trial.

The two groups are compared to see which treatment works better.

In well-designed clinical trials, patients are grouped by chance, called randomization. Patients do not choose whether they will get the new treatment as part of the investigational group or the standard treatment as part of the control group.

Randomized clinical trials, considered the gold standard for obtaining evidence, aim to enroll two groups of people who are as similar as possible—their only difference is whether they get the new treatment.

Randomized trials are also designed to be ethical. They are only done if we really do not know whether a new treatment is better than the one currently in use.

In some trials, patients know which arm they are in. In others, patients do not know which arm they are in, called a masked or blind study. In some trials, neither doctors nor patients know which arm the patients are in; these are double-masked or double-blind studies.

Masking helps to minimize information bias, a systematic difference in the data collected between the study arms. A doctor could provide different care to a patient known to be in the investigational group than to one known to be in the control group. Or the investigator’s expectations may bias the interpretation of results if the investigator knows who is receiving the treatment and who isn’t.

Observational Studies

Observational or epidemiology studies examine which risk factors, or exposures, are associated with an increased or decreased risk that a person will develop a disease. Unlike clinical trials, researchers observe participants and do not intervene with treatment.

Case-control studies begin by identifying a group of people who already have a disease (cases). Next, the researchers find a comparison group without the disease, as similar as possible to the people who got sick (controls).

Researchers ask everyone in both groups the same question—for example, “Were you exposed to secondhand smoke as a teenager?”—then compare how many cases were exposed with how many controls were exposed. If many more cases were exposed than controls, it could mean exposure to secondhand smoke is linked to the disease.

A problem with case-control studies: having the disease itself may affect how people answer questions about their past. A breast cancer diagnosis could make women more likely to remember secondhand smoke exposure than women without breast cancer. This is recall bias.

Another limitation of case-control studies: while they can identify exposures associated with disease, exposure may not necessarily occur before disease. A true experimental clinical trial would be necessary to show one factor caused another, which is often impractical. In the case of secondhand smoke, no one can be randomly assigned to secondhand smoke exposure to see if breast cancer develops.

However, the next level of epidemiology study—the cohort study—can help provide stronger evidence.

Retrospective cohort studies begin by identifying two groups who are alike in many ways but differ by a certain characteristic (exposure), like female nurses who smoke and those who do not smoke. Researchers then compare their medical records to look for a certain outcome (disease), such as lung cancer.

If many more female nurses who smoke have developed lung cancer than those who did not smoke, it could mean smoking is linked to lung cancer.

Retrospective cohort studies have the same limitation as case-control studies; it is not always clear whether the exposure occurred before the disease started. And if the people being studied are no longer alive, researchers have to rely on family for information, which could be less accurate.

Prospective cohort studies involve identifying a large group, collecting information (exposures) about them at the beginning of the study through medical records or surveys, and following them over time to see what happens to their health.

Prospective cohort studies can show if exposure occurred before diagnosis, but they cannot prove the exposure caused the disease and not a separate, possibly unmeasurable factor.

When looking at results from epidemiology studies, remember: association does not mean causation.

Systematic Reviews

Systematic reviews are summaries of results from lots of smaller studies, carefully chosen from the literature according to strict rules and measured by quality.

Systematic reviews are at the top of the hierarchy of evidence because they look at a whole range of studies and make conclusions about them, though a review cannot eliminate bias from the original studies.

Meta-Analyses

A meta-analysis—often but not always a part of a systematic review—combines and reanalyzes the results of smaller studies and lets researchers view bigger-picture effects.

Researchers should only include and combine appropriate data. For example, a meta-analysis pooling data across all modes of cancer therapy for all types of cancer would be inappropriate; some cancer treatments are effective for certain cancers and harmful for others. Combining the results of these studies would yield a meaningless result.

A meta-analysis is not advisable when there are too many differences between studies, not enough studies exist, or the studies are missing a lot of data.