External Source Analysis
Centre for Evidence-Based Medicine — New Zealand cebm.org.nz
Educational Overview — Evidence-Based Medicine

Understanding Clinical Trials: Design, Evidence, and Interpretation

Authors: Dr. Priya Menon PhD (Epidemiology, Auckland); Dr. Tom Callister MB ChB, MBioeth Affiliation: Centre for Evidence-Based Medicine, University of Otago Published: September 2023 Last reviewed: January 2025 Peer reviewed: Yes

Key Messages

  • Clinical trials are the primary method for determining whether medical treatments are safe and effective.
  • Randomisation, blinding, and control groups are essential features that reduce bias in trial results.
  • A single study — no matter how well designed — is rarely definitive. Systematic reviews and meta-analyses combine evidence from multiple trials.
  • Understanding study design helps you evaluate health claims critically and identify misleading uses of research.
  • Phrases like "studies show" and "scientists say" can conceal enormous variation in evidence quality.

What Is a Clinical Trial?

A clinical trial is a research study conducted in human participants to evaluate a medical intervention — a drug, vaccine, surgical procedure, device, or behavioural approach. The fundamental question a clinical trial asks is: does this intervention work, and is it safe?[1]

Before a treatment reaches clinical trials, it typically undergoes years of laboratory and animal research. Even so, many treatments that appear promising in pre-clinical research fail in human trials. This is not a flaw in the system — it is the system working as intended, filtering out interventions that are ineffective or harmful before they are widely used.[2]

The Phases of a Clinical Trial

In most regulatory frameworks, clinical trials proceed through four phases, each designed to answer different questions:

Phase I
Safety

Small groups (20–100 people). Tests safety and dosing. Identifies side effects. Usually in healthy volunteers.

Phase II
Efficacy & Safety

Larger groups (100–300). Tests whether the treatment works and continues safety monitoring in patients with the condition.

Phase III
Confirmation

Large-scale (300–3,000+). Compares to standard treatment or placebo. Provides the main evidence base for regulatory approval.

Phase IV
Post-Market

After approval. Ongoing monitoring of long-term safety and effectiveness in real-world populations.

Key Design Features That Reduce Bias

Randomisation

In a randomised controlled trial (RCT), participants are randomly assigned to either the treatment group or the control group. This means any differences between groups at the start of the trial are due to chance rather than systematic selection — reducing confounding, where characteristics of participants (age, severity of illness, lifestyle) could otherwise distort the results.[3]

Control Groups

A control group receives either a placebo (a treatment with no active ingredients) or, where it would be unethical to withhold treatment, the current best available treatment. The control group provides a comparison point: without it, we cannot know whether any improvement in the treatment group is due to the intervention, or simply to time, the placebo effect, or other factors.[4]

Blinding

Blinding prevents knowledge of treatment assignment from influencing outcomes or measurements. In a single-blind trial, participants do not know which group they are in. In a double-blind trial — generally considered the gold standard — neither participants nor the researchers assessing outcomes know who received the treatment. This prevents both the placebo effect in participants and unconscious bias in assessment by researchers.[5]

Statistical Significance and P-Values

Results are typically assessed using a p-value — a measure of the probability that the observed result could have occurred by chance if there were actually no difference between groups. By convention, a p-value below 0.05 is considered "statistically significant," meaning there is less than a 5% probability the result is due to chance. However, statistical significance does not mean clinical significance — a result can be statistically significant but too small to matter in practice.[6]

Common Misreading of Evidence

A single statistically significant result in a small study does not confirm that a treatment works. Many findings fail to replicate. Headlines like "Scientists discover X cures Y" frequently misrepresent preliminary findings. Before drawing conclusions, ask: How large was the study? Was it randomised and blinded? Has it been replicated by independent researchers?

The Evidence Hierarchy

Not all study designs provide equally reliable evidence. The evidence hierarchy ranks study types by their resistance to bias:

Evidence Hierarchy (strongest to weakest)

1
Systematic reviews & meta-analyses
Combine results from multiple high-quality RCTs; most robust
2
Randomised controlled trials (RCTs)
Well-designed individual trials; controlled for bias
3
Cohort studies
Follow groups over time; observational, not experimental
4
Case-control studies
Compare people with and without a condition retrospectively
5
Case reports / anecdotes
Individual accounts; cannot establish causation
6
Expert opinion / editorial
Without systematic evidence; lowest weight

Evaluating Health Claims: A Checklist

Question to AskStrong EvidenceWeak Evidence
Was the study randomised?YesNo / Unclear
Was there a control group?YesNo / Anecdote only
Was it double-blind?YesNo / Single-blind
Sample sizeLarge (hundreds+)Small (under 50)
Independently replicated?Yes, multiple timesSingle study only
Published in peer-reviewed journal?YesNo / Preprint only
Conflicts of interest declared?Declared & managedUndisclosed / Obvious bias
Systematic review available?Yes, supports findingNot yet / Contradicts

Limitations and Research Integrity

Clinical trials have genuine limitations. They are expensive and time-consuming; they sometimes lack diversity in their participant populations; and results in controlled trial conditions may not perfectly reflect real-world outcomes. Some trials have been conducted or reported improperly, and a small number of researchers have committed fraud.[7]

These are real problems that the scientific community actively works to address through pre-registration of trials (so outcomes cannot be changed after the fact), open data policies, and independent replication. The existence of flawed or fraudulent research does not invalidate the clinical trial system — it demonstrates why replication, peer review, and systematic review are essential features of science, and why no single study should be treated as conclusive.[8]

References

  1. Friedman LM, Furberg CD, DeMets DL. Fundamentals of Clinical Trials. 5th ed. Springer; 2015.
  2. Ioannidis JPA. "Why most published research findings are false." PLoS Med. 2005;2(8):e124.
  3. Schulz KF, Altman DG, Moher D. "CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials." BMJ. 2010;340:c332.
  4. Enserink M. "The placebo problem." Science. 2012;336(6085):1094–1097.
  5. Sackett DL. "Bias in analytic research." J Chron Dis. 1979;32(1–2):51–63.
  6. Wasserstein RL, Lazar NA. "The ASA statement on p-values: context, process, and purpose." Am Stat. 2016;70(2):129–133.
  7. Fanelli D. "How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data." PLoS ONE. 2009;4(5):e5738.
  8. Munafo MR, et al. "A manifesto for reproducible science." Nat Hum Behav. 2017;1(1):0021.