Skip to content

Is acupuncture no more than a placebo? Extensive discussion required about possible bias

Deng et al. · Experimental and Therapeutic Medicine · 2015

📋Methodological Review⚖️Bias Analysis🔬Moderate Impact

Evidence Level

MODERATE
75/ 100
Quality
4/5
Sample
3/5
Replication
4/5
🎯

OBJECTIVE

To analyze the methodological biases that may make acupuncture appear to be only a placebo

🔍

METHOD

Critical review of problems in acupuncture clinical trials

📊

FOCUS

Study design, placebo effect, and acupuncture administration

🎯

APPLICATION

Improving the quality of future acupuncture research

🔬 Study Design

0participants
randomization

Methodological analysis

n=0

Literature review on biases

⏱️ Duration: Retrospective analysis

📊 Results in numbers

0%

Reduction in between-group difference with inadequate randomization

0%

Overestimation in unblinded studies

0%

Studies with adequate randomization

0%

Studies with adequate allocation concealment

Percentage highlights

41%
Reduction in between-group difference with inadequate randomization
17%
Overestimation in unblinded studies
26%
Studies with adequate randomization
29%
Studies with adequate allocation concealment

📊 Outcome Comparison

Methodological quality of studies

Adequate randomization
26
Adequate allocation concealment
29
💬 What does this mean for you?

This study explains why some research suggests that acupuncture is only a placebo. The researchers identified problems in study design that can mask the true effects of acupuncture. When studies are well conducted, acupuncture can show real benefits beyond the placebo effect.

📝

Article summary

Plain-language narrative summary

This review article addresses a fundamental question in acupuncture research: why do many studies suggest that acupuncture is no more effective than placebo? The Chinese authors, led by a team from the Tianjin University of Traditional Chinese Medicine, conducted a comprehensive analysis of the methodological problems that may bias the results of randomized controlled clinical trials in acupuncture. The work identifies three main categories of problems that can lead to erroneous conclusions about the efficacy of acupuncture: problems in study design, potent placebo effects, and inadequate administration of acupuncture. With regard to study design, the authors highlight common problems that also affect other areas of medicine, such as inadequate randomization, insufficient blinding, and high dropout rates.

Specifically in acupuncture, adequate randomization is found in only 26% of the studies analyzed, while adequate allocation concealment occurs in only 29% of cases. These problems can overestimate treatment effects by up to 41% when randomization is inadequate and by 17% when blinding is insufficient. A particular challenge for acupuncture research is the development of appropriate placebo controls. Unlike an inert pill, creating a truly inactive 'sham acupuncture' is extremely difficult.

All forms of sham control currently used — including superficial needling, incorrect points, non-traditional points, and non-penetrating needles — can produce some physiological effects. This reduces the observed difference between real and sham acupuncture, making it appear that acupuncture is no more effective than placebo. The placebo effect in acupuncture is particularly potent, being stronger than pill placebo. This is due to the complexity of the intervention, which involves an elaborate ritual, intense communication between practitioner and patient, and high expectations.

Neuroimaging studies demonstrate that real and sham acupuncture activate different brain patterns, suggesting distinct mechanisms of action. The inadequate administration of acupuncture represents another important and often overlooked bias. The authors compare two studies on hypertension with opposite results, demonstrating how different treatment protocols can dramatically influence outcomes. The study that showed benefits used 22 sessions over 6 weeks, with point selection based on traditional Chinese diagnosis, while the negative study used only up to 12 sessions over 6–8 weeks.

Point specificity and adequate needle manipulation are fundamental elements that are rarely objectively quantified in studies. Different manipulation techniques — including depth, intensity, duration, and frequency of stimulation — can produce distinct cellular and neurochemical effects. Experimental studies show that specific manipulations induce maximal responses in connective tissue and different patterns of neuropeptide release. The clinical implications of this work are significant for patients and researchers.

The authors argue that when methodological biases are adequately controlled — through rigorous design, minimization of the placebo effect, and optimization of acupuncture administration — studies can demonstrate significant differences between real acupuncture and placebo controls. This suggests that negative conclusions about the efficacy of acupuncture may reflect methodological limitations rather than real ineffectiveness of the intervention. For clinical practice, this means that patients should not dismiss acupuncture based solely on studies showing equivalence with placebo, especially if these studies present the methodological limitations discussed. The work proposes guidelines for future research, including the use of central randomization in multicenter studies, the development of better sham controls, strategies to minimize the placebo effect, and objective quantification of acupuncture protocols.

The authors emphasize the need for standardized guidelines for the optimal administration of acupuncture for different clinical conditions.

Strengths

  • 1Comprehensive analysis of multiple sources of bias in acupuncture research
  • 2Detailed discussion of methodological aspects specific to acupuncture
  • 3Comparison of studies with opposing results to illustrate important points
  • 4Practical proposals for improving future research
⚠️

Limitations

  • 1Narrative review without explicit systematic search methods
  • 2Focus primarily on Chinese literature may introduce selection bias
  • 3Absence of quantitative analysis of the biases identified
  • 4Limited discussion of the costs of implementing the suggested improvements
Dr. Marcus Yu Bin Pai

Expert Commentary

Dr. Marcus Yu Bin Pai

MD, PhD · Pain Medicine · Physical Medicine and Rehabilitation · Medical Acupuncture

Clinical Relevance

The methodological discussion raised by Deng et al. has direct implications for how we interpret the acupuncture literature in daily clinical practice. When a clinical trial concludes that acupuncture is equivalent to sham, the clinical reader rarely examines whether there was adequate randomization — present in only 26% of the studies analyzed — or allocation concealment, found in only 29%. These deficits alone can inflate the estimated effect by 41% and 17%, respectively, distorting the comparison between groups. For the physiatrist deciding whether to integrate acupuncture into the rehabilitation plan of a patient with chronic musculoskeletal pain, understanding that active sham produces measurable physiological effects — and therefore artificially compresses the effect size — is fundamental to interpreting negative results without dismissing the intervention. Populations with refractory chronic pain, in which the conventional pharmacological arsenal is limited by adverse effects, are the ones who stand to lose the most when biased conclusions steer clinicians away from a therapeutic option with robust neurophysiological plausibility.

Notable Findings

The most methodologically relevant finding is the documentation that all forms of sham in acupuncture — superficial needling, incorrect points, non-penetrating needles — produce measurable physiological responses, making it impossible to construct a truly inert control comparable to pharmacological placebo. This has direct consequences for the interpretation of any meta-analysis that juxtaposes real and sham acupuncture as if they were active versus inactive. The comparison between the two hypertension studies is particularly instructive: the protocol with 22 sessions and individualized point selection showed benefit; the protocol with up to 12 sessions and standardized selection did not. This dose-response disparity is rarely controlled for in evidence syntheses. The neuroimaging data mentioned, demonstrating distinct brain patterns between real and sham acupuncture, reinforce that the two conditions are not neurobiologically equivalent, even when the clinical outcomes appear to overlap because of design limitations.

From My Experience

In my practice in the pain and rehabilitation service, this debate about placebo versus specific effect frequently arises when discussing cases with colleagues who still resist acupuncture as a medical tool. I have observed that patients with chronic myofascial pain respond perceptibly between the third and fifth sessions, provided the protocol includes adequate needle manipulation with elicitation of De Qi and point selection compatible with the clinical pattern — exactly the kind of variable that negative studies tend to neglect. I typically work with initial cycles of 10 to 12 sessions, combined with supervised therapeutic exercise, and assess the need for monthly maintenance according to the chronicity of the case. Patients with high central sensitization tend to respond more slowly and benefit from combination with neuromodulation. The profile that responds best, in my experience, is one with a predominantly peripheral musculoskeletal component, without major untreated psychiatric comorbidity — which is in line with what Deng et al. indirectly suggest by valuing optimized treatment protocols.

PhD in Health Sciences, University of São Paulo. Board-certified in Pain Medicine, Physical Medicine and Rehabilitation, and Medical Acupuncture.

Full original article

Read the full scientific study

Experimental and Therapeutic Medicine · 2015

DOI: 10.3892/etm.2015.2653

Access original article

Scientific Review

Marcus Yu Bin Pai, MD, PhD

Marcus Yu Bin Pai, MD, PhD

CRM-SP: 158074 | RQE: 65523 · 65524 · 655241

PhD in Health Sciences, University of São Paulo. Board-certified in Pain Medicine, Physical Medicine and Rehabilitation, and Medical Acupuncture. Scientific review and curation of every entry in this library.

Learn more about the author →
⚕️

Medical disclaimer: This content is for educational purposes only and does not replace consultation, diagnosis, or treatment by a qualified professional. Some information may be assisted by artificial intelligence and is subject to inaccuracies. Always consult a physician.

Content reviewed by the medical team at CEIMEC — Integrated Centre for Chinese Medicine Studies, a reference in Medical Acupuncture for over 30 years.