Placebo Devices as Effective Control Methods in Acupuncture Clinical Trials: A Systematic Review

This systematic review and meta-analysis represents an important milestone in methodological research on acupuncture, analyzing the efficacy of three placebo devices widely used in randomized clinical trials: Streitberger, Park, and Takakura. The study addresses a fundamental question in acupuncture research: how to create an adequate placebo control that is completely inert and allows effective blinding of participants and researchers. The researchers conducted a comprehensive search across six databases (four in English and two in Chinese) from inception to July 2014, including manual searches of relevant references. Thirty-six randomized controlled trials that compared manual acupuncture with one of the three placebo devices were included, covering various clinical conditions.

The methodology rigorously followed the PRISMA guidelines, with independent data extraction by two reviewers and risk-of-bias assessment using the Cochrane Collaboration tool. The Streitberger device, introduced in 1998, uses a needle with a blunt tip and a telescopic handle that produces a pricking sensation without penetrating the skin. It was the most used (21 studies), but presents limitations such as difficulty of application in certain body areas and impossibility of blinding the therapist. The Park device, developed later, attempted to improve the design with a guide tube and sheath to maintain sterilization, and was used in 13 studies.

The Takakura device, the most recent (2007), was the first designed to allow double-blind blinding, including a soft internal material to simulate the therapist's sensation during needling, and was evaluated in only 2 studies. The results of the meta-analysis do not support the notion of the Streitberger or Park devices as inert controls. For musculoskeletal pain, the Park device proved less effective than real acupuncture, while the Streitberger performed better than real acupuncture. In in vitro fertilization, the results were inconsistent, with some studies favoring the placebo devices over real acupuncture.

Adverse events were reported in 16 studies, generally without significant differences between groups, although real acupuncture tended toward more events. The assessment of blinding credibility revealed that, although most authors reported success, when Bang's Blinding Index was calculated, only one study with the Park device demonstrated an ideal blinding scenario. The Takakura device was the only one capable of blinding therapists, representing a significant advance for double-blind studies. Risk-of-bias assessment showed that studies with Takakura had low risk in all domains except selective reporting.

Therapist blinding remained the greatest challenge, being a problem in 94.4% of the studies. The clinical implications are substantial for the future of acupuncture research. None of the devices proved to be completely inert, questioning the validity of studies that used them as placebo controls. This may explain inconsistent results in meta-analyses of acupuncture and suggests a need to reinterpret existing evidence.

The Takakura device emerges as the most promising due to its capacity for double blinding, but it needs further validation. The study highlights important limitations: small number of studies included in the meta-analyses, variable methodological quality of the primary studies, and lack of wait-list groups for comparison. Limitations include clinical heterogeneity of the studies, limited assessment of adverse events, and insufficient data for calculating the Blinding Index in many studies. This work provides clear directions for future research, including the need for development of improved placebo devices, standardization of blinding assessment methods, and the conduct of three-arm studies including a no-treatment control.

The research represents a fundamental methodological contribution that will influence the design of future acupuncture clinical trials and the interpretation of existing evidence.