American Society of Nephrology, Clinical Journal of the American Society of Nephrology, 5(3), p. 1246-1252, 2008
DOI: 10.2215/cjn.03580807
Full text: Download
linical trials are generally designed to test the superi- ority of an intervention (e.g., treatment, procedure, or device) as compared with a control. Trials that claim superiority of an intervention most often try to reject the null hypothesis, which generally states that the effect of an inter- vention of interest is no different from the control. In this editorial, we introduce a conceptual framework for readers, reviewers, and those involved in guideline development. This paradigm is based on evaluating a study on its statistical merits (result-based merit) as well as the clinical relevance of the potential treatment effect (process-based merit). We propose a decision matrix that incorporates these ideas in formulating the acceptability of a study for publication and/or inclusion in a guideline. Although noninferiority trials and equivalence trials are other valid trial designs, here we largely focus our discus- sion on superiority trials. Studies termed "negative" are commonly defined as those where the difference for the primary endpoint has aPvalue greater than or equal to 0.05 (P!0.05) (1), that is, where the null hypothesis is not rejected. These studies are difficult to publish because they are said to be "nonsignificant." In other words, the data are not strong enough to persuade rejection of the null hypothesis. A highPvalue is frequently interpreted as proof that the null hypothesis is true; however, such an inter- pretation is a logical fallacy. A nonsignificant result implies that there was not enough evidence to infer probabilistically that the null hypothesis can be rejected. What is important to keep in