Table 6.
Secondary outcome: statistical items, in vivo and in vitro experiments
| Item | NPG before | NPG after | Adj p | Non-NPG before | Non-NPG after | Adj p | ||||||||||||
| n | N | % | CI | n | N | % | CI | n | N | % | CI | n | N | % | CI | |||
| In vivo | ||||||||||||||||||
| Exact n | 93 | 203 | 45.8 | 39.8 to 52.7 | 131 | 189 | 69.3 | 62.4 to 75.5 | 0.0004 | 76 | 164 | 46.3 | 38.8 to 54.0 | 89 | 189 | 47.1 | 40.1 to 54.2 | NS |
| Technical or biological replicates | 137 | 201 | 68.2 | 61.4 to 74.2 | 151 | 188 | 80.3 | 74.0 to 85.4 | NS | 92 | 164 | 56.1 | 48.4 to 63.5 | 102 | 188 | 54.3 | 47.1 to 61.2 | NS |
| Number of times replicated | 45 | 199 | 22.6 | 17.3 to 28.9 | 68 | 183 | 37.2 | 30.5 to 44.4 | NS | 35 | 164 | 21.3 | 15.7 to 28.3 | 36 | 188 | 19.1 | 14.1 to 25.4 | NS |
| Test described if uncommon? | 26 | 51 | 51.0 | 37.5 to 64.3 | 41 | 68 | 60.3 | 48.3 to 71.7 | NS | 24 | 42 | 57.1 | 41.1 to 71.9 | 30 | 53 | 56.6 | 42.4 to 69.9 | NS |
| t-Test defined as one-sided or two-sided? | 61 | 133 | 45.9 | 37.6 to 54.4 | 102 | 144 | 70.8 | 62.9 to 77.7 | 0.003 | 30 | 100 | 30.0 | 21.8 to 39.7 | 50 | 109 | 45.9 | 36.8 to 55.3 | NS |
| Correction for multiplicity | 63 | 116 | 54.3 | 45.2 to 63.1 | 69 | 122 | 56.6 | 47.6 to 65.1 | NS | 57 | 101 | 56.4 | 46.6 to 65.8 | 74 | 118 | 62.7 | 53.7 to 71.0 | NS |
| Reporting full statistics | 39 | 167 | 23.4 | 17.6 to 30.4 | 36 | 171 | 21.1 | 15.6 to 27.8 | NS | 21 | 136 | 15.4 | 10.3 to 22.5 | 20 | 156 | 12.8 | 8.4 to 19.0 | NS |
| Reporting of average | 135 | 181 | 74.6 | 67.7 to 80.4 | 147 | 171 | 86.0 | 79.1 to 90.4 | NS | 110 | 147 | 74.8 | 67.2 to 81.2 | 121 | 168 | 72.0 | 64.8 to 78.3 | NS |
| Definition of error bars | 159 | 181 | 87.8 | 82.2 to 91.9 | 155 | 168 | 92.3 | 87.1 to 95.4 | NS | 118 | 144 | 81.9 | 74.8 to 87.4 | 129 | 165 | 78.2 | 71.2 to 83.8 | NS |
| Testing of assumptions | 15 | 171 | 8.8 | 5.4 to 14.0 | 44 | 165 | 26.7 | 20.5 to 33.9 | 0.002 | 12 | 134 | 9.0 | 5.2 to 15.1 | 18 | 156 | 11.5 | 7.4 to 17.6 | NS |
| Reporting measures of variation | 143 | 183 | 78.1 | 71.6 to 83.5 | 139 | 172 | 80.8 | 74.2 to 86.0 | NS | 115 | 142 | 81.0 | 73.4 to 86.9 | 125 | 169 | 74.0 | 66.6 to 80.3 | NS |
| Variation less than twofold | 13 | 53 | 24.5 | 14.8 to 37.8 | 22 | 61 | 36.1 | 25.1 to 48.8 | NS | 12 | 49 | 24.5 | 14.5 to 38.4 | 17 | 50 | 34.0 | 22.3 to 48.0 | NS |
| In vitro | ||||||||||||||||||
| Exact n | 51 | 158 | 32.3 | 25.4 to 40.0 | 93 | 181 | 70.5 | 44.1 to 58.6 | 0.050 | 49 | 133 | 36.8 | 29.1 to 45.4 | 43 | 165 | 26.1 | 19.9 to 33.3 | NS |
| Technical or biological replicates | 90 | 159 | 56.6 | 48.8 to 64.1 | 137 | 182 | 75.3 | 68.5 to 81.0 | 0.035 | 52 | 133 | 39.1 | 31.2 to 47.6 | 70 | 165 | 42.4 | 35.1 to 50.1 | NS |
| Number of times replicated | 62 | 158 | 39.2 | 31.9 to 47.1 | 85 | 181 | 47.0 | 39.8 to 54.2 | NS | 48 | 132 | 36.4 | 28.6 to 44.9 | 58 | 164 | 35.4 | 28.4 to 43.0 | NS |
| Test described if uncommon? | 23 | 42 | 54.8 | 39.7 to 69.0 | 36 | 58 | 62.1 | 49.0 to 73.6 | NS | 19 | 44 | 43.2 | 29.5 to 58.0 | 14 | 39 | 35.9 | 22.6 to 51.9 | NS |
| t-Test defined as one-sided or two-sided? | 51 | 109 | 46.8 | 37.6 to 56.2 | 94 | 130 | 72.3 | 64.0 to 79.3 | 0.008 | 27 | 82 | 32.9 | 23.6 to 43.8 | 30 | 89 | 33.7 | 24.7 to 44.1 | NS |
| Correction for multiplicity | 48 | 102 | 47.1 | 37.6 to 56.7 | 59 | 114 | 51.8 | 42.6 to 60.8 | NS | 40 | 95 | 42.1 | 36.7 to 57.6 | 54 | 100 | 54.0 | 44.2 to 63.5 | NS |
| Reporting full statistics | 25 | 140 | 17.9 | 12.4 to 25.1 | 27 | 160 | 16.9 | 11.8 to 23.5 | NS | 16 | 112 | 14.3 | 8.9 to 22.0 | 19 | 135 | 14.1 | 9.2 to 21.0 | NS |
| Reporting of average | 122 | 149 | 81.9 | 74.5 to 87.3 | 140 | 160 | 87.5 | 81.4 to 91.8 | NS | 90 | 126 | 71.4 | 62.9 to 78.6 | 111 | 148 | 75.0 | 67.4 to 81.3 | NS |
| Definition of error bars | 136 | 149 | 91.3 | 85.6 to 94.9 | 155 | 164 | 94.5 | 89.8 to 97.1 | NS | 98 | 122 | 80.3 | 72.3 to 86.4 | 119 | 146 | 81.5 | 74.4 to 87.0 | NS |
| Testing of assumptions | 13 | 139 | 9.4 | 5.5 to 15.4 | 34 | 155 | 21.9 | 16.1 to 29.1 | NS | NS | 110 | 6.4 | 3.1 to 12.8 | 9 | 133 | 6.8 | 3.6 to 12.5 | NS |
| Reporting measures of variation | 112 | 149 | 75.2 | 67.6 to 81.4 | 132 | 162 | 81.5 | 74.8 to 86.7 | NS | 89 | 125 | 71.2 | 62.7 to 78.4 | 103 | 147 | 70.1 | 62.1 to 76.9 | NS |
| Variation less than twofold | 9 | 40 | 18.4 | 9.8 to 31.7 | 15 | 55 | 27.3 | 17.2 to 40.4 | NS | 12 | 46 | 26.1 | 15.4 to 40.5 | 17 | 45 | 37.8 | 24.9 to 52.6 | NS |
n, number meeting the criteria; N, total number of studies where that criteria is relevant; %, per cent meeting the criteria; CI, 95% CI of that percentage; Adj p, adjusted significance level (two-sample proportion test (prop.test) followed by Holm-Bonferroni correction (p.adjust.methods)); NS, not significant at p<0.05.
NPG, Nature Publishing Group.