Table 1 Evaluation criteria for five variable selection methods over 100 repetitions by assuming Negative Binomial distribution for the response variable
Method | P | \(\rho\) | P' | No. FN | No. TP | No. FP | No. TN | TA | Sensitivity | Specificity |
|---|---|---|---|---|---|---|---|---|---|---|
ALASSO | 20 | 0.2 | 10.10 ± 1.10 | 0.00 ± 0.00 | 5.00 ± 0.00 | 5.10 ± 1.10 | 9.90 ± 1.10 | 0.74 ± 0.05 | 1.00 ± 0.00 | 0.66 ± 0.07 |
0.5 | 8.20 ± 1.98 | 0.00 ± 0.00 | 5.00 ± 0.00 | 3.20 ± 1.98 | 11.80 ± 1.98 | 0.84 ± 0.09 | 1.00 ± 0.00 | 0.78 ± 0.13 | ||
0.7 | 7.33 ± 1.80 | 0.00 ± 0.00 | 5.00 ± 0.00 | 2.33 ± 1.80 | 12.66 ± 1.80 | 0.88 ± 0.09 | 1.00 ± 0.00 | 0.84 ± 0.12 | ||
MCP | 20 | 0.2 | 5.70 ± 2.21 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.70 ± 2.21 | 14.30 ± 2.21 | 0.96 ± 0.11 | 1.00 ± 0.00 | 0.95 ± 0.14 |
0.5 | 5.10 ± 0.31 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.10 ± 0.31 | 14.90 ± 0.31 | 0.99 ± 0.01 | 1.00 ± 0.00 | 0.99 ± 0.02 | ||
0.7 | 5.22 ± 0.44 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.22 ± 0.44 | 14.77 ± 0.44 | 0.98 ± 0.02 | 1.00 ± 0.00 | 0.98 ± 0.03 | ||
SCAD | 20 | 0.2 | 5.00 ± 0.00 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.00 ± 0.00 | 15.00 ± 0.00 | 1.00 ± 0.00 | 1.00 ± 0.00 | 1.00 ± 0.00 |
0.5 | 6.70 ± 3.43 | 0.00 ± 0.00 | 5.00 ± 0.00 | 1.70 ± 3.43 | 13.30 ± 3.43 | 0.91 ± 0.17 | 1.00 ± 0.00 | 0.88 ± 0.22 | ||
0.7 | 6.77 ± 1.64 | 0.00 ± 0.00 | 5.00 ± 0.00 | 1.77 ± 1.64 | 13.22 ± 1.64 | 0.91 ± 0.08 | 1.00 ± 0.00 | 0.88 ± 0.10 | ||
Backward Stepwise | 20 | 0.2 | 7.40 ± 1.07 | 0.00 ± 0.00 | 5.00 ± 0.00 | 2.40 ± 1.07 | 12.60 ± 1.07 | 0.88 ± 0.05 | 1.00 ± 0.00 | 0.84 ± 0.07 |
0.5 | 7.80 ± 1.47 | 0.00 ± 0.00 | 5.00 ± 0.00 | 2.80 ± 1.47 | 12.20 ± 1.47 | 0.86 ± 0.07 | 1.00 ± 0.00 | 0.81 ± 0.09 | ||
0.7 | 8.44 ± 1.81 | 0.00 ± 0.00 | 5.00 ± 0.00 | 3.44 ± 1.81 | 11.55 ± 1.81 | 0.82 ± 0.09 | 1.00 ± 0.00 | 0.77 ± 0.12 | ||
Random Forest | 20 | 0.2 | 20.00 ± 0.00 | 0.00 ± 0.00 | 5.00 ± 0.00 | 15.00 ± 0.00 | 0.00 ± 0.00 | 0.25 ± 0.00 | 1.00 ± 0.00 | 0.00 ± 0.00 |
0.5 | 19.90 ± 0.31 | 0.00 ± 0.00 | 5.00 ± 0.00 | 14.90 ± 0.31 | 0.10 ± 0.31 | 0.25 ± 0.01 | 1.00 ± 0.00 | 0.006 ± 0.02 | ||
0.7 | 19.33 ± 1.00 | 0.00 ± 0.00 | 5.00 ± 0.00 | 14.33 ± 1.00 | 0.66 ± 1.00 | 0.28 ± 0.05 | 1.00 ± 0.00 | 0.04 ± 0.06 | ||
ALASSO | 50 | 0.2 | 10.00 ± 5.21 | 0.00 ± 0.00 | 5.00 ± 0.00 | 5.00 ± 5.21 | 40.00 ± 5.21 | 0.90 ± 0.10 | 1.00 ± 0.00 | 0.88 ± 0.11 |
0.5 | 9.40 ± 6.09 | 0.00 ± 0.00 | 5.00 ± 0.00 | 4.40 ± 6.09 | 40.60 ± 6.09 | 0.91 ± 0.12 | 1.00 ± 0.00 | 0.90 ± 0.13 | ||
0.7 | 10.33 ± 4.16 | 0.00 ± 0.00 | 5.00 ± 0.00 | 5.33 ± 4.16 | 39.66 ± 4.16 | 0.89 ± 0.08 | 1.00 ± 0.00 | 0.88 ± 0.09 | ||
MCP | 50 | 0.2 | 5.10 ± 0.31 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.10 ± 0.31 | 44.90 ± 0.31 | 0.99 ± 0.006 | 1.00 ± 0.00 | 0.99 ± 0.01 |
0.5 | 5.20 ± 0.42 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.20 ± 0.42 | 44.80 ± 0.42 | 0.99 ± 0.008 | 1.00 ± 0.00 | 0.99 ± 0.01 | ||
0.7 | 5.16 ± 0.57 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.16 ± 0.57 | 44.83 ± 0.57 | 0.99 ± 0.01 | 1.00 ± 0.00 | 0.99 ± 0.01 | ||
SCAD | 50 | 0.2 | 5.18 ± 0.40 | 0.00 ± 0.00 | 5.00 ± 0.00 | 18.00 ± 0.40 | 44.81 ± 0.40 | 0.99 ± 0.008 | 1.00 ± 0.00 | 0.99 ± 0.01 |
0.5 | 5.90 ± 2.23 | 0.00 ± 0.00 | 5.00 ± 0.00 | 0.90 ± 2.23 | 44.10 ± 2.23 | 0.98 ± 0.05 | 1.00 ± 0.00 | 0.98 ± 0.04 | ||
0.7 | 7.91 ± 3.37 | 0.00 ± 0.00 | 5.00 ± 0.00 | 2.91 ± 3.37 | 42.08 ± 3.37 | 0.94 ± 0.06 | 1.00 ± 0.00 | 0.93 ± 0.07 | ||
Backward Stepwise | 50 | 0.2 | 14.72 ± 2.93 | 0.00 ± 0.00 | 5.00 ± 0.00 | 9.72 ± 2.93 | 35.27 ± 2.93 | 0.80 ± 0.05 | 1.00 ± 0.00 | 0.78 ± 0.06 |
0.5 | 18.50 ± 4.35 | 0.00 ± 0.00 | 5.00 ± 0.00 | 13.50 ± 4.35 | 31.50 ± 4.35 | 0.73 ± 0.08 | 1.00 ± 0.00 | 0.70 ± 0.09 | ||
0.7 | 16.33 ± 3.14 | 0.00 ± 0.00 | 5.00 ± 0.00 | 11.33 ± 3.14 | 33.66 ± 3.14 | 0.77 ± 0.06 | 1.00 ± 0.00 | 0.74 ± 0.07 | ||
Random Forest | 50 | 0.2 | 21.90 ± 10.08 | 0.00 ± 0.00 | 5.00 ± 0.00 | 16.90 ± 10.08 | 28.09 ± 10.08 | 0.66 ± 0.20 | 1.00 ± 0.00 | 0.62 ± 0.22 |
0.5 | 17.50 ± 6.11 | 0.00 ± 0.00 | 5.00 ± 0.00 | 12.50 ± 6.11 | 32.50 ± 6.11 | 0.75 ± 0.12 | 1.00 ± 0.00 | 0.72 ± 0.13 | ||
0.7 | 13.66 ± 1.55 | 0.00 ± 0.00 | 5.00 ± 0.00 | 8.66 ± 1.55 | 36.33 ± 1.55 | 0.82 ± 0.03 | 1.00 ± 0.00 | 0.80 ± 0.03 |