| Solver | #Ins. | LMHS-I | MaxHS | mscg2015b | maxino-kdyn | maxino-k16 | mscg2015a | LMHS-C | Open-WBO | WPM3-2015-co | optiriss-def | QMSAT14 | optiriss-sel | QMSAT15UC | ILP-2015 | Open-WBO-L | ratselfax-cnfc4 | ratselfax-cnf | msUZK-nopp | msUZK-pp | WMaxSatz+ | WMaxSatz09 | toysat | toysat_ls | CCEHC2akms | ahms-ls-1.68 | ahms-1.55 | ahms-ls-1.55 | ahms-1.68 | CCLS2akms |
|---|
| BTBNSL | 60 | 203.24(45) | 343.90(28) | 85.26(13) | 101.82(16) | 109.02(15) | 120.85(6) | 234.26(28) | 76.61(12) | 0.00(0) | 64.86(6) | 200.40(28) | 0.00(0) | 201.47(28) | 91.88(9) | 0.00(0) | 214.48(4) | 290.74(7) | 0.00(0) | 0.00(0) | 44.46(4) | 45.16(4) | 85.98(3) | 87.87(2) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| ustrial/correlation-clustering | 129 | 295.95(77) | 361.48(75) | 459.74(30) | 289.81(23) | 203.72(21) | 283.23(25) | 445.01(68) | 581.92(12) | 493.61(4) | 665.39(9) | 1354.96(1) | 0.00(0) | 1564.96(2) | 18.57(5) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| dustrial/haplotyping-pedigrees | 100 | 285.08(82) | 264.63(89) | 13.61(100) | 8.51(100) | 8.28(100) | 17.31(100) | 413.39(50) | 12.56(99) | 38.97(100) | 30.61(100) | 248.72(80) | 39.62(92) | 322.61(63) | 210.72(13) | 15.85(99) | 68.21(18) | 353.32(18) | 249.30(33) | 248.22(33) | 0.00(0) | 0.00(0) | 19.86(20) | 0.00(0) | 303.75(1) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| hs-timetabling | 14 | 522.40(2) | 0.00(0) | 0.00(0) | 832.37(2) | 1131.96(2) | 1670.95(1) | 551.21(2) | 268.76(1) | 368.55(1) | 0.00(0) | 0.00(0) | 0.00(0) | 781.46(1) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 1403.73(1) | 1172.43(1) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| packup-wpms | 99 | 7.78(99) | 3.99(99) | 5.83(99) | 1.32(98) | 1.39(98) | 1.95(99) | 4.03(99) | 20.69(95) | 12.60(99) | 43.84(89) | 229.82(77) | 7.49(78) | 257.59(67) | 0.54(99) | 0.00(0) | 10.92(2) | 11.77(2) | 1542.69(2) | 1716.37(2) | 326.45(14) | 327.43(14) | 47.96(2) | 133.39(2) | 389.08(20) | 14.58(16) | 9.78(16) | 10.34(16) | 14.08(16) | 264.93(11) |
| industrial/preference_planning | 29 | 63.04(28) | 69.43(28) | 25.88(29) | 17.49(29) | 24.38(29) | 28.82(29) | 74.42(28) | 12.47(29) | 24.35(29) | 70.30(29) | 14.02(29) | 11.01(19) | 32.91(29) | 463.98(12) | 17.32(29) | 84.01(25) | 151.48(26) | 100.31(29) | 120.27(29) | 2.30(5) | 2.29(5) | 170.54(25) | 171.97(25) | 3.19(5) | 0.14(2) | 0.14(2) | 0.19(2) | 0.09(2) | 3.02(5) |
| railway-transport | 11 | 420.34(3) | 223.91(3) | 87.13(3) | 141.92(3) | 195.08(3) | 252.31(3) | 633.91(3) | 250.36(3) | 406.82(3) | 9.00(2) | 672.47(5) | 6.73(2) | 205.63(3) | 0.00(0) | 407.19(3) | 0.00(0) | 0.00(0) | 177.71(1) | 160.88(1) | 0.00(0) | 0.00(0) | 991.92(1) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| timetabling | 26 | 492.04(6) | 668.10(7) | 70.59(12) | 106.16(12) | 90.11(12) | 95.36(13) | 199.26(4) | 67.48(12) | 272.48(12) | 267.83(9) | 385.29(9) | 99.25(7) | 434.72(12) | 0.00(0) | 574.46(5) | 0.00(0) | 0.00(0) | 993.32(4) | 1114.12(5) | 0.00(0) | 0.00(0) | 721.37(2) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| ustrial/upgradeability-problem | 100 | 4.07(100) | 1.31(100) | 1.14(100) | 0.57(100) | 0.57(100) | 0.79(100) | 4.11(100) | 1.51(100) | 3.80(100) | 2.32(100) | 239.16(74) | 22.84(100) | 409.11(54) | 0.74(100) | 108.43(93) | 229.25(35) | 734.07(29) | 0.00(0) | 0.00(0) | 275.85(46) | 276.22(46) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| wcsp/spot5/dir | 21 | 2.74(6) | 55.68(7) | 196.43(17) | 0.19(14) | 0.33(14) | 103.30(16) | 1.92(6) | 6.55(14) | 161.53(18) | 19.53(14) | 128.16(18) | 60.73(14) | 96.27(17) | 12.35(17) | 29.39(9) | 24.87(3) | 9.15(3) | 24.84(7) | 52.43(7) | 0.05(4) | 0.05(4) | 7.80(7) | 23.58(6) | 0.45(4) | 249.04(4) | 1.31(4) | 155.54(4) | 1.83(3) | 0.41(4) |
| wcsp/spot5/log | 21 | 3.12(6) | 48.77(7) | 0.56(14) | 0.59(14) | 0.71(14) | 98.03(15) | 1.53(6) | 59.34(14) | 5.91(14) | 14.12(8) | 176.22(17) | 111.71(7) | 20.57(15) | 0.54(6) | 19.99(8) | 14.19(3) | 13.10(3) | 69.64(7) | 0.79(6) | 0.69(3) | 0.98(3) | 0.50(6) | 18.83(6) | 170.77(5) | 313.03(5) | 332.38(4) | 232.97(4) | 0.27(4) | 171.32(5) |
|
| Total | 610 | 454 | 443 | 417 | 411 | 408 | 407 | 394 | 391 | 380 | 366 | 338 | 319 | 291 | 261 | 246 | 90 | 88 | 84 | 84 | 76 | 76 | 66 | 41 | 35 | 27 | 26 | 26 | 25 | 25 |