| Solver | #Ins. | ISAC+-2015-pms | Open-WBO-R | mscg2015b | mscg2015a | maxino-k16 | maxino-kdyn | MaxHS | WPM3-2015-co | optiriss-def | Open-WBO | LMHS-C | QMSAT15UC | Open-WBO-L | QMSAT14 | LMHS-I | msUZK-nopp | ILP-2015 | msUZK-pp | toysat | WMaxSatz+ | WMaxSatz09 | ratselfax-cnf | optiriss-sel | ahms-ls-1.55 | ahms-1.55 | toysat_ls | ahms-ls-1.68 | ahms-1.68 | CCEHC2akms | CCLS2akms |
|---|
| aes-key-recovery | 76 | 56.25(60) | 121.49(72) | 112.42(71) | 62.31(69) | 100.20(72) | 45.46(69) | 102.52(67) | 63.11(60) | 21.96(72) | 30.81(73) | 105.52(48) | 36.58(40) | 537.25(20) | 394.33(16) | 127.52(53) | 240.44(13) | 581.91(5) | 374.22(23) | 65.25(37) | 0.00(0) | 0.00(0) | 0.00(0) | 46.82(74) | 0.00(0) | 0.00(0) | 714.57(40) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| causal-discovery | 81 | 165.11(72) | 94.26(81) | 122.66(80) | 129.04(81) | 101.79(80) | 104.98(81) | 151.28(81) | 135.53(79) | 153.28(71) | 164.50(71) | 220.08(77) | 150.55(78) | 156.52(81) | 170.63(81) | 212.01(69) | 202.14(67) | 0.00(0) | 176.09(68) | 614.11(41) | 1417.90(1) | 1284.49(1) | 549.19(44) | 97.73(44) | 0.00(0) | 0.00(0) | 625.48(13) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| fault-diagnosis | 100 | 61.02(89) | 74.96(90) | 63.36(96) | 26.32(90) | 69.76(90) | 47.66(89) | 49.90(53) | 59.44(89) | 76.46(90) | 43.94(88) | 61.50(52) | 46.29(71) | 67.21(88) | 30.98(88) | 1.07(50) | 46.22(50) | 3.06(50) | 45.04(50) | 20.30(51) | 18.24(24) | 17.83(24) | 31.61(51) | 48.88(80) | 0.00(0) | 0.00(0) | 613.67(13) | 0.00(0) | 0.00(0) | 11.59(3) | 0.00(0) |
| frb | 25 | 244.23(22) | 29.41(25) | 122.56(15) | 142.63(11) | 410.73(6) | 96.87(6) | 264.18(15) | 281.69(6) | 176.34(25) | 958.87(3) | 224.39(12) | 70.18(25) | 68.00(25) | 61.74(25) | 221.69(12) | 215.89(10) | 267.17(12) | 186.56(6) | 139.71(24) | 283.25(5) | 315.98(5) | 0.00(0) | 0.00(0) | 91.71(5) | 89.87(5) | 123.57(22) | 154.56(5) | 161.87(5) | 345.36(5) | 340.53(5) |
| job-shop | 3 | 18.93(3) | 45.26(3) | 35.47(3) | 38.49(3) | 49.99(3) | 48.30(3) | 31.77(3) | 49.21(3) | 44.99(3) | 43.29(3) | 49.53(3) | 44.76(3) | 17.67(3) | 16.54(3) | 46.22(3) | 25.53(3) | 0.00(0) | 23.72(3) | 768.38(3) | 0.00(0) | 0.00(0) | 634.89(3) | 51.09(3) | 0.00(0) | 0.00(0) | 1400.20(1) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
| maxclicque/random | 96 | 2.99(96) | 17.07(96) | 103.45(86) | 114.26(85) | 156.32(86) | 126.65(83) | 23.13(96) | 101.04(86) | 119.31(68) | 124.62(82) | 27.81(96) | 87.21(80) | 92.05(78) | 92.21(80) | 27.39(96) | 140.57(74) | 27.73(96) | 79.34(65) | 158.66(59) | 2.28(96) | 2.16(96) | 65.88(68) | 281.43(14) | 0.99(96) | 0.99(96) | 185.37(62) | 1.26(96) | 1.32(96) | 4.51(96) | 4.33(96) |
| maxclicque/structured | 62 | 37.10(43) | 69.69(36) | 106.28(28) | 116.74(27) | 230.03(28) | 215.42(28) | 139.55(38) | 113.29(28) | 45.48(20) | 93.84(25) | 178.58(38) | 164.45(26) | 204.02(27) | 157.60(27) | 175.21(38) | 75.91(21) | 131.39(37) | 24.89(19) | 56.93(15) | 134.31(37) | 116.78(36) | 199.95(18) | 29.13(14) | 56.53(29) | 54.36(29) | 140.61(16) | 33.76(28) | 30.47(28) | 112.16(37) | 107.31(37) |
| maxone/3sat | 80 | 2.26(80) | 13.00(80) | 11.13(80) | 13.98(80) | 8.84(80) | 7.12(80) | 1.93(80) | 7.01(80) | 95.84(78) | 31.29(80) | 3.13(80) | 140.24(80) | 111.06(80) | 98.17(80) | 3.10(80) | 318.87(65) | 2.85(80) | 213.99(45) | 126.57(38) | 0.41(80) | 0.41(80) | 101.81(30) | 69.66(30) | 0.83(80) | 0.84(80) | 176.10(38) | 0.47(80) | 0.48(80) | 1.27(80) | 1.11(80) |
| maxone/structured | 60 | 7.84(59) | 23.76(59) | 3.63(60) | 3.67(60) | 2.09(60) | 2.03(60) | 10.13(60) | 3.56(60) | 45.56(59) | 16.21(59) | 8.19(60) | 7.61(60) | 5.27(60) | 4.33(60) | 8.15(60) | 29.99(60) | 46.00(59) | 32.11(60) | 25.60(60) | 92.35(58) | 85.66(58) | 4.27(60) | 61.90(9) | 24.49(44) | 23.83(44) | 36.93(60) | 236.05(28) | 219.12(28) | 372.21(15) | 379.19(15) |
| min-enc/kbtree | 42 | 72.67(42) | 307.66(11) | 24.07(6) | 22.76(6) | 184.54(6) | 214.10(6) | 405.09(12) | 174.88(7) | 54.47(6) | 47.40(6) | 716.50(6) | 124.97(6) | 75.29(6) | 74.50(6) | 630.30(6) | 808.32(5) | 32.16(42) | 572.17(4) | 0.00(0) | 646.53(11) | 650.43(11) | 0.00(0) | 218.36(2) | 504.92(34) | 477.71(33) | 0.00(0) | 556.86(35) | 502.87(34) | 334.22(6) | 232.75(6) |
| pseudo/miplib | 4 | 25.65(4) | 9.54(4) | 12.08(4) | 13.25(4) | 31.64(4) | 35.20(4) | 3.25(4) | 3.89(4) | 11.41(4) | 11.48(4) | 3.34(4) | 2.66(4) | 2.91(4) | 2.34(4) | 3.31(4) | 10.77(4) | 24.18(4) | 55.78(4) | 401.81(4) | 595.73(3) | 582.45(3) | 1.46(3) | 0.78(3) | 0.02(2) | 0.02(2) | 0.88(3) | 0.02(2) | 0.02(2) | 375.37(3) | 381.94(3) |
| reversi | 44 | 48.02(33) | 18.38(33) | 12.44(33) | 13.12(33) | 22.56(33) | 21.99(33) | 19.05(31) | 12.18(33) | 22.93(33) | 20.05(33) | 21.44(31) | 11.62(33) | 19.33(33) | 21.06(33) | 49.13(31) | 36.46(33) | 23.66(15) | 27.01(32) | 299.17(31) | 113.27(7) | 112.35(7) | 177.39(32) | 67.24(33) | 1.31(3) | 1.12(3) | 126.55(16) | 0.95(3) | 0.95(3) | 405.83(7) | 408.78(7) |
| scheduling | 5 | 0.00(0) | 330.35(1) | 484.78(1) | 137.25(1) | 412.56(2) | 106.30(1) | 0.00(0) | 140.82(1) | 334.33(1) | 553.71(1) | 0.00(0) | 1191.99(1) | 655.15(1) | 1099.01(1) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) | 0.00(0) |
|
| Total | 678 | 603 | 591 | 563 | 550 | 550 | 543 | 540 | 536 | 530 | 528 | 507 | 507 | 506 | 504 | 502 | 405 | 400 | 379 | 363 | 322 | 321 | 309 | 306 | 293 | 292 | 284 | 277 | 276 | 252 | 249 |