Benchmark

LabelMeaning
SSolution {OPTIMUM FOUND or OPT | UNSATISFIABLE or UNSAT | UNKNOWN | Not available or N/A}
OBest solution found
TCPU time (TO for Time Out)
(out)(err)Standard output and standard error for each solver

ColorMeaning
TextBest solver column
TextOptimal solution with the best CPU time
TextOptimal solution and finished within the Time Out
TextOptimal solution and did not finish within the Time Out
TextTime Out
TextBuggy solution

Instance file name Best solver IncWMaxSatz WMaxSatz+ WMaxSatz-2009 WPM1 WPM2 akmaxsat akmaxsat_ls claspMaxSat sat4j-maxsat wbo1.6
mul_8_11.wcnf S = N/A
O = N/A
T = TO		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 2.71
(out)(err)		 S = N/A
O = N/A
T = 2.83
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = 429
T = TO
(out)(err)		 S = N/A
O = 1394
T = TO
(out)(err)		 S = N/A
O = 488
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)
mul_8_13.wcnf S = N/A
O = N/A
T = TO		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 2.74
(out)(err)		 S = N/A
O = N/A
T = 2.85
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = 429
T = TO
(out)(err)		 S = N/A
O = 1163
T = TO
(out)(err)		 S = N/A
O = 543
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)
mul_8_14.wcnf S = N/A
O = N/A
T = TO		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 2.52
(out)(err)		 S = N/A
O = N/A
T = 2.66
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = 384
T = TO
(out)(err)		 S = N/A
O = 1208
T = TO
(out)(err)		 S = N/A
O = 468
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)
mul_8_3.wcnf S = N/A
O = N/A
T = TO		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 1.06
(out)(err)		 S = N/A
O = N/A
T = 1.06
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = 99
T = TO
(out)(err)		 S = N/A
O = 492
T = TO
(out)(err)		 S = N/A
O = 241
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)
mul_8_9.wcnf S = N/A
O = N/A
T = TO		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 1.63
(out)(err)		 S = N/A
O = N/A
T = 1.70
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = 155
T = TO
(out)(err)		 S = N/A
O = 1124
T = TO
(out)(err)		 S = N/A
O = 375
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)
sbox_4.wcnf S = OPT
O = 22
T = 967.49		 S = OPT
O = 22
T = 967.49
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = OPT
O = 22
T = 1347.20
(out)(err)		 S = OPT
O = 22
T = 1140.02
(out)(err)		 S = N/A
O = 23
T = TO
(out)(err)		 S = N/A
O = 23
T = TO
(out)(err)		 S = N/A
O = N/A
T = 1800.00
(out)(err)
sbox_8.wcnf S = N/A
O = N/A
T = TO		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 0.00
(out)(err)		 S = N/A
O = N/A
T = 0.00
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = N/A
T = 21.43
(out)(err)		 S = N/A
O = N/A
T = 21.89
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)		 S = N/A
O = 671
T = 259.26
(out)(err)		 S = N/A
O = N/A
T = TO
(out)(err)