Geschrieben von:/Posted by: Robert Allgeuer at 24 April 2004 00:10:55:
Under my test conditions List 5.12 scored higher than Ruffian 1.0.1 and is now the strongest free engine in YABRL. It also scored almost equal to the leading Ruffian 2.1.0, just some tiny 5 points behind.
However - as posted in this forum a few days ago - List has a bug and does not know how to mate against a lone king. I therefore had to make a decision, and decided to test in such a way that all opponents resign a lost game. If the opponent engine did not support resignation, I adjudicated such a game. This was done in order to avoid that engines that do resign have a disadvantage.
As a bottomline this means that the resulting rating is the one of List under the assumption that all opponents resign, if they are lost (resign threshold 7 pawn units). If one would let play all games to the end, List´s rating would drop significantly.
List won the direct comparison against Ruffian 2.1.0 and 1.0.1; interestingly Anmon 5.30 is the engine that scored the highest against List.
List played in the ChessPartner GUI with a book built from Dann Corbit´s book.pgn file.
For conditions and tools please refer to the link below. Next I will put all these results into perspective by adding a strong commercial engine, Chesstiger 15.
Robert
Program  Elo +  -  Games  Score  Av.Op. Draws
 01 Ruffian v2.1.0 : 2675  18 27  798 70.7 %  2522  24.9 %
 02 Ruffian v2.0.0 : 2675  17 27  840 71.6 %  2514  25.8 %
 03 List v5.12 : 2670  19 28  696 69.6 %  2526  26.6 %
 04 Ruffian v1.0.1 : 2648  17 23  956 68.8 %  2511  27.2 %
 05 DeepSjeng v1.6ntb  : 2627  20 25  779 65.0 %  2519  24.9 %
 06 Ktulu v4.2 : 2591  20 22  855 60.5 %  2517  24.3 %
 07 SmarThink v0.17a : 2589  20 21  859 59.7 %  2521  25.5 %
 08 Thinker v4.5b  : 2589  21 20  816 59.6 %  2521  33.2 %
 09 Crafty v17.14DC  : 2588  18 18 1038 60.1 %  2517  33.0 %
 10 Crafty v19.06DCntb : 2583  20 19  901 58.8 %  2521  30.5 %
 11 Aristarch v4.21  : 2578  18 19 1057 58.6 %  2517  24.7 %
 12 Aristarch v4.37  : 2573  21 18  839 57.6 %  2520  36.6 %
 13 Delfi v4.3 : 2567  20 19  980 57.2 %  2517  25.4 %
 14 Crafty-MPC v18.15DC  : 2561  20 19  964 56.4 %  2517  27.3 %
 15 Delfi v4.2 : 2561  25 25  580 58.1 %  2504  27.2 %
 16 SmarThink v0.16b++ : 2559  21 21  836 58.0 %  2503  24.3 %
 17 Little Goliath 2000 v3.9 : 2557  19 18 1060 55.6 %  2518  26.4 %
 18 Crafty v18.15DC  : 2557  22 22  741 59.0 %  2493  29.0 %
 19 El Chinito v3.25 : 2556  22 20  820 55.5 %  2517  27.6 %
 20 SoS 3  : 2555  19 18 1059 55.3 %  2518  22.8 %
 21 Yace Paderborn : 2552  20 18 1040 55.2 %  2516  25.9 %
 22 Pepito v1.59 profile : 2550  20 18 1060 54.7 %  2518  25.6 %
 23 Aristarch v4.4 : 2547  36 34  319 54.1 %  2518  20.4 %
 24 SoS 4  : 2542  23 20  839 53.4 %  2519  24.1 %
 25 Green Light Chess v3.00  : 2542  20 17 1060 53.4 %  2518  26.0 %
 26 Yace v0.99.56  : 2541  33 29  380 54.3 %  2511  26.6 %
 27 Little Goliath 2000 v3.5 : 2536  31 25  440 53.6 %  2511  30.9 %
 28 Tao v5.6 : 2526  25 20  776 50.6 %  2522  24.5 %
 29 Anmon v5.30  : 2525  24 19  820 51.0 %  2518  26.8 %
 30 Amyan v1.59  : 2513  18 23  931 49.8 %  2514  26.0 %
 31 Pharaon v2.62  : 2509  17 21 1057 48.6 %  2518  24.2 %
 32 Crafty v19.01DC  : 2499  24 19  815 50.4 %  2496  25.5 %
 33 LambChop v10.99  : 2495  18 20 1057 46.5 %  2519  22.5 %
 34 Ktulu v3.9 : 2491  19 24  779 48.6 %  2501  26.1 %
 35 Gromit v3.8.2  : 2489  18 20 1037 45.8 %  2518  23.2 %
 36 SlowChess v2.89b : 2488  19 21  917 46.0 %  2516  23.9 %
 37 KnightDreamer v3.2 : 2486  19 21  960 45.4 %  2518  24.8 %
 38 Anmon v5.22  : 2483  19 22  899 46.4 %  2508  26.7 %
 39 Comet B44-2  : 2480  18 20  980 44.4 %  2519  26.4 %
 40 Amy v0.8.3 : 2476  20 19 1049 43.9 %  2519  19.0 %
 41 SoS v11-99 : 2476  33 34  359 46.0 %  2504  17.3 %
 42 Tao v5.4 : 2475  19 19 1039 44.1 %  2516  21.0 %
 43 Dragon v4.4.3  : 2470  19 20  925 43.3 %  2517  25.8 %
 44 Comet B62-3  : 2458  20 19  960 41.4 %  2518  25.5 %
 45 Francesca M.0.0.9  : 2442  20 18 1058 38.9 %  2520  25.0 %
 46 PostModernist v1.007 : 2441  21 18  980 38.9 %  2520  25.0 %
 47 Comet B60  : 2434  22 21  780 41.2 %  2496  25.6 %
 48 Leila v0.53h : 2426  23 18  978 36.9 %  2520  21.0 %
 49 Tcb v0045  : 2422  22 18  979 36.3 %  2520  24.3 %
 50 Resp v0.19 : 2404  23 17  960 33.9 %  2519  23.4 %
 51 Nejmet v3.07 : 2389  25 18  876 33.2 %  2510  22.3 %
 52 SlowChess v2.78  : 2378  27 19  790 33.5 %  2497  19.6 %
 53 Exchess v4.03  : 2329  30 15  959 24.9 %  2521  21.4 %
 54 Beowulf v2.2 : 2303  33 14 1020 22.4 %  2519  17.5 %
Games : 23676 (finished)
White Wins  :  9615 (40.6 %)
Black Wins  :  8100 (34.2 %)
Draws :  5961 (25.2 %)
Unfinished  : 0
White Perf. : 53.2 %
Black Perf. : 46.8 %
(3) List v5.12 : 696 (+392,=185,-119), 69.6 %
Ruffian v2.1.0 : 20 (+ 10,= 5,- 5), 62.5 %
DeepSjeng v1.6ntb  : 20 (+ 6,= 8,- 6), 50.0 %
SmarThink v0.17a : 20 (+ 11,= 5,- 4), 67.5 %
Thinker v4.5b  : 20 (+ 10,= 7,- 3), 67.5 %
Crafty v17.14DC  : 20 (+ 8,= 10,- 2), 65.0 %
Ktulu v4.2 : 20 (+ 5,= 6,- 9), 40.0 %
Crafty v19.06DCntb : 20 (+ 8,= 6,- 6), 55.0 %
Aristarch v4.21  : 20 (+ 11,= 6,- 3), 70.0 %
Aristarch v4.37  : 20 (+ 9,= 7,- 4), 62.5 %
Delfi v4.3 : 20 (+ 8,= 6,- 6), 55.0 %
Crafty-MPC v18.15DC  : 20 (+ 13,= 5,- 2), 77.5 %
El Chinito v3.25 : 20 (+ 14,= 6,- 0), 85.0 %
Little Goliath 2000 v3.9 : 20 (+ 8,= 8,- 4), 60.0 %
SoS 3  : 20 (+ 10,= 6,- 4), 65.0 %
Pepito v1.59 profile : 20 (+ 13,= 7,- 0), 82.5 %
Yace Paderborn : 20 (+ 12,= 4,- 4), 70.0 %
SoS 4  : 20 (+ 10,= 3,- 7), 57.5 %
Green Light Chess v3.00  : 20 (+ 7,= 8,- 5), 55.0 %
Anmon v5.30  : 20 (+ 5,= 5,- 10), 37.5 %
Pharaon v2.62  : 18 (+ 11,= 3,- 4), 69.4 %
LambChop v10.99  : 20 (+ 15,= 3,- 2), 82.5 %
Gromit v3.8.2  : 20 (+ 15,= 5,- 0), 87.5 %
KnightDreamer v3.2 : 20 (+ 14,= 3,- 3), 77.5 %
Ruffian v1.0.1 : 20 (+ 9,= 10,- 1), 70.0 %
Comet B44-2  : 20 (+ 14,= 1,- 5), 72.5 %
Tao v5.6 : 19 (+ 10,= 6,- 3), 68.4 %
Amy v0.8.3 : 20 (+ 14,= 5,- 1), 82.5 %
Dragon v4.4.3  : 20 (+ 13,= 7,- 0), 82.5 %
Comet B62-3  : 20 (+ 13,= 4,- 3), 75.0 %
Francesca M.0.0.9  : 19 (+ 12,= 4,- 3), 73.7 %
PostModernist v1.007 : 20 (+ 13,= 6,- 1), 80.0 %
Leila v0.53h : 20 (+ 17,= 0,- 3), 85.0 %
Tcb v0045  : 20 (+ 14,= 4,- 2), 80.0 %
Resp v0.19 : 20 (+ 14,= 3,- 3), 77.5 %
Exchess v4.03  : 20 (+ 16,= 3,- 1), 87.5 %
YABRL (Yet Another Blitz Rating List)