1000 Games Test
Inspired by the test of Chris Tatham many years ago I began a new one with actual settings and hardware.
Each engine run a gauntlet of 40 games against 25 opponents (no Chessmasters). Opponents choosen are around + - 130Elo of CM10 Deault. He scored 499 :)
Time control is 40 moves in 2 minutes repeating
Opening book is FEOBOS by Frank Quisinsky
each opening two times and in sequence
Hashtables 128mb, 512mb for T8
In the list you will find a column named "Top 10 win %". This means how high the chance is to win against the Top10 engines from this test. All creators of setting know when testing a new one quick against two or three opponents you can get a realy good result but then in a greater tournament the engine plays not so good. A setting can get a high score in this list but has a low win percentage. This means this setting makes more points against engines of same or lower and less against Top10 strength.
Playing CM against CM will be fun but you can get very different results.
Games download: 1000 games test
Opponent List:
Spike 1.2 Turin
ChessbrainVB 3.03
Arasan 15.6 x64
Shredder 7.04
Ktulu 7.5
Rebel Polgar (owen Setting)
Atlas 3.50 x64
EXChess 6.50b x64
Chronos 1.9.7
Gaviota 0.84
Deep Gandalf 7 x64
Shredder Classic 1.3
Wildcat 7
KnightX 3 x64
Shredder 5.32
Scorpio 2.0
K2 0.91
Arasan 13
Danasah 7.9
N2 0.4
Jonny 2.89
Colossus 2006c
Ufim 8.02
Rebel Century
CT800 1.43 x64