Marc Lacrosse wrote:Roger Brown wrote:Guenther Simon wrote:
I would offer my medium book which is permanently updated (...)
The book is a definite yes (...)
May I remind you that my performance.bin polyglot opening book which was initially bundled with Fruit 2.2 in 2005 has been made freely available and is downloadable at Leo's site since early 2006.
This is the book with which Fruit topped the SSDF rating list and won WBEC ridderkerk tournament a few months before rybka appeared.
Although it is now old (three years is an eternity in opening theory), this book still holds his own against most general opening books.
Just to see, I tested it against the one that Guenther Simon just offered to include in your proposed bundle (GS_medium081104).
I made two identical teams and had them play a scheveningen-type tournament. Team one played with Guenther's book and Team Two with my old performance.bin. Each member from team one played 50 fast blitz games against each member of team two on a fast quad under WinXP 64.
Each team was made of the four best free engines according to latest CCRL lists :
Rybka (2.2n2), Toga (1.4.2JD), Glaurung (2.1), Bright (0.3a).
Results :
Performance beats GSmedium +272 =276 -252 (51.25%)
This is almost equality according to bayeselo (+ 8 Elo points for Performance, with a LoS of 77%).
Taking into account that GSmedium weights 3271 KB while Performance is 1453 KB, I am not sure that your choice is best.
Regards
Marc
Hi Marc,
Some thoughts here:
In my understanding HG seems to look for sth even smaller and
I created a 663KB(unzipped) Polyglot book file meanwhile, with
a max depth of 16 plies. But of course it is also just a well meant offer
and I don't care if any other book is included in that bundle.
I also want to mention that you can well get the same result you got
between my book and your book, if you just rename your book and let
it play against itself, because an exact 50% score in this test would
be even more unlikely statistically. I guess also that your book goes
further than max. 30 plies like mine? But this just as a side note.
Actually in the beginning I hated to create books, because IMHO it
should be the authors task to create a book for his engine for those
people who still like to match progs as they come, the oldfashioned
way with _own_ books. IMHO the author that way simply shifts the responsibility
for some non trivial part of the engines games to the poor users,
even if they didn't ask for it.
This happened more and more with UCI engines coming up(I am very
grateful therefore that Fruit the prototype of a great UCI engine came with
your book and that even the mother of all UCIs, Shredder, in later
versions delivered an own GUI independent book!
This is true of course for all other UCI engines authors who didn't decide against bothering
with integrating book code!) and now one can see lots of wasted games in the net because users
set their GUI books up wrongly or use faulty own book creations
or use settings not delivered by a third parties book creator or whatever...
AFAIK CCRL and CEGT delete all games with a too bad opening lines,
as they are responsible for the choosen book after they don't use
authors books at all. This is at least consequent. I hate that I have to do
the same when a bad line slipped through which happens very rarely,
but well as I said now the testers are responsible, which is not so nice.
Some testers simply ignore this, choose a book from a third party, may
be even set it up faulty and let the result even after -3.00 or bigger for
the first out of book move...
The author of such an engine probably just says never
mind the user provided crappy opening lines...
But well the situation cannot be changed anymore and now we have a lot
of programs(especially UCI) which need books from another side.
This creates a new problem at least for 'oldfashioned' (natural way?)testers,
who don't like to test from start positions or mini default books but
own 'normal' books. No single person can provide high quality _specialized_ books
for all of those bookless UCI engines. Instead the
compromise is to make a book which can _both_ hold its own against
books of engines with released books _and_ against _itself_ which is
nearly a paradoxon. This is because now all bookless UCI engines play
against the same used book...)
IMHO the way to test such a book against another book is to play it against
itself and measure the bad lines coming out of a sample of games
and playing both books against different other books and then compare
the results. I guess in the first part of the test a book with bigger depth
will have worse results and in the second part it's the opposite.
I hope I could make my thoughts and the dilemma somehow clear?
[not so sure about it
]
Regards,
Guenther
P.S. Despite all above I would still welcome a way to set max depth of
a Polyglot book via the Polyglot.ini file too, quasi simulating
book depth limiting by other UCI able GUIs.
Edited:
P.S.2 Oops, I forgot to ask for the played games against my medium book.
Of course I am interested in the lines played for further improving.
Thus if you still have the games available and want to share them,
I would be very pleased.
You could send them to rwbc(at)gmx.de