Page 1 of 1

Help with test suites

PostPosted: 22 Aug 2006, 16:20
by Carlos Pagador
Hello everyone,

In your experience, what is the best way to run an epd test suite for lets say Rybka 1.0 Beta?

Using a program, like Arena or maybe the epd Lyapko's tool or something else?

Thanks in advance.

Best regards,
Carlos

Re: Help with test suites

PostPosted: 22 Aug 2006, 17:12
by Nicolai Czempin
Carlos Pagador wrote:Hello everyone,

In your experience, what is the best way to run an epd test suite for lets say Rybka 1.0 Beta?

Using a program, like Arena or maybe the epd Lyapko's tool or something else?

Thanks in advance.

Best regards,
Carlos


Well, I'm happy with Arena, except it sometimes hangs after a few hundred positions.

The only other ways I tried were EPD2WB (via Polyglot to test my then-UCI-only engine) and Gradualtest. After discovering the feature in Arena (which I use for my engine-engine tournaments as well) I never looked for anything else.

Re: Help with test suites

PostPosted: 22 Aug 2006, 20:32
by Carlos Pagador
Hi Nicolai,

Thank you for the reply. I used Arena 1.1 for running epd tests (BWTC) with some engines, but I would also like to get more analysis information of each position. Arena creates a text file with the final evaluation for each position. BTW, what version of Arena do you use?

Re: Help with test suites

PostPosted: 22 Aug 2006, 21:15
by Nicolai Czempin
Carlos Pagador wrote:Hi Nicolai,

Thank you for the reply. I used Arena 1.1 for running epd tests (BWTC) with some engines, but I would also like to get more analysis information of each position. Arena creates a text file with the final evaluation for each position. BTW, what version of Arena do you use?


Arena creates a log file and a report. The report only contains the move and the time, the log contains much more.

I use Arena 1.1 exclusively.

Re: Help with test suites

PostPosted: 22 Aug 2006, 23:47
by Roger Brown
Nicolai Czempin wrote:
Arena creates a log file and a report. The report only contains the move and the time, the log contains much more.

I use Arena 1.1 exclusively.





Hmmmmmm.........


Later.

Re: Help with test suites

PostPosted: 23 Aug 2006, 16:58
by Nicolai Czempin
Roger Brown wrote:
Nicolai Czempin wrote:
Arena creates a log file and a report. The report only contains the move and the time, the log contains much more.

I use Arena 1.1 exclusively.





Hmmmmmm.........


Later.


:mrgreen:

Ooops. [and where's the blushing smiley when you need it]

Now that I know how to set up my engine for Winboard, I'll be using it more and more, because of the friendly and intelligent community that surrounds it that I really want to support. I didn't add WB to my engine for fun, but out of respect and admiration for all you guys (and gals?).

*Cough.*

Seriously, I use Arena exclusively for tournaments and test suites. But now that I have added WB support, naturally I need to test more with "the mother of chess GUIs".

Re: Help with test suites

PostPosted: 23 Aug 2006, 16:59
by Nicolai Czempin
Nicolai Czempin wrote:
Roger Brown wrote:
Nicolai Czempin wrote:
Arena creates a log file and a report. The report only contains the move and the time, the log contains much more.

I use Arena 1.1 exclusively.





Hmmmmmm.........


Later.


:mrgreen:

Ooops. [and where's the blushing smiley when you need it]

Now that I know how to set up my engine for Winboard, I'll be using it more and more, because of the friendly and intelligent community that surrounds it that I really want to support. I didn't add WB to my engine for fun, but out of respect and admiration for all you guys (and gals?).

*Cough.*

Seriously, I use Arena exclusively for tournaments and test suites. But now that I have added WB support, naturally I need to test more with "the mother of chess GUIs".


But what I really meant was "I use version 1.1 exclusively, i. e. not version 1.02 or 1.99beta"