Gaviota tablebases : kppkp corrupted

[Olivier Deville]

Gaviota tablebases : kppkp corrupted, according to tbcheck util.

Olivier

[Miguel A. Ballicora]

Gaviota tablebases : kppkp corrupted, according to tbcheck util.

Olivier

Hi Oliver,

Could you do the following?

1) donwload the last gaviota and tbcheck version
2) delete kppkp.gtb
3) regenerate only kppkp.gtb (doing tbgen 5 in gaviota should do only the one that is missing)
4) run tbcheck again and let me know.

Is this a file you generated or downloaded?

There were some problems in the first versions I released, and after some back and forth debugging sessions with Gabor we think we got rid of all the problems.

Miguel

[Olivier Deville]

Hi Miguel

The corrupted file belongs to the set that I download from olympuschess site.

I tried to run tbgen 5 under gaviota, but it seems to produce only 3 men tbs.

Olivier

[Miguel A. Ballicora]

Hi Miguel

The corrupted file belongs to the set that I download from olympuschess site.

I tried to run tbgen 5 under gaviota, but it seems to produce only 3 men tbs.

Olivier

I will download it from olympuschess and take a look.

What output do you have after to type tbgen 5? what folder do you have the TBs?

Miguel

[Olivier Deville]

Hi Miguel

The corrupted file belongs to the set that I download from olympuschess site.

I tried to run tbgen 5 under gaviota, but it seems to produce only 3 men tbs.

Olivier

I will download it from olympuschess and take a look.

What output do you have after to type tbgen 5? what folder do you have the TBs?

Miguel

Hi Miguel

For this test everything was in c:\gtb folder.

Here is the output I am geting :

images/gtb.JPG

Olivier

[Miguel A. Ballicora]

Hi Miguel

The corrupted file belongs to the set that I download from olympuschess site.

I tried to run tbgen 5 under gaviota, but it seems to produce only 3 men tbs.

Olivier

I will download it from olympuschess and take a look.

What output do you have after to type tbgen 5? what folder do you have the TBs?

Miguel

Hi Miguel

For this test everything was in c:\gtb folder.

Here is the output I am geting :

images/gtb.JPG

Olivier

mmhh... There is something strange about how it was installed or anything like that. I will get back to you with more precise questions.

Miguel

[Olivier Deville]

Hi Miguel

We are making progress I added the gaviota.ini file (I thought it was not needed for generating tbs).

tbs are being generated right now. Afterwards i'll run tbcheck and we'll see what happens.

Olivier

[Miguel A. Ballicora]

Hi Miguel

We are making progress I added the gaviota.ini file (I thought it was not needed for generating tbs).

tbs are being generated right now. Afterwards i'll run tbcheck and we'll see what happens.

Olivier

Yes, it finds the destination folders in the ini file. Let me know how it goes!

Miguel

[Olivier Deville]

Hi Miguel

We are making progress I added the gaviota.ini file (I thought it was not needed for generating tbs).

tbs are being generated right now. Afterwards i'll run tbcheck and we'll see what happens.

Olivier

Yes, it finds the destination folders in the ini file. Let me know how it goes!

Miguel

Here are the news :

See the screenshot, kppkp is not saved (there was no kppkp.gtb in the folder).

images/gtb2.JPG

Olivier

[Olivier Deville]

Here is my gaviota.ini :

;=========================
; parameters for Gaviota
;=========================

;-------------------------------------------------------
; name that Winboard will use for saving games into pgn
;-------------------------------------------------------

;name = "Gaviota 0.74.41"

;------------------------------------------------------------
; hashmem --> is hash tables (transposition, refutation).
; ref_table --> is a special table for refutation moves,
; keep it smaller than hashmem,
; probably half is best
; learn_table --> holds information from learn.epd
; do not set it bigger than 1 M
; pawn_table --> information about pawn structure.
; keep it small, 1-4 M
; M is Megabytes, k kilobytes , b bytes
;-------------------------------------------------------------

hashmem = 64 M
ref_table = 32 M
learn_table = 1 M
pawn_table = 1 M

;----------------------------------------------
; log info. max_logs is number of files kept.
; After that number is reached, it will start
; to overwrite them
;----------------------------------------------

log = off
max_logs = 200
log_path = "logs"

;-----------------------------------------------------------------------
; ponder can have three values, 0, 1, or 2 (recommended).
; 2: Pondering will be determined by the interface (winboard, etc.)
; 1: Ponder is on, hardwired, no matter what the interface wants
; 0: Ponder is off, hardwired, won't turn on even if the interface wants
;-----------------------------------------------------------------------

ponder = 2

;-------------
; book info
;-------------

book = on
book_file = "cleanbook.bin"
book_learn = on

;------------------------------------------------
; learning of positions when is out of book.
; learn = on --> will save what just learned,
; use_learned = on --> will use any previous stored
; information in the "learn_file"
; learn_file = "/properpath/whatevername.epd"
;------------------------------------------------

learn = on
use_learned = on
learn_file = "learn.epd"

;-------------------------------------------------------------------
; won't show every output detail in the first n plies of the search
;-------------------------------------------------------------------

quiet_level = 6

;---------------------------------------------------------------------------
; logs when the node/sec is lower than "alert_nps"
; it is useful to detect when the program slowed down because of the OS etc.
;---------------------------------------------------------------------------

alert_nps = 10000

;-----------------------------------------------------------------
; Runs all the commands included in the file after initialization
; and before accepting commands from the user.
; Delete the command if you do not want to have an initial script
; or comment it out placing a semicolon before.
;-----------------------------------------------------------------

;script_file = "input.txt"

;-----------------------------
; Resign in hopeless position?
;-----------------------------

resign_mode = on

;------------------------------------------------------
; Should I kibitz info on computer tournaments online?
;------------------------------------------------------

kibitz = off

;---------------------------------
;
; Gaviota Tablebase parameters
;
;---------------------------------

use_tablebase = on
tb_compression = off
tb_decoding_scheme = 4
tb_probing_depth = 2
tb_pieces_used = 5
tb_cache = on
tb_cache_size = 64 M

tb_path_1 = "c:\gtb"
tb_path_2 = ""
tb_path_3 = ""
tb_path_4 = ""


;-------------------------------------------------------------------
; SAN support (Standard Algebraic Notation) (e.g. Nf3)
; on ==> will try to send and accept SAN moves if GUI supports it
; off ==> will use default coordinate notation (e.g. g1f3)
;
; Some GUIs (Arena, ChessGUI etc.) are NOT fully SAN compliant
; and send wrong SAN moves. Use SAN = off with those GUIs
;-------------------------------------------------------------------

SAN = off

;------------------------------------------------------------
; PARALLEL SEARCH
; cores --> CPU Usage
; Gaviota will launch up a number of threads
; equal to this value
; Supported up to 16 cores
;------------------------------------------------------------

cores = 1

;-------
; end!
;-------

[Miguel A. Ballicora]

Hi Miguel

We are making progress I added the gaviota.ini file (I thought it was not needed for generating tbs).

tbs are being generated right now. Afterwards i'll run tbcheck and we'll see what happens.

Olivier

Yes, it finds the destination folders in the ini file. Let me know how it goes!

Miguel

Here are the news :

See the screenshot, kppkp is not saved (there was no kppkp.gtb in the folder).

images/gtb2.JPG

Olivier

Based on the screen shot and the ini, try

tb_path_1 = "c:\gtb\"

rather than

tb_path_1 = "c:\gtb"

It is trying to save c:\gtbkppkp.gtb according to the screen shot rather than c:\gtb\kppkp.gtb

Gaviota is supposed to figure out that the \ is missing, but apparently does not. In Linux works well but in windows there must be something that I did wrong. I will try to correct it.
Maybe it was generated and saved as c:\gtbkppkp.gtb. If that is the case, you can try renaming it and put it in the folder. In any case, I would change the ini.

Miguel

[Olivier Deville]

Yes I just noticed it myself Trying it right now.

Olivier

[Olivier Deville]

Victory

My own generated kppkp.gtb is not corrupted.

Olivier

[Miguel A. Ballicora]

Victory

My own generated kppkp.gtb is not corrupted.

Olivier

Great!

Now, if you want, you can compress them with

tbcp -s4 <folder>

(to use compression scheme 4, the one that gives smallest files)
it may take 7 to 9 hours but it will reduce the whole thing to 6.5 GiB. You can remove the original files manually. If you have backups of the original ones (just to be cautious for now), or you are a brave tester, you can run

tbcp -r -s4 <folder>

And the original ones will be removed automatically You can always get the original files from the compressed ones, though, reverting the process.

Miguel