Yace memory usage

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 16:19:23:

While preparing AEGT, I see that Yace 0.99.87 takes only 17mb in memory (I tried several values for hashtables in yace.ini). I checked it both with TaskManager and TaskInfo. OS is WinXP home.
Any comments ?
Olivier


ChessWar + AEGT

[Christian Koch]

Geschrieben von:/Posted by: Christian Koch at 26 July 2004 16:23:30:
Als Antwort auf:/In reply to: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 16:19:23:

Hi Olivier,
here is my YACE.INI and it work pretty fine here since months
---------------------------------------------------------------------------
auto_log
hash 64M
tbldir c:\chess\tb4
sgames yacegam.pgn
book_learn 6
pos_learn 1
---------------------------------------------------------------------------
Hope this helps,
Christian

While preparing AEGT, I see that Yace 0.99.87 takes only 17mb in memory (I tried several values for hashtables in yace.ini). I checked it both with TaskManager and TaskInfo. OS is WinXP home.
Any comments ?
Olivier

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 16:55:50:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Christian Koch at 26 July 2004 16:23:30:

Hi Olivier,
here is my YACE.INI and it work pretty fine here since months
---------------------------------------------------------------------------
auto_log
hash 64M
tbldir c:\chess\tb4
sgames yacegam.pgn
book_learn 6
pos_learn 1
---------------------------------------------------------------------------
Hope this helps,
Christian

While preparing AEGT, I see that Yace 0.99.87 takes only 17mb in memory (I tried several values for hashtables in yace.ini). I checked it both with TaskManager and TaskInfo. OS is WinXP home.
Any comments ?
Olivier

Thanks for helping, Christian
I have the same thing here... When it loads, Yace allocates 80mb (if hash 64M), but drops immediately to 17mb. Very strange, I'll have to check this stuff.
Olivier



ChessWar + AEGT

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 17:16:15:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 16:55:50:

Hi Olivier,
here is my YACE.INI and it work pretty fine here since months
---------------------------------------------------------------------------
auto_log
hash 64M
tbldir c:\chess\tb4
sgames yacegam.pgn
book_learn 6
pos_learn 1
---------------------------------------------------------------------------
Hope this helps,
Christian

While preparing AEGT, I see that Yace 0.99.87 takes only 17mb in memory (I tried several values for hashtables in yace.ini). I checked it both with TaskManager and TaskInfo. OS is WinXP home.
Any comments ?
Olivier

Thanks for helping, Christian
I have the same thing here... When it loads, Yace allocates 80mb (if hash 64M), but drops immediately to 17mb. Very strange, I'll have to check this stuff.
Olivier

As a matter of facts, the problem occurs only with Yace 0.99.87... Yace Paderborn behaves normally !
Olivier



ChessWar + AEGT

[Dieter Bürßner]

Geschrieben von:/Posted by: Dieter Bürßner at 26 July 2004 19:46:32:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 16:55:50:

I have the same thing here... When it loads, Yace allocates 80mb (if hash 64M), but drops immediately to 17mb. Very strange, I'll have to check this stuff.

Yes, very strange. Can you please start yace.exe without any ini-file from the DOS-command prompt. To do this, type
yace nul
At the command prompt, after you cd to the directory where yace is installed. Then type
hash 64M
ana
Now look at the memory usage in Task-manager. What do you see?
Now type
quit
You'll see one line "entries ...". What does this line show?
Is it possible, that for some reason the task-manager does not show the correct value? Try the same with
hash 600M
when you have 512M RAM (or 300M if you have 256M RAM, etc.). You should see heavy disk swapping! Search should be extremely slow. What does the task-manager show?
Regards,
Dieter

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 20:19:37:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Dieter Bürßner at 26 July 2004 19:46:32:

I have the same thing here... When it loads, Yace allocates 80mb (if hash 64M), but drops immediately to 17mb. Very strange, I'll have to check this stuff.

Yes, very strange. Can you please start yace.exe without any ini-file from the DOS-command prompt. To do this, type
yace nul
At the command prompt, after you cd to the directory where yace is installed. Then type
hash 64M
ana
Now look at the memory usage in Task-manager. What do you see?
Now type
quit
You'll see one line "entries ...". What does this line show?
Is it possible, that for some reason the task-manager does not show the correct value? Try the same with
hash 600M
when you have 512M RAM (or 300M if you have 256M RAM, etc.). You should see heavy disk swapping! Search should be extremely slow. What does the task-manager show?
Regards,
Dieter

Dieter, many thanks for your answer
I did that, and got exacty 64m in memory according to TaskInfo.
I must say that the problem occurs only with the last Yace 0.99.87, only in UCI mode, and only in the Fritz GUI (both winboard and UCI are fine in Arena) ... and only here ( tested in my 2 computers). Christian Koch did the test, and he tells me it works.
If I cannot solve this problem, I'll use a workaround : using Yace in winboard mode with wb2uci (I have decided I'll use Fritz for AEGT).
Olivier



ChessWar + AEGT

[Günther Simon]

Geschrieben von:/Posted by: Günther Simon at 26 July 2004 20:19:48:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Dieter Bürßner at 26 July 2004 19:46:32:

I have the same thing here... When it loads, Yace allocates 80mb (if hash 64M), but drops immediately to 17mb. Very strange, I'll have to check this stuff.

Yes, very strange. Can you please start yace.exe without any ini-file from the DOS-command prompt. To do this, type
yace nul
At the command prompt, after you cd to the directory where yace is installed. Then type
hash 64M
ana
Now look at the memory usage in Task-manager. What do you see?
Now type
quit
You'll see one line "entries ...". What does this line show?
Is it possible, that for some reason the task-manager does not show the correct value? Try the same with
hash 600M
when you have 512M RAM (or 300M if you have 256M RAM, etc.). You should see heavy disk swapping! Search should be extremely slow. What does the task-manager show?
Regards,
Dieter

On my older WIN98SE machine I got 65.152 KB totally used

'entries 5333331 size 63999972 size_wanted 64000000 tts3 1777776'
I tried it with 400MB on this 384MB (phsyical) machine and
got 197.964 KB totally used. Somehow Yace divided it by 2,
perhaps to avoid swapping?
'white ( 1): hash 400MB
hash size wanted 400000000
HASH size/2 16666665
Stored 2 learned positions into hash table
entries 16666665 size 199999980 size_wanted 400000000 tts3 5555554
white ( 1):'

I will try it on my PIV with WIN XP too later.
Best regards,
Günther

[Dieter Bürßner]

Geschrieben von:/Posted by: Dieter Bürßner at 26 July 2004 20:26:46:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Günther Simon at 26 July 2004 20:19:48:

I tried it with 400MB on this 384MB (phsyical) machine and
got 197.964 KB totally used. Somehow Yace divided it by 2,
perhaps to avoid swapping?

No. Yace can only use 256MB or more on Win NT/2000/XP (or Linux). On other versions of Windows, it can't. I could solve this, but was too lazy until now ...
Cheers,
Dieter

[Dieter Bürßner]

Geschrieben von:/Posted by: Dieter Bürßner at 26 July 2004 20:31:04:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 20:19:37:

I must say that the problem occurs only with the last Yace 0.99.87, only in UCI mode, and only in the Fritz GUI (both winboard and UCI are fine in Arena) ... and only here ( tested in my 2 computers). Christian Koch did the test, and he tells me it works.

I assume, you use Yace without any yace.ini under Fritz. Can you please add a minimal yace.ini, with exactly one line:
log send_to_dieter.txt
Leave besides hash, TB, TB-cache all engine-parameters at default values. Do *not* set the log File under the engine parameters. Start analysis in the root position for a second or so, after you loaded the engine. Close all, and send me the file. Thanks,
Dieter

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 21:05:09:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Dieter Bürßner at 26 July 2004 20:31:04:

I must say that the problem occurs only with the last Yace 0.99.87, only in UCI mode, and only in the Fritz GUI (both winboard and UCI are fine in Arena) ... and only here ( tested in my 2 computers). Christian Koch did the test, and he tells me it works.

I assume, you use Yace without any yace.ini under Fritz. Can you please add a minimal yace.ini, with exactly one line:
log send_to_dieter.txt
Leave besides hash, TB, TB-cache all engine-parameters at default values. Do *not* set the log File under the engine parameters. Start analysis in the root position for a second or so, after you loaded the engine. Close all, and send me the file. Thanks,
Dieter

Dieter, I do use an ini file :
REM initialization file for Yace
; If you want to put all logfiles in a directory, i.e. first create the
; subdirectory logs and then uncomment the line.
log_path logs\
auto_log
; Use 30 Megabytes for hash tables. Change this to a size suitable for
; your hardware. You can use numbers like 10.5M, 10.5m, 10500k or 105000000.
hash 64M
; set the chache size for endgame tables. Default is 2M. I suggest to use
; not less than 1M and not more than 8M.
egtb_cache 8M
; Where to find the endgame tables, Nalimov format, compressed or uncompressed
; If you don't have endgame tables, delete the following line
tbldir e:\TBs
; save all my games
sgames yacegam.pgn
; positional learning now is on by default
book_learn 6
; to disable book learning, I suggest
; book_learn 4
; Yes - 4 and not 0, so that Yace will have access to NAGs in dblearn.bin

I'll try to get a logfile...
Olivier


ChessWar + AEGT

[Dieter Bürßner]

Geschrieben von:/Posted by: Dieter Bürßner at 26 July 2004 21:15:48:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 21:05:09:

Dieter, I do use an ini file :

When Yace is running in UCI-mode, you should not use an ini-File. I looked over the one you posted - it should not hurt. It is also my fault, not documenting this properly. But at least in news.txt, you can read:
---
Added support for UCI. Multi Variants mode won't work yet.
Under UCI you should use Yace without ini file, if you do not really
know what you are doing. Important parameters should be set in the engines
setup of the GUI instead.
---
I don't think, this has anything to do with the (possible) problem mentioned.
Cheers,
Dieter

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 21:18:09:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 21:05:09:

Here is the logfile : Yace runs in UCI mode in the Fritz GUI, and the ini file is the one used in the above message.
input: sgames yacegam.pgn
input: ; positional learning now is on by default
input: book_learn 6
book_learn = 6
DBBOOK101 10000 128 20 ff 10599
input: ; to disable book learning, I suggest
input: ; book_learn 4
input: ; Yes - 4 and not 0, so that Yace will have access to NAGs in dblearn.bin
white ( 1): input: uci
id name Yace 0.99.87
id author Dieter Buerssner
option name Ponder type check default false
option name Hash type spin default 1 min 1 max 1024
option name NalimovCache type spin min 1 max 64 default 2
option name NalimovPath type string default
option name Position Learning type check default true
option name Log File type check default false
option name Show hash performance type check default false
option name Show add. EGTB info type combo default at end of search var never var at end of search var allways
option name Endgame-Database Usage type combo default Normal var Never var Only at root var Very Low var Low var Normal var High
option name Use partitial TBs type combo default Use 3-6 men var Use only 3/4-men var Use only 3/4/5-men var Use 3-6 men
option name OwnBook type check default true
option name BookFile type string default dbbook.bin
option name LearnBookFile type string default dblearn.bin
option name BookLearning type check default true
option name Book Random type check default true
option name BitbasePath type string default
option name Selectivity type combo default Normal var None var Normal var Risky
option name Extensions type combo default Normal var Normal var Aggressive
option name Add. time for so many moves type spin min 0 max 15 default 5
option name null_high type spin min 0 max 600 default 300
option name null_low type spin min 0 max 600 default 300
option name null_endgame type spin min 0 max 600 default 200
option name null_split type spin min 0 max 2000 default 550
option name Recapture extension type spin min 0 max 100 default 59
option name Check extension type spin min 0 max 100 default 100
option name Perpetual check extension type spin min 0 max 100 default 59
option name Mate threat extension type spin min 0 max 100 default 100
option name Passed pawn extension type spin min 0 max 100 default 100
option name Autoplayer delay (ms) type spin min 0 max 2000 default 0
option name Clear Hash type button
option name UCI_ShowCurrLine type check default false
option name UCI_ShowRefutations type check default false
option name UCI_AnalyseMode type check default false
option name UCI_GUI type check default false
uciok
white ( 1): input: setoption name Hash value 1
Stored 0 learned positions into hash table
entries 87381 size 1048572 size_wanted 1048576 tts3 29126
white ( 1): input: isready
readyok
white ( 1): input: position startpos moves e2e4 e7e6 e1e2 d7d5 e2e4
About the "game" (I was white) : 1.e4 e6 2.Ke2 d5 and here I made a mouseslip and played 3.Kxe4!!? (sorry for the mess...) Yace did not answer and lost on time... an easy win for myself
I looked at TaskInfo and Yace was taking 17mb. I'm ready for other tests...
Olivier



ChessWar + AEGT

[Dieter Bürßner]

Geschrieben von:/Posted by: Dieter Bürßner at 26 July 2004 21:21:51:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 21:18:09:

much snipped, then:

white ( 1): input: setoption name Hash value 1

The Gui told Yace to use 1 MB for Hash tables. And Yace followed the order. I fear, I can't do anything about this.
Regards,
Dieter

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 26 July 2004 21:56:36:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Dieter Bürßner at 26 July 2004 21:21:51:

much snipped, then:

white ( 1): input: setoption name Hash value 1

The Gui told Yace to use 1 MB for Hash tables. And Yace followed the order. I fear, I can't do anything about this.
Regards,
Dieter

Then the 1mb bug is not dead (I have the last uci.dll available, 1st of April, Fools day...), I suspected that...
Sorry for bothering you with that buggy GUI, Dieter... I'll do more tests tomorrow, and if nothing works, I still have my workaround (running Yace with wb2uci).
Olivier



ChessWar + AEGT

[Dieter Bürßner]

Geschrieben von:/Posted by: Dieter Bürßner at 26 July 2004 22:08:37:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 21:18:09:

I almost have overlooked this:

white ( 1): input: position startpos moves e2e4 e7e6 e1e2 d7d5 e2e4
About the "game" (I was white) : 1.e4 e6 2.Ke2 d5 and here I made a mouseslip and played 3.Kxe4!!? (sorry for the mess...) Yace did not answer and lost on time... an easy win for myself

?? Fritz let you move Ke2xe4? And also reported it to the engine? You should report this to Chessbase ...
Regards,
Dieter

[Christian Koch]

Geschrieben von:/Posted by: Christian Koch at 26 July 2004 22:23:12:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Olivier Deville at 26 July 2004 21:18:09:

my output:
white ( 1): input: setoption name Hash value 256
Stored 0 learned positions into hash table
entries 22369620 size 268435440 size_wanted 268435456 tts3 7456539
your output:
white ( 1): input: setoption name Hash value 1
Stored 0 learned positions into hash table
entries 87381 size 1048572 size_wanted 1048576 tts3 29126

Have you pressef F§ under Fritz-GUI and set the correct hash size?
bye,
Christian

[Christian Koch]

Geschrieben von:/Posted by: Christian Koch at 27 July 2004 00:01:08:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Christian Koch at 26 July 2004 22:23:12:

correction:
Have you pressef F3 under Fritz-GUI and set the correct hash size

my output:
white ( 1): input: setoption name Hash value 256
Stored 0 learned positions into hash table
entries 22369620 size 268435440 size_wanted 268435456 tts3 7456539
your output:
white ( 1): input: setoption name Hash value 1
Stored 0 learned positions into hash table
entries 87381 size 1048572 size_wanted 1048576 tts3 29126

Have you pressef F§ under Fritz-GUI and set the correct hash size?
bye,
Christian

[Olivier Deville]

Geschrieben von:/Posted by: Olivier Deville at 27 July 2004 07:58:05:
Als Antwort auf:/In reply to: Re: Yace memory usage geschrieben von:/posted by: Christian Koch at 27 July 2004 00:01:08:

correction:
Have you pressef F3 under Fritz-GUI and set the correct hash size

my output:
white ( 1): input: setoption name Hash value 256
Stored 0 learned positions into hash table
entries 22369620 size 268435440 size_wanted 268435456 tts3 7456539
your output:
white ( 1): input: setoption name Hash value 1
Stored 0 learned positions into hash table
entries 87381 size 1048572 size_wanted 1048576 tts3 29126

Have you pressef F§ under Fritz-GUI and set the correct hash size?
bye,
Christian

Yes Christian, this helps... but the games are automated here, and I won't be there to press F3 when the game starts.
I made a few more tests this morning, totally unsuccessful. So I'll take wb2uci, at least this works and I hope Yace won't be too harmed.
Olivier



ChessWar + AEGT