Removing Stockfish specific end game knowledge, use syzygy

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

syzygy
Posts: 5564
Joined: Tue Feb 28, 2012 11:56 pm

Re: Removing Stockfish specific end game knowledge, use syzy

Post by syzygy »

mohzus wrote:Sorry, I do not understand. I remove SF specific knowledge but I replace it with the 5 pieces Syzygy TB's. Stockfish should find such mates instantly, right?
Not the same. I've explained this to you already a while ago.

For KBNK it won't matter if you don't mind being dependent on the presence of TBs. For KRPKR it will matter.
User avatar
mohzus
Posts: 106
Joined: Tue Sep 24, 2013 2:54 am

Re: Removing Stockfish specific end game knowledge, use syzy

Post by mohzus »

syzygy wrote:
mohzus wrote:Sorry, I do not understand. I remove SF specific knowledge but I replace it with the 5 pieces Syzygy TB's. Stockfish should find such mates instantly, right?
Not the same. I've explained this to you already a while ago.

For KBNK it won't matter if you don't mind being dependent on the presence of TBs. For KRPKR it will matter.
I remember now what you told me. For example when there are 10 pieces or so, there will be a difference and I should be penalized if I removed SF specific knowledge.
In the example you give: KRPKR, there are only 5 pieces. So the syzygy are sufficient for a perfect play, if I'm not wrong.
The following FEN 1k6/1r6/8/8/8/8/1PK5/1R6 returns

Code: Select all

info depth 1 seldepth 1 score cp 0 nodes 42 nps 1312 tbhits 16 time 32 multipv 1 pv b7b4
and a 0 cp score onward, which I guess is the correct result (draw).

I will test some positions when there are more pieces remaining, comparing the two stockfishes if possible. I would greatly appreciate if someone has some positions where I could get differences between the normal SF+syzygy and the removed specific end game knowledge + syzygy.
syzygy
Posts: 5564
Joined: Tue Feb 28, 2012 11:56 pm

Re: Removing Stockfish specific end game knowledge, use syzy

Post by syzygy »

mohzus wrote:In the example you give: KRPKR, there are only 5 pieces. So the syzygy are sufficient for a perfect play, if I'm not wrong.
When you're threre, yes. But the point is that you're not yet there when you have 10 pieces. If starting from 10 pieces you reach KRPKR in the QSEARCH the tables are not probed and you rely on the evaluation. If the evaluation gets it right, that's simply better. If you remove special KRPKR, the evaluation won't get it right.

The alternative is to probe during qsearch, but I think that would cost too much nps.

Apparently people think that searching a 10 piece position has nothing to do with 5 piece positions? Even though you're obviously playing out capture sequences and mentally evaluating the resulting positions when playing chess yourself...
User avatar
mohzus
Posts: 106
Joined: Tue Sep 24, 2013 2:54 am

Re: Removing Stockfish specific end game knowledge, use syzy

Post by mohzus »

syzygy wrote:
mohzus wrote:In the example you give: KRPKR, there are only 5 pieces. So the syzygy are sufficient for a perfect play, if I'm not wrong.
When you're threre, yes. But the point is that you're not yet there when you have 10 pieces. If starting from 10 pieces you reach KRPKR in the QSEARCH the tables are not probed and you rely on the evaluation. If the evaluation gets it right, that's simply better. If you remove special KRPKR, the evaluation won't get it right.

The alternative is to probe during qsearch, but I think that would cost too much nps.

Apparently people think that searching a 10 piece position has nothing to do with 5 piece positions? Even though you're obviously playing out capture sequences and mentally evaluating the resulting positions when playing chess yourself...
Okay I did not know that there was no probing during the qsearch. I thought that whenever SF reached "mentally" 5 pieces it would use the syzygy, if you allow me non programming terms :)
Ahahah, I'm going to use the "normal" stockfish after all. Your argument convinced me.

Last question though, is there some UCI option I can modify in order to do probing at qsearch or an option that would favor the version of SF with removed specific knowledge?
For example I don't know what SyzygyProbeDepth does.
Thank you.
User avatar
mohzus
Posts: 106
Joined: Tue Sep 24, 2013 2:54 am

Re: Removing Stockfish specific end game knowledge, use syzy

Post by mohzus »

First little analysis on a single position:
SF modified:

Code: Select all

position fen 4rbr1/5p2/p1k2P2/2p4p/1pP1pBq1/P3Q1P1/7P/2RR2K1 b - - 61 31
isready
readyok
go infinite
info depth 1 seldepth 1 score cp -54 nodes 124 nps 62000 tbhits 0 time 2 multipv 1 pv c6b7 a3b4 c5b4
info depth 2 seldepth 2 score cp -54 nodes 227 nps 113500 tbhits 0 time 2 multipv 1 pv c6b7 a3b4 c5b4
info depth 3 seldepth 3 score cp -54 nodes 693 nps 231000 tbhits 0 time 3 multipv 1 pv c6b7 a3b4 c5b4
info depth 4 seldepth 4 score cp -189 nodes 1127 nps 375666 tbhits 0 time 3 multipv 1 pv c6b7 a3b4 c5b4 c1a1
info depth 5 seldepth 5 score cp -132 nodes 1941 nps 485250 tbhits 0 time 4 multipv 1 pv c6b7 a3b4 c5b4 c1a1 a6a5
info depth 6 seldepth 6 score cp -169 nodes 3387 nps 564500 tbhits 0 time 6 multipv 1 pv c6b7 a3b4 c5b4 c1a1 g4f5 d1d5 f5f6
info depth 7 seldepth 8 score cp -262 nodes 7667 nps 851888 tbhits 0 time 9 multipv 1 pv c6b7 a3b4 c5b4 c4c5 f8c5 e3c5 g4f4 d1d7 b7b8 d7f7 g8g3 h2g3 f4g3 g1h1
info depth 8 seldepth 12 score cp -25 nodes 17733 nps 886650 tbhits 0 time 20 multipv 1 pv g4f3 e3d2 c6b6 a3b4 e4e3 b4c5 f8c5 c1b1 b6a7 d2d7 a7a8 d7d5 f3d5 d1d5
info depth 9 seldepth 13 score cp -25 nodes 19489 nps 885863 tbhits 0 time 22 multipv 1 pv g4f3 e3d2 c6b6 a3b4 e4e3 b4c5 f8c5 c1b1 b6a7 d2d7 a7a8 d7d5 f3d5 d1d5
info depth 10 seldepth 16 score cp -8 nodes 32441 nps 811025 tbhits 0 time 40 multipv 1 pv g4f3 e3d2 f3d3 d2d3 e4d3 d1d3 e8e2 c1d1 c6b6 f4e3
info depth 11 seldepth 16 score cp 0 nodes 52392 nps 970222 tbhits 0 time 54 multipv 1 pv g4f3 e3d2 f3d3 d2e1 d3f3 e1d2
info depth 12 seldepth 16 score cp 0 nodes 60848 nps 950750 tbhits 0 time 64 multipv 1 pv g4f3 e3d2 f3d3 d2e1 d3f3 e1d2
info depth 13 seldepth 16 score cp 0 nodes 86460 nps 1041686 tbhits 0 time 83 multipv 1 pv g4f3 e3d2 f3d3 d2e1 d3f3 e1d2
info depth 14 seldepth 16 score cp 0 nodes 105723 nps 1067909 tbhits 0 time 99 multipv 1 pv g4f3 e3d2 f3d3 d2e1 d3f3 e1d2
info depth 15 seldepth 16 score cp 0 nodes 143539 nps 1148312 tbhits 0 time 125 multipv 1 pv g4f3 e3d2 f3d3 d2e1 d3f3 e1d2
info depth 16 seldepth 16 score cp 0 nodes 181749 nps 1180188 tbhits 0 time 154 multipv 1 pv g4f3 e3d2 f3d3 d2e1 d3f3 e1d2
info depth 17 seldepth 25 score cp 0 nodes 733794 nps 1528737 tbhits 0 time 480 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 d1d7 e8e2 c1c3 c5c4 c3f3 f8c5 g1f1
info depth 18 seldepth 28 score cp 0 nodes 1001649 nps 1582383 tbhits 0 time 633 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 d1d7 e8e2 c1b1 g8h8 f4c7 b6a7 c7f4 a7b6
info depth 19 seldepth 30 score cp -4 nodes 1330687 nps 1632744 tbhits 0 time 815 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 b6b5 d1b1 b5c4 a1a4 c4c3 b1c1 c3b2 a4a6 e8e4 a6b6 e4b4
info depth 20 seldepth 31 score cp 0 nodes 2144261 nps 1681773 tbhits 0 time 1275 multipv 1 pv h5h4 a3b4 c5b4 f4c7 f8c5 d1d6 c5d6 e3b6 c6d7 b6d6 d7c8 d6a6 c8c7 a6a5 c7d6 a5d5 d6c7 d5a5
info depth 21 seldepth 35 score cp -48 nodes 4385890 nps 1785785 tbhits 2 time 2456 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 b4b3 e3b3 c5d4 g1g2 e8e6 b3a4 c6c5 a4a5 c5c4 a5c7 c4d3 c7f7 g8e8 f4g5 h4g3 f7h7 e6b6 f6f7 e8f8 h7f5 g3h2 f5f1 d3c3
info depth 22 currmove c6b6 currmovenumber 5
info depth 22 currmove g4h3 currmovenumber 6
info depth 22 currmove f8h6 currmovenumber 7
info depth 22 currmove e8d8 currmovenumber 8
info depth 22 currmove e8e6 currmovenumber 9
info depth 22 currmove g4c8 currmovenumber 10
info depth 22 currmove a6a5 currmovenumber 11
info depth 22 seldepth 39 score cp -57 upperbound nodes 5649015 nps 1800769 tbhits 4 time 3137 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 b4b3 e3b3 c5d4 g1g2 e8e6 b3a3 c6b6 a3b4 b6a7 c4c5 d4f6 c5c6 e6c6 f4e3 a7a8 b4e4 h4h3 g2h3
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 currmove b4a3 currmovenumber 2
info depth 22 currmove c6b7 currmovenumber 4
info depth 22 currmove f8h6 currmovenumber 13
info depth 22 currmove a6a5 currmovenumber 14
info depth 22 currmove f8d6 currmovenumber 15
info depth 22 currmove e8a8 currmovenumber 16
info depth 22 currmove g4e6 currmovenumber 17
info depth 22 currmove g4e2 currmovenumber 18
info depth 22 currmove g4f5 currmovenumber 19
info depth 22 currmove e8c8 currmovenumber 20
info depth 22 currmove g4g7 currmovenumber 21
info depth 22 currmove g8g5 currmovenumber 22
info depth 22 currmove e8e5 currmovenumber 23
info depth 22 currmove e8b8 currmovenumber 24
info depth 22 currmove g4d7 currmovenumber 25
info depth 22 currmove g4h4 currmovenumber 26
info depth 22 currmove g4g6 currmovenumber 27
info depth 22 currmove e8e7 currmovenumber 28
info depth 22 currmove f8g7 currmovenumber 29
info depth 22 currmove g8g7 currmovenumber 30
info depth 22 currmove g4g5 currmovenumber 31
info depth 22 currmove f8e7 currmovenumber 32
info depth 22 currmove g4d1 currmovenumber 33
info depth 22 currmove g4f4 currmovenumber 34
info depth 22 currmove g4g3 currmovenumber 35
info depth 22 seldepth 39 score cp -65 upperbound nodes 6064198 nps 1795735 tbhits 4 time 3377 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 b4b3 e3b3 c5d4 g1g2 e8e6 b3a3 c6b6 a3b4 b6a7 c4c5 d4f6 c5c6 e6c6 f4e3 a7a8 b4e4 h4h3 g2h3
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 currmove b4a3 currmovenumber 2
info depth 22 currmove c6b7 currmovenumber 4
info depth 22 currmove g4h3 currmovenumber 5
info depth 22 currmove b4b3 currmovenumber 6
info depth 22 currmove c6b6 currmovenumber 7
info depth 22 currmove e8e6 currmovenumber 8
info depth 22 currmove f8h6 currmovenumber 11
info depth 22 currmove g8h8 currmovenumber 12
info depth 22 currmove e8d8 currmovenumber 13
info depth 22 currmove g4e2 currmovenumber 14
info depth 22 currmove g4e6 currmovenumber 15
info depth 22 currmove a6a5 currmovenumber 16
info depth 22 seldepth 39 score cp -77 upperbound nodes 6641110 nps 1794894 tbhits 5 time 3700 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 b4b3 e3b3 c5d4 g1g2 e8e6 b3a3 c6b6 a3b4 b6a7 c4c5 d4f6 f4d6
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 currmove b4a3 currmovenumber 2
info depth 22 currmove c6b7 currmovenumber 4
info depth 22 currmove c6b6 currmovenumber 5
info depth 22 currmove g4h3 currmovenumber 7
info depth 22 currmove b4b3 currmovenumber 8
info depth 22 currmove a6a5 currmovenumber 9
info depth 22 currmove f8d6 currmovenumber 10
info depth 22 currmove g4g5 currmovenumber 11
info depth 22 currmove g4c8 currmovenumber 12
info depth 22 currmove g8g6 currmovenumber 13
info depth 22 currmove e8a8 currmovenumber 14
info depth 22 currmove g8h8 currmovenumber 15
info depth 22 currmove e8d8 currmovenumber 16
info depth 22 currmove g4h4 currmovenumber 17
info depth 22 currmove f8h6 currmovenumber 18
info depth 22 currmove g4e2 currmovenumber 19
info depth 22 currmove f8e7 currmovenumber 20
info depth 22 currmove g4f5 currmovenumber 21
info depth 22 currmove e8c8 currmovenumber 22
info depth 22 currmove e8e7 currmovenumber 23
info depth 22 currmove g4e6 currmovenumber 24
info depth 22 currmove g4g7 currmovenumber 25
info depth 22 currmove g8g5 currmovenumber 26
info depth 22 currmove g4g6 currmovenumber 27
info depth 22 currmove e8e5 currmovenumber 28
info depth 22 currmove g8g7 currmovenumber 29
info depth 22 currmove f8g7 currmovenumber 30
info depth 22 currmove e8b8 currmovenumber 31
info depth 22 currmove g4d7 currmovenumber 32
info depth 22 currmove g4d1 currmovenumber 33
info depth 22 currmove g4f4 currmovenumber 34
info depth 22 currmove g4g3 currmovenumber 35
info depth 22 seldepth 39 score cp -95 upperbound nodes 8127058 nps 1803207 tbhits 13 time 4507 multipv 1 pv h5h4 a3b4
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 currmove b4a3 currmovenumber 2
info depth 22 currmove c6b7 currmovenumber 4
info depth 22 currmove g4h3 currmovenumber 5
info depth 22 currmove c6b6 currmovenumber 6
info depth 22 currmove b4b3 currmovenumber 7
info depth 22 currmove g4c8 currmovenumber 8
info depth 22 currmove e8d8 currmovenumber 9
info depth 22 currmove f8h6 currmovenumber 10
info depth 22 currmove g8h8 currmovenumber 11
info depth 22 currmove g4e2 currmovenumber 13
info depth 22 currmove f8d6 currmovenumber 14
info depth 22 currmove e8e6 currmovenumber 15
info depth 22 currmove g4f5 currmovenumber 16
info depth 22 currmove f8e7 currmovenumber 17
info depth 22 currmove g4h4 currmovenumber 19
info depth 22 currmove g8g6 currmovenumber 21
info depth 22 seldepth 40 score cp -122 upperbound nodes 9300237 nps 1795412 tbhits 31 time 5180 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 b4b3 e3b3 e8d8 b3a2 c5d4 g1g2 c6b6 a2b1 b6c5 b1e4 c5c4 e4c6 d4c5 c6a6
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 currmove b4a3 currmovenumber 2
info depth 22 currmove g4e6 currmovenumber 8
info depth 22 currmove g4c8 currmovenumber 9
info depth 22 currmove f8d6 currmovenumber 10
info depth 22 currmove g4f5 currmovenumber 11
info depth 22 currmove e8d8 currmovenumber 12
info depth 22 currmove g8g6 currmovenumber 13
info depth 22 seldepth 43 score cp -96 nodes 10317460 nps 1801861 tbhits 66 time 5726 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 b4b3 e3b3 c5d4 g1g2 d4e5 b3a4 c6b6 f4e3 b6c7 a4a5 c7c8 a5a6 c8d7 a6b7 d7e6 e3f2 e6f6 b7e4 g8g5 g3g4 f6g7 f2e3 g5g6 c4c5 g6e6 g2f3 e5c3
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 45 score cp -88 lowerbound nodes 11892378 nps 1823704 tbhits 153 time 6521 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 45 score cp -80 lowerbound nodes 12152776 nps 1823372 tbhits 153 time 6665 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 45 score cp -68 lowerbound nodes 12461906 nps 1824850 tbhits 153 time 6829 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 45 score cp -50 lowerbound nodes 12962077 nps 1829768 tbhits 155 time 7084 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 45 score cp -23 lowerbound nodes 13544473 nps 1834548 tbhits 159 time 7383 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 currmove b4a3 currmovenumber 2
info depth 23 currmove g4d7 currmovenumber 4
info depth 23 currmove c6b6 currmovenumber 5
info depth 23 currmove c6b7 currmovenumber 6
info depth 23 currmove g8h8 currmovenumber 7
info depth 23 currmove f8d6 currmovenumber 8
info depth 23 currmove g4h3 currmovenumber 9
info depth 23 currmove g4c8 currmovenumber 10
info depth 23 currmove g4e6 currmovenumber 11
info depth 23 currmove f8h6 currmovenumber 12
info depth 23 currmove e8a8 currmovenumber 13
info depth 23 currmove g4g5 currmovenumber 14
info depth 23 currmove g4e2 currmovenumber 15
info depth 23 currmove g8g6 currmovenumber 16
info depth 23 currmove a6a5 currmovenumber 17
info depth 23 currmove b4b3 currmovenumber 18
info depth 23 currmove g4f5 currmovenumber 19
info depth 23 currmove e8b8 currmovenumber 20
info depth 23 currmove g8g5 currmovenumber 21
info depth 23 currmove e8e6 currmovenumber 22
info depth 23 currmove e8c8 currmovenumber 23
info depth 23 currmove g4h4 currmovenumber 24
info depth 23 currmove e8e5 currmovenumber 25
info depth 23 currmove e8d8 currmovenumber 26
info depth 23 currmove f8g7 currmovenumber 27
info depth 23 currmove g4g6 currmovenumber 28
info depth 23 currmove f8e7 currmovenumber 29
info depth 23 currmove g4g7 currmovenumber 30
info depth 23 currmove e8e7 currmovenumber 31
info depth 23 currmove g8g7 currmovenumber 32
info depth 23 currmove g4d1 currmovenumber 33
info depth 23 currmove g4f4 currmovenumber 34
info depth 23 currmove g4g3 currmovenumber 35
info depth 23 seldepth 45 score cp 0 nodes 15098883 nps 1833723 tbhits 162 time 8234 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8 g1g2 d8d4 e5c7 b6c7 e4e8 d4d7 e8e5 c7b6 e5b8 d7b7 b8d8 b6a7 d8d5 a7b6 d5d1 b6c7 d1a4 b4b3 a4a5 c7d6 a5a6 d6c7 a6a5 c7c6 a5a6 c6c7
info depth 24 currmove h5h4 currmovenumber 1
info depth 24 currmove b4a3 currmovenumber 2
info depth 24 currmove g4h3 currmovenumber 4
info depth 24 currmove g8h8 currmovenumber 5
info depth 24 currmove c6b6 currmovenumber 6
info depth 24 currmove g4e6 currmovenumber 7
info depth 24 currmove a6a5 currmovenumber 8
info depth 24 currmove g4c8 currmovenumber 9
info depth 24 currmove e8a8 currmovenumber 10
info depth 24 currmove g8g6 currmovenumber 11
info depth 24 currmove f8h6 currmovenumber 12
info depth 24 currmove g4g5 currmovenumber 13
info depth 24 currmove g4d7 currmovenumber 14
info depth 24 currmove g4h4 currmovenumber 15
info depth 24 currmove g4e2 currmovenumber 16
info depth 24 currmove g4f5 currmovenumber 17
info depth 24 currmove b4b3 currmovenumber 18
info depth 24 currmove e8e6 currmovenumber 19
info depth 24 currmove f8d6 currmovenumber 20
info depth 24 currmove c6b7 currmovenumber 21
info depth 24 currmove e8b8 currmovenumber 22
info depth 24 currmove e8e5 currmovenumber 23
info depth 24 currmove e8d8 currmovenumber 24
info depth 24 currmove e8c8 currmovenumber 25
info depth 24 currmove g8g5 currmovenumber 26
info depth 24 currmove f8g7 currmovenumber 27
info depth 24 currmove f8e7 currmovenumber 28
info depth 24 currmove g4g6 currmovenumber 29
info depth 24 currmove g4g7 currmovenumber 30
info depth 24 currmove e8e7 currmovenumber 31
info depth 24 currmove g8g7 currmovenumber 32
info depth 24 currmove g4d1 currmovenumber 33
info depth 24 currmove g4f4 currmovenumber 34
info depth 24 currmove g4g3 currmovenumber 35
info depth 24 seldepth 45 score cp -8 upperbound nodes 15691301 nps 1828396 tbhits 162 time 8582 multipv 1 pv h5h4 a3b4 c5b4 c1a1 g4d1 a1d1 f8c5 d1d4 h4g3 h2g3 e8d8 e3e4 c6b6 f4e5 g8e8 g1g2 d8d4 e5c7 b6c7 e4e8 d4d7 e8e5 c7b6 e5b8 d7b7 b8d8 b6a7 d8d5 a7b6 d5d1 b6c7 d1a4 b4b3 a4a5 c7d6 a5a6 d6c7 a6a5 c7c6 a5a4 c6d6 a4a8
Normal SF:

Code: Select all

position fen 4rbr1/5p2/p1k2P2/2p4p/1pP1pBq1/P3Q1P1/7P/2RR2K1 b - - 61 31
isready
readyok
go infinite
info depth 1 seldepth 1 score cp -54 nodes 127 nps 42333 tbhits 0 time 3 multipv 1 pv c6b7 a3b4 c5b4
info depth 2 seldepth 2 score cp -54 nodes 231 nps 77000 tbhits 0 time 3 multipv 1 pv c6b7 a3b4 c5b4
info depth 3 seldepth 3 score cp -54 nodes 697 nps 139400 tbhits 0 time 5 multipv 1 pv c6b7 a3b4 c5b4
info depth 4 seldepth 4 score cp -189 nodes 1508 nps 167555 tbhits 0 time 9 multipv 1 pv c6b7 a3b4 c5b4 c1a1
info depth 5 seldepth 5 score cp -132 nodes 2295 nps 176538 tbhits 0 time 13 multipv 1 pv c6b7 a3b4 c5b4 c1a1 a6a5
info depth 6 seldepth 6 score cp -169 nodes 3662 nps 228875 tbhits 0 time 16 multipv 1 pv c6b7 a3b4 c5b4 c1a1 g4f5 d1d5 f5f6
info depth 7 seldepth 8 score cp -262 nodes 7943 nps 294185 tbhits 0 time 27 multipv 1 pv c6b7 a3b4 c5b4 c4c5 f8c5 e3c5 g4f4 d1d7 b7b8 d7f7 g8g3 h2g3 f4g3 g1h1
info depth 8 seldepth 11 score cp 0 nodes 16778 nps 342408 tbhits 0 time 49 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 9 seldepth 11 score cp 0 nodes 17898 nps 350941 tbhits 0 time 51 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 10 seldepth 11 score cp 0 nodes 23097 nps 344731 tbhits 0 time 67 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 11 seldepth 11 score cp 0 nodes 25748 nps 367828 tbhits 0 time 70 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 12 seldepth 14 score cp 0 nodes 36741 nps 448060 tbhits 0 time 82 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 13 seldepth 14 score cp 0 nodes 54939 nps 543950 tbhits 0 time 101 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 14 seldepth 14 score cp 0 nodes 81783 nps 699000 tbhits 0 time 117 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 15 seldepth 14 score cp 0 nodes 118781 nps 824868 tbhits 0 time 144 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 16 seldepth 14 score cp 0 nodes 251989 nps 1100388 tbhits 0 time 229 multipv 1 pv g4f3 e3d2 f3d3 d2g2 d3f3 g2d2
info depth 17 seldepth 29 score cp -3 nodes 1338122 nps 1589218 tbhits 0 time 842 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 d1d7 e8e2 c1c3 c5c4 c3f3 f8c5 g1f1 e2h2 f3c3 h2f2 f1e1 g8h8 f4c7 b6b5 d7f7
info depth 18 seldepth 33 score cp -11 nodes 1667985 nps 1624133 tbhits 0 time 1027 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 c1b1 e8e2 d1d8 c5c4 d8b8 b6c5 b8c8 c5b6 c8c6 b6b7 b1d1 e2g2 g1f1
info depth 19 seldepth 33 score cp 0 nodes 2293583 nps 1677822 tbhits 0 time 1367 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 d1d7 e8e2 c1b1 e2g2 g1f1 g8h8 f4c7 b6b7 c7a5 b7b8 d7d8 b8b7 d8d7
info depth 20 seldepth 33 score cp -96 nodes 4293938 nps 1730728 tbhits 0 time 2481 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 b6b5 d1b1 b5c4 a1a4 c4c3 b1c1 c3b2 a4a6 e8e4 c1d1 e4e8 d1d7 c5c4 d7f7
info depth 21 currmove e8a8 currmovenumber 20
info depth 21 currmove g4g5 currmovenumber 21
info depth 21 currmove f8g7 currmovenumber 22
info depth 21 currmove g8g7 currmovenumber 23
info depth 21 currmove e8c8 currmovenumber 24
info depth 21 currmove g4g7 currmovenumber 25
info depth 21 currmove g8g5 currmovenumber 26
info depth 21 currmove g4e6 currmovenumber 27
info depth 21 currmove e8e7 currmovenumber 28
info depth 21 currmove f8e7 currmovenumber 29
info depth 21 currmove e8e5 currmovenumber 30
info depth 21 currmove g4g6 currmovenumber 31
info depth 21 currmove g4e2 currmovenumber 32
info depth 21 currmove g4d1 currmovenumber 33
info depth 21 currmove g4f4 currmovenumber 34
info depth 21 currmove g4g3 currmovenumber 35
info depth 21 seldepth 33 score cp -104 nodes 5242780 nps 1725166 tbhits 0 time 3039 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 b6b5 d1b1 b5c4 a1a4 c4c3 b1c1 c3b2 a4a6 e8e4 c1d1 f8h6 f4h6 g6h6 d1d7
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 seldepth 37 score cp -96 lowerbound nodes 5773950 nps 1734439 tbhits 8 time 3329 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8d8 f2f3 d8d3 f3e4 d3d4 e4e5 g6g2
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 seldepth 37 score cp -88 lowerbound nodes 5906087 nps 1736063 tbhits 8 time 3402 multipv 1 pv h5h4 c1b1 h4g3 h2g3 g4f3 e3f3 e4f3 g1f2 g8h8
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 seldepth 37 score cp -76 lowerbound nodes 6128084 nps 1739450 tbhits 10 time 3523 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 f4h6 g6h6 d1b1 b6b7 a1a6 e8e2 f2f3 e2e6 a6e6 f7e6
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 seldepth 37 score cp -58 lowerbound nodes 6625086 nps 1746661 tbhits 12 time 3793 multipv 1 pv h5h4 e3d2 h4g3 h2g3 g4h3 d2d5 c6b6 d5f7 g8g3
info depth 22 currmove h5h4 currmovenumber 1
info depth 22 currmove b4a3 currmovenumber 2
info depth 22 currmove b4b3 currmovenumber 4
info depth 22 currmove g4h3 currmovenumber 5
info depth 22 currmove g8h8 currmovenumber 6
info depth 22 currmove c6b6 currmovenumber 7
info depth 22 currmove g4f5 currmovenumber 8
info depth 22 currmove f8h6 currmovenumber 9
info depth 22 currmove f8d6 currmovenumber 10
info depth 22 currmove a6a5 currmovenumber 11
info depth 22 currmove g4c8 currmovenumber 12
info depth 22 currmove e8d8 currmovenumber 13
info depth 22 currmove f8g7 currmovenumber 14
info depth 22 currmove e8a8 currmovenumber 15
info depth 22 currmove c6b7 currmovenumber 16
info depth 22 currmove e8e6 currmovenumber 17
info depth 22 currmove g8g6 currmovenumber 18
info depth 22 currmove g4d7 currmovenumber 19
info depth 22 currmove g4e2 currmovenumber 20
info depth 22 currmove e8b8 currmovenumber 21
info depth 22 currmove g4h4 currmovenumber 22
info depth 22 currmove g4g5 currmovenumber 23
info depth 22 currmove g4e6 currmovenumber 24
info depth 22 currmove e8c8 currmovenumber 25
info depth 22 currmove e8e7 currmovenumber 26
info depth 22 currmove g8g7 currmovenumber 27
info depth 22 currmove g4g7 currmovenumber 28
info depth 22 currmove f8e7 currmovenumber 29
info depth 22 currmove e8e5 currmovenumber 30
info depth 22 currmove g8g5 currmovenumber 31
info depth 22 currmove g4g6 currmovenumber 32
info depth 22 currmove g4d1 currmovenumber 33
info depth 22 currmove g4f4 currmovenumber 34
info depth 22 currmove g4g3 currmovenumber 35
info depth 22 seldepth 37 score cp -88 nodes 7428798 nps 1736917 tbhits 13 time 4277 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8e4 b1d1 e4f4 d1d7 b7c8 d7f7 g6g2 f2e3
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 37 score cp -80 lowerbound nodes 8069955 nps 1739589 tbhits 16 time 4639 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8d8 f4f5 g6g2 f2f3 g2h2 b1e1 d8d3 f3e4 c5c4 a6c6 d3b3
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 37 score cp -72 lowerbound nodes 8369713 nps 1743327 tbhits 18 time 4801 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8d8 f4f5 g6g2 f2f3 g2h2 b1e1 d8d3 f3e4 c5c4 a6c6 d3b3
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 seldepth 37 score cp -60 lowerbound nodes 8609364 nps 1747384 tbhits 24 time 4927 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8d8 f4f5 g6g2 f2f3 g2d2 a6c6 d8d3 f3g4 d3d4
info depth 23 currmove h5h4 currmovenumber 1
info depth 23 currmove b4a3 currmovenumber 2
info depth 23 currmove c6b6 currmovenumber 4
info depth 23 currmove g4h3 currmovenumber 5
info depth 23 currmove g8h8 currmovenumber 6
info depth 23 currmove f8d6 currmovenumber 7
info depth 23 currmove c6b7 currmovenumber 8
info depth 23 currmove g4f5 currmovenumber 9
info depth 23 currmove b4b3 currmovenumber 10
info depth 23 currmove e8e6 currmovenumber 11
info depth 23 currmove e8d8 currmovenumber 12
info depth 23 currmove f8h6 currmovenumber 13
info depth 23 currmove g4e2 currmovenumber 14
info depth 23 currmove g4c8 currmovenumber 15
info depth 23 currmove e8c8 currmovenumber 16
info depth 23 currmove g8g6 currmovenumber 17
info depth 23 seldepth 43 score cp -86 nodes 9601124 nps 1739649 tbhits 50 time 5519 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8e6 f4f5 e6e2 f2f3 g6g2 b1f1 e2b2 a6d6 g2d2 d6d2 b2d2 f1c1 b7b6
info depth 24 currmove h5h4 currmovenumber 1
info depth 24 seldepth 49 score cp -78 lowerbound nodes 11027780 nps 1762470 tbhits 145 time 6257 multipv 1 pv h5h4 a3b4 h4g3 b4b5 a6b5 c4b5 c6b6 h2g3 g4f3 e3f3 e4f3 g1f2 g8g6 c1a1 f8h6 d1b1 h6f4 a1a6 b6b7 g3f4 e8e4 f2f3 e4b4 b1a1 b4b3 f3f2 b3b2 f2e3 g6g3 e3e4 b2b4 e4d5 b4f4 d5c5 g3g5 c5d6 f4f6 d6e7 f6a6 b5a6 b7a7
User avatar
mohzus
Posts: 106
Joined: Tue Sep 24, 2013 2:54 am

Re: Removing Stockfish specific end game knowledge, use syzy

Post by mohzus »

I notice that in general the modified (and normal SF I suppose too) stockfish gets tb hits when there are over 20 pieces remaining on the board; using the 5-men syzygy TB's.
So I do not know whether SF really lose knowledge that would help it to get a winning TB position from the middle game. Because if it uses the TB's when there are still like 23 pieces on the board, it will try to enter a winning TB position, I guess.
I may be wrong of course, because I do not really know how SF and the Syzygy really work.
You can call me Isaac, I misspelled my name when registering.
Isaac
Posts: 265
Joined: Sat Feb 22, 2014 8:37 pm

Re: Removing Stockfish specific end game knowledge, use syzy

Post by Isaac »

I have started a match with cutechess between the modified SF version + syzygy against normal SF+syzygy.
My hardware is very slow (1.86 Ghz, 1 core dedicated to cutechess only, out of 2) so I doubt I will ever reach a sufficient number of games to see which version is the stronger one.
Time control is 30+0.05 on my machine, which would translate roughly to 17+0.05 on the fishtest platform.

If anyone else is interested in doing a similar test, go ahead and report the results please. :)
Isaac
Posts: 265
Joined: Sat Feb 22, 2014 8:37 pm

Re: Removing Stockfish specific end game knowledge, use syzy

Post by Isaac »

I give up for now. After a few hours, the result is 53 wins, 57 losses and 191 draws (win ratio: 0.493) for my version against SF normal+syzygy. Nothing unexpected. I'm guessing I'd need around 50k games to determine with a high certainty which version is stronger.

Here's the parameters of my testing, in case someone is interested (I doubt it):

Code: Select all

./cutechess-cli -rounds 1000 -tournament gauntlet -repeat -wait 500 -pgnout results.pgn -resign movecount=3 score=400 -draw movenumber=34 movecount=20 score=20 -concurrency 1 -openings file=/home/isaac/Downloads/fishtest-master/worker/testing/8moves_v3.pgn format=pgn order=random plies=16 -engine name=mysf cmd=./mysf -engine name=sfnormal cmd=./sfnormal -each proto=uci option.Threads=1 option.OwnBook=false option.Hash=128 restart=on option.SyzygyProbeLimit=5 option.SyzygyPath=/media/isaac/0def13e7-1105-40e3-9aac-44393a0f6ac3/home/isaac/Downloads/syzygy  tc=30+0.05 
Games in pgn format available at http://www.sendspace.com/file/zn9ylq.