Test programs

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

xr_a_y wrote: Thu Apr 22, 2021 6:07 pm Thanks for this test!
200Elo looks quite ok between Xiphos and Minic+NoisyNotch.
There will be version 3.05 and I will test it too.
Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Igel 3.0.0 x64 vs rofChade 2.3 x64

Match result 33 - 10 - 57 (100 games)


The match was played on the following equipment:

Processor - Intel Core i7 870
Hard disc - Samsung SSD 860 PRO 1 TB
Memory of frames - 16 GB DDR3 1333
System - Windows 10 64 bit Pro


During the match, the opening book was not used, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting the engines during the game.

Igel 3.0.0 x64 x64
Protocol=uci
Hash=1024
Threads=4
SyzygyPath=D:/Syzygy
SyzygyProbeDepth=2
Skill Level=20
NNUE=ign-1-139b702b

rofChade 2.3 x64
Protocol=uci
Hash=1024
Threads=4
MoveOverhead=100
SyzygyProbeDepth=2
SyzygyPath=D:/Syzygy

Parties of the match Igel 3.0.0 vs rofChade 2.3 https://www.sendspace.com/file/wleav4
Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Toga III 0.3 x64 vs Defenchess 2.3dev2 x64

Match result 2 - 62 - 36 (100 games)


The match was played on the following equipment:

Processor - Intel Core i7 870
Hard disc - Samsung SSD 860 PRO 1 TB
Memory of frames - 16 GB DDR3 1333
System - Windows 10 64 bit Pro


During the match, the opening book was not used, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting the engines during the game.

Toga III 0.3 x64
Protocol=uci
Hash=1024
Number of threads=4
Other options unchanged

Defenchess 2.3dev2 x64
Protocol=uci
Hash=1024
Threads=4
MoveOverhead=100
SyzygyPath=D:/Syzygy

Parties of the match Toga III 0.3 vs Defenchess 2.3dev2 https://www.sendspace.com/file/uz7ar8
Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Pedone 3.1 x64 vs Laser 1.7 x64

Match result 47 - 8 - 45 (100 games)


The match was played on the following equipment:

Processor - Intel Core i7 870
Hard disc - Samsung SSD 860 PRO 1 TB
Memory of frames - 16 GB DDR3 1333
System - Windows 10 64 bit Pro


During the match, the opening book was not used, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting the engines during the game.

Pedone 3.1 x64
Protocol=uci
Threads=4
MultiPV=1
LargePages=On
SyzygyPath=D:/Syzygy
SyzygyProbeLimit=6

Laser 1.7 x64
Protocol=uci
Hash=1024
Threads=4
MultiPV=1
BufferTime=300
SyzygyPath=D:/Syzygy

Parties of the match Pedone 3.1 vs Laser 1.7 https://www.sendspace.com/file/tvfuzr
Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

Match Dragon 2 x64 vs Fat Fritz 2.1 x64 (all original engines)

Match result 0 - 15 - 85 (100 games)


The match was played on the following equipment:

Processor - Intel Core i7 870
Hard disc - Samsung SSD 860 PRO 1 TB
Memory of frames - 16 GB DDR3 1333
System - Windows 10 64 bit Pro


During the match, the opening book was not used, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting the engines during the game.

Dragon 2 x64
Protocol=uci
Hash=1024
Threads=4
Contempt=8
Overhead ms=100
SyzygyPath=D:/Syzygy
Time Usage=0
Table Memory=128
Syzygy Probe Limit=6
Syzygy Probe Depth=2
Smart Syzygy=false
OwnBook=false
Ponder=false


Fat Fritz 2.1 x64
Protocol=uci
Hash=1024
Threads=4
Contempt=24
Move Overhead=10
MultiPV=1
Syzygy50MoveRule=On
SyzygyPath=D:/Syzygy
SyzygyProbeLimit=6
SyzygyProbeDepth=2
Use NNUE=On
Eval File=FatFritz2_v1.bin


Parties of the match Dragon 2 vs Fat Fritz 2.1 - https://www.sendspace.com/file/i13lgl
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Test programs

Post by lkaufman »

Krzysztof Grzelak wrote: Sat May 08, 2021 7:58 pm Match Dragon 2 x64 vs Fat Fritz 2.1 x64 (all original engines)

Match result 0 - 15 - 85 (100 games)


The match was played on the following equipment:

Processor - Intel Core i7 870
Hard disc - Samsung SSD 860 PRO 1 TB
Memory of frames - 16 GB DDR3 1333
System - Windows 10 64 bit Pro


During the match, the opening book was not used, time for the game - 5 minutes + 3 seconds. I have used 6-men Syzygy table bases. The match was played on the GUI Cutochess 1.2 by Guenther Simon.

Setting the engines during the game.

Dragon 2 x64
Protocol=uci
Hash=1024
Threads=4
Contempt=8
Overhead ms=100
SyzygyPath=D:/Syzygy
Time Usage=0
Table Memory=128
Syzygy Probe Limit=6
Syzygy Probe Depth=2
Smart Syzygy=false
OwnBook=false
Ponder=false


Fat Fritz 2.1 x64
Protocol=uci
Hash=1024
Threads=4
Contempt=24
Move Overhead=10
MultiPV=1
Syzygy50MoveRule=On
SyzygyPath=D:/Syzygy
SyzygyProbeLimit=6
SyzygyProbeDepth=2
Use NNUE=On
Eval File=FatFritz2_v1.bin


Parties of the match Dragon 2 vs Fat Fritz 2.1 - https://www.sendspace.com/file/i13lgl
Fat Fritz 2.1 uses a GPU, Dragon does not. What GPU was used for Fat Fritz 2.1? If it's a good one, I would expect it to beat Dragon on four CPU threads, it's more typical to compare a good GPU with 16 cpu cores/threads.
Komodo rules!
mar
Posts: 2554
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: Test programs

Post by mar »

lkaufman wrote: Sat May 08, 2021 9:41 pm Fat Fritz 2.1 uses a GPU, Dragon does not. What GPU was used for Fat Fritz 2.1? If it's a good one, I would expect it to beat Dragon on four CPU threads, it's more typical to compare a good GPU with 16 cpu cores/threads.
are you sure? I thought FF2 was SF NNUE.
Martin Sedlak
Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

lkaufman wrote: Sat May 08, 2021 9:41 pm Fat Fritz 2.1 uses a GPU, Dragon does not. What GPU was used for Fat Fritz 2.1? If it's a good one, I would expect it to beat Dragon on four CPU threads, it's more typical to compare a good GPU with 16 cpu cores/threads.
Unfortunately but I made a mistake engine playing it Fat Fritz 2. I do not have Fat Fritz 2.1.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Test programs

Post by lkaufman »

mar wrote: Sat May 08, 2021 9:55 pm
lkaufman wrote: Sat May 08, 2021 9:41 pm Fat Fritz 2.1 uses a GPU, Dragon does not. What GPU was used for Fat Fritz 2.1? If it's a good one, I would expect it to beat Dragon on four CPU threads, it's more typical to compare a good GPU with 16 cpu cores/threads.
are you sure? I thought FF2 was SF NNUE.
Sorry, I was thinking of the older FF. FF2 is pretty much like SF13 with a different net but similar strength, so Dragon should lose to it by about this score based on the rating gap between SF13 and the older dragon, allowing for the 10 to 12 elo gain since then.
Komodo rules!
Krzysztof Grzelak
Posts: 1525
Joined: Tue Jul 15, 2014 12:47 pm

Re: Test programs

Post by Krzysztof Grzelak »

lkaufman wrote: Sat May 08, 2021 10:11 pm Sorry, I was thinking of the older FF. FF2 is pretty much like SF13 with a different net but similar strength, so Dragon should lose to it by about this score based on the rating gap between SF13 and the older dragon, allowing for the 10 to 12 elo gain since then.
Shame for me is for programmers and the program Dragon 2.