The engines are the latest incarnations of top 3 dogs:
Komodo 11.2.2
Houdini 6.02
BrainFish 2 Oct 2017 (no any book, just the fastest compile of the current master Stockfish)
The TB usage is the default in all three. Contempt=0 in all three.
1/ Starting positions are from 14-men unbalanced suite resulting from "Peasant Revolt" chess endgame variant. This endgame suite is very sensitive to TBs. The typical position looks like this:
[D]2n3n1/3k4/2n1p3/8/PP4P1/2PPPP1P/8/4K3 w - -
3000 games Round-Robin, 1000 games each engine with and without 6-men Syzygy. Result in Ordo:
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(next)
1 Houdini_602 Syzygy-6 : 51.6 12.2 567.0 1000 56.7 87
2 Komodo 11.2 Syzygy-6 : 40.8 12.5 553.0 1000 55.3 100
3 Komodo 11.2 NO TB : 13.5 12.3 517.5 1000 51.8 97
4 BrainFish Syzygy-6 : -4.6 12.6 494.0 1000 49.4 100
5 Houdini_602 NO TB : -30.7 12.1 460.0 1000 46.0 100
6 BrainFish NO TB : -70.6 12.5 408.5 1000 40.9 ---
The ELO gain from TBs (6-men Syzygy):
- Komodo 11.2.2: 27.3
BrainFish: 66.0
Houdini 6.02: 82.3
2/ To see that this is not just a property of this particular endgame variant, I also checked with a 7-8-9 men opening suite of unbalanced endgames occurring in normal games. This suite is not that sensitive to TBs as the previous one, but contains a large diversity of endgames.
3000 games Round-Robin, 1000 games each engine with and without 6-men Syzygy. Result in Ordo:
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(next)
1 Houdini_602 Syzygy-6 : 29.6 13.7 550.5 1000 55.0 91
2 BrainFish Syzygy-6 : 15.2 13.7 526.0 1000 52.6 85
3 Komodo 11.2 Syzygy-6 : 3.8 13.7 506.5 1000 50.6 93
4 Komodo 11.2 NO TB : -12.6 13.6 478.5 1000 47.9 52
5 BrainFish NO TB : -13.2 13.7 477.5 1000 47.8 81
6 Houdini_602 NO TB : -22.9 13.7 461.0 1000 46.1 ---
The ELO gain from TBs (6-men Syzygy):
- Komodo 11.2.2: 16.4
BrainFish: 28.4
Houdini 6.02: 52.5