Stockfish NNUE SV Tests

[mehmet123]

Honey vs Stockfish (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Honey 13.2 x64 bmi2 : 2406 11 11 1200 51.6 % 2394 68.6 %
2 Stockfish 300521 x64 bmi2 : 2394 11 11 1200 48.4 % 2406 68.6 %

Individual statistics:

1 Honey 13.2 x64 bmi2 : 2406 1200 (+208,=823,-169), 51.6 %

Stockfish 300521 x64 bmi2 : 1200 (+208,=823,-169), 51.6 %

2 Stockfish 300521 x64 bmi2 : 2394 1200 (+169,=823,-208), 48.4 %

Honey 13.2 x64 bmi2 : 1200 (+169,=823,-208), 48.4 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/fucskr1v ... 7.pgn/file

[mehmet123]

Honey vs Cfish:

Program Elo + - Games Score Av.Op. Draws

1 Honey 13.2 x64 bmi2 : 2408 9 9 1000 52.4 % 2392 81.0 %
2 Cfish 090521 x64 bmi2 : 2392 9 9 1000 47.6 % 2408 81.0 %

Individual statistics:

1 Honey 13.2 x64 bmi2 : 2408 1000 (+119,=810,- 71), 52.4 %

Cfish 090521 x64 bmi2 : 1000 (+119,=810,- 71), 52.4 %

2 Cfish 090521 x64 bmi2 : 2392 1000 (+ 71,=810,-119), 47.6 %

Honey 13.2 x64 bmi2 : 1000 (+ 71,=810,-119), 47.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile)
https://www.mediafire.com/file/75u9xmw3 ... 8.pgn/file

The most important reason why the power difference is so high is that Cfish has not been yet been updated.

[Modern Times]

Honey vs Stockfish (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Honey 13.2 x64 bmi2 : 2406 11 11 1200 51.6 % 2394 68.6 %
2 Stockfish 300521 x64 bmi2 : 2394 11 11 1200 48.4 % 2406 68.6 %

Great performance from Honey !

[mehmet123]

Honey vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Honey 13.2 x64 bmi2 : 2401 8 7 500 50.2 % 2399 94.0 %
2 Stockfish 01062 x64 bmi2 : 2399 7 8 500 49.8 % 2401 94.0 %

Individual statistics:

1 Honey 13.2 x64 bmi2 : 2401 500 (+ 16,=470,- 14), 50.2 %

Stockfish 01062 x64 bmi2 : 500 (+ 16,=470,- 14), 50.2 %

2 Stockfish 01062 x64 bmi2 : 2399 500 (+ 14,=470,- 16), 49.8 %

Honey 13.2 x64 bmi2 : 500 (+ 14,=470,- 16), 49.8 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 3 min + 0 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/lef1dulh ... 9.pgn/file


Honey 13.2 - Stockfish 280521: +8 elo// 10 sec + 0.2 sec (800 games)
Honey 13.2 - Stockfish 280521: +6 elo // 30 sec + 0.5 sec (800 games)
Honey 13.2 - Stockfish 010621: +2 elo // 3 min + 0 sec (500 games)
Honey 13.2 - Cfish 090521 : +16 elo // 10 sec + 0.2 sec (1000 games)
Honey 13.2- Stockfish 300521: +12 elo // 10 sec + 0.2 sec (1200 games)// Fischer Random Chess

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 080621 x64 bmi2 : 2410 8 7 1000 52.8 % 2390 87.9 %
2 Stockfish 13 x64 bmi2 : 2390 7 8 1000 47.1 % 2410 87.9 %

Individual statistics:

1 Stockfish 080621 x64 bmi2 : 2410 1000 (+ 89,=879,- 32), 52.9 %

Stockfish 13 x64 bmi2 : 1000 (+ 89,=879,- 32), 52.8 %

2 Stockfish 13 x64 bmi2 : 2390 1000 (+ 32,=879,- 89), 47.1 %

Stockfish 080621 x64 bmi2 : 1000 (+ 32,=879,- 89), 47.1 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/dppdawdt ... 0.pgn/file

[mehmet123]

Dark Horse Net vs Default Net:

Program Elo + - Games Score Av.Op. Draws

1 SugaR AI 2.10 bmi2 : 2411 18 16 200 53.2 % 2389 87.5 %
2 SugaR AI 2.10 bmi2 DH : 2389 16 18 200 46.8 % 2411 87.5 %

Individual statistics:

1 SugaR AI 2.10 bmi2 : 2411 200 (+ 19,=175,- 6), 53.2 %

SugaR AI 2.10 bmi2 DH : 200 (+ 19,=175,- 6), 53.2 %

2 SugaR AI 2.10 bmi2 DH : 2389 200 (+ 6,=175,- 19), 46.8 %

SugaR AI 2.10 bmi2 : 200 (+ 6,=175,- 19), 46.8 %


Game Conditions: Cutechess Gui, 6 Core (Core-i7 9750h), 30 sec + 0,5 sec TC, Balsa 5 Moves Opening Book, 512 Mb Hash, Ponder Off//Learning:Off
SugaR AI 2.10 bmi2 plays with Default Stockfish Net //SugaR AI 2.10 bmi2 DH plays with Dark Horse 0.3 XL Net
https://www.mediafire.com/file/25m9397i ... 1.pgn/file

[mehmet123]

Stockfish Dev vs Stockfish 13: (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 140621 x64 bmi2 : 2407 14 14 800 52.1 % 2393 67.9 %
2 Stockfish 13 x64 bmi2 : 2393 14 14 800 47.9 % 2407 67.9 %

Individual statistics:

1 Stockfish 140621 x64 bmi2 : 2407 800 (+145,=543,-112), 52.1 %

Stockfish 13 x64 bmi2 : 800 (+145,=543,-112), 52.1 %

2 Stockfish 13 x64 bmi2 : 2393 800 (+112,=543,-145), 47.9 %

Stockfish 140621 x64 bmi2 : 800 (+112,=543,-145), 47.9 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/3h1nme3f ... 3.pgn/file

[mehmet123]

Opening Book vs No Opening Book Test:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish Polyglot 13 Don : 2417 14 11 300 55.0 % 2383 89.3 %
2 Stockfish Polyglot 13 Master : 2383 11 14 300 45.0 % 2417 89.3 %

Individual statistics:

1 Stockfish Polyglot 13 Don : 2417 300 (+ 31,=268,- 1), 55.0 %

Stockfish Polyglot 13 Master : 300 (+ 31,=268,- 1), 55.0 %

2 Stockfish Polyglot 13 Master: 2383 300 (+ 1,=268,- 31), 45.0 %

Stockfish Polyglot 13 Don : 300 (+ 1,=268,- 31), 45.0 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, 64 Mb Hash, Ponder Off
Stockfish Polyglot 13 Master played without opening book.
Stockfish Polyglot 13 x64 bmi2 by Massimiliano Goi// Don Free opening book by Vasid Chouhan
https://www.mediafire.com/file/5pxb56c2 ... 4.pgn/file

[mehmet123]

Opening Book vs No Opening Book Test:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish Polyglot 13 Chucaro : 2407 10 8 300 52.0 % 2393 94.7 %
2 Stockfish Polyglot 13 Master : 2393 8 10 300 48.0 % 2407 94.7 %

Individual statistics:

1 Stockfish Polyglot 13 Chucaro: 2407 300 (+ 14,=284,- 2), 52.0 %

Stockfish Polyglot 13 Master : 300 (+ 14,=284,- 2), 52.0 %

2 Stockfish Polyglot 13 Master: 2393 300 (+ 2,=284,- 14), 48.0 %

Stockfish Polyglot 13 Chucaro : 300 (+ 2,=284,- 14), 48.0 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, 64 Mb Hash, Ponder Off
Stockfish Polyglot 13 Master played without opening book.
Stockfish Polyglot 13 x64 bmi2 by Massimiliano Goi// Chucaro opening book by Angel Morano
https://www.mediafire.com/file/05kmac1a ... 5.pgn/file

[mehmet123]

Opening Book vs No Opening Book Test:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish Polyglot 13 MANTIS5 : 2405 12 11 300 51.3 % 2395 92.0 %
2 Stockfish Polyglot 13 Master : 2395 11 12 300 48.7 % 2405 92.0 %

Individual statistics:

1 Stockfish Polyglot 13 MANTIS5: 2405 300 (+ 16,=276,- 8), 51.3 %

Stockfish Polyglot 13 Master : 300 (+ 16,=276,- 8), 51.3 %

2 Stockfish Polyglot 13 Master: 2395 300 (+ 8,=276,- 16), 48.7 %

Stockfish Polyglot 13 MANTIS5 : 300 (+ 8,=276,- 16), 48.7 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, 64 Mb Hash, Ponder Off
Stockfish Polyglot 13 Master played without opening book.
Stockfish Polyglot 13 x64 bmi2 by Massimiliano Goi// MANTIS5 opening book by Roger Constantinesco
https://www.mediafire.com/file/cjj5b1s4 ... 6.pgn/file

These 3 opening books (Don Free, Chucaro, MANTIS5) that I used in my tests are currently in the top 3 at SCCT Book CS LV tournament.
https://sites.google.com/site/computers ... book-cs-55