Stockfish NNUE SV Tests

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220521 x64 bmi2 : 2415 12 11 500 54.3 % 2385 86.2 %
2 Stockfish 13 x64 bmi2 : 2385 11 12 500 45.7 % 2415 86.2 %

Individual statistics:

1 Stockfish 220521 x64 bmi2 : 2415 500 (+ 56,=431,- 13), 54.3 %

Stockfish 13 x64 bmi2 : 500 (+ 56,=431,- 13), 54.3 %

2 Stockfish 13 x64 bmi2 : 2385 500 (+ 13,=431,- 56), 45.7 %

Stockfish 220521 x64 bmi2 : 500 (+ 13,=431,- 56), 45.7 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Perfect 2021 Opening Book (8 moves), 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/w5w111kr ... 6.pgn/file

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220521 x64 bmi2 : 2407 12 12 501 52.0 % 2393 84.8 %
2 Stockfish 13 x64 bmi2 : 2393 12 12 501 48.0 % 2407 84.8 %


Individual statistics:

1 Stockfish 220521 x64 bmi2 : 2407 500 (+ 48,=424,- 28), 52.0 %

Stockfish 13 x64 bmi2 : 500 (+ 48,=424,- 28), 52.0 %

2 Stockfish 13 x64 bmi2 : 2393 500 (+ 28,=424,- 48), 48.0 %

Stockfish 220521 x64 bmi2 : 500 (+ 28,=424,- 48), 48.0 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/r2qy9h70 ... 7.pgn/file

Stockfish Dev had played always white against Stockfish 13 in the last tests because I accidentally closed the swap sides option. In previous test the elo difference is a bit high (+32 elo ) because of this error.

[mehmet123]

Sugar AI vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 SugaR AI 2.10 x64 bmi2 : 2403 9 9 1000 50.4 % 2399 84.2 %
2 Stockfish 250521 x64 bmi2 : 2400 9 9 1000 49.6 % 2401 84.2 %

Individual statistics:

1 SugaR AI 2.10 x64 bmi2 : 2403 1000 (+ 83,=842,- 75), 50.4 %

Stockfish 250521 x64 bmi2 : 1000 (+ 83,=842,- 75), 50.4 %

2 Stockfish 250521 x64 bmi2 : 2400 1000 (+ 75,=842,- 83), 49.6 %

SugaR AI 2.10 x64 bmi2 : 1000 (+ 75,=842,- 83), 49.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off//Default Nets
https://www.mediafire.com/file/skq4kt9x ... 8.pgn/file

[mehmet123]

Sugar AI vs Stockfish:

Program Elo + - Games Score Av.Op. Draws
1 Stockfish 250521 x64 bmi2 : 2403 5 5 1500 50.4 % 2399 92.8 %
2 SugaR AI 2.10 x64 bmi2 : 2400 5 5 1500 49.6 % 2401 92.8 %

Individual statistics:

1 Stockfish 250521 x64 bmi2 : 2403 1500 (+ 60,=1392,- 48), 50.4 %

SugaR AI 2.10 x64 bmi2 : 1500 (+ 60,=1392,- 48), 50.4 %

2 SugaR AI 2.10 x64 bmi2 : 2400 1500 (+ 48,=1392,- 60), 49.6 %

Stockfish 250521 x64 bmi2 : 1500 (+ 48,=1392,- 60), 49.6 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
Default Nets//Sugar Experience File :Off
https://www.mediafire.com/file/xghnh1cj ... 9.pgn/file

[mehmet123]

Fire vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Fire 8.NN x64 bmi2 : 2439 25 24 400 61.1 % 2361 48.8 %
2 Stockfish 11 x64 bmi2 : 2361 24 25 400 38.9 % 2439 48.8 %

Individual statistics:

1 Fire 8.NN x64 bmi2 : 2439 400 (+147,=195,- 58), 61.1 %

Stockfish 11 x64 bmi2 : 400 (+147,=195,- 58), 61.1 %

2 Stockfish 11 x64 bmi2 : 2361 400 (+ 58,=195,-147), 38.9 %

Fire 8.NN x64 bmi2 : 400 (+ 58,=195,-147), 38.9 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/75nlvtf1 ... 0.pgn/file

[mehmet123]

Fire vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Fire 8.NN x64 bmi2 : 2441 22 21 400 61.5 % 2359 59.5 %
2 Stockfish 11 x64 bmi2 : 2359 21 22 400 38.5 % 2441 59.5 %

Individual statistics:

1 Fire 8.NN x64 bmi2 : 2441 400 (+127,=238,- 35), 61.5 %

Stockfish 11 x64 bmi2 : 400 (+127,=238,- 35), 61.5 %

2 Stockfish 11 x64 bmi2 : 2359 400 (+ 35,=238,-127), 38.5 %

Fire 8.NN x64 bmi2 : 400 (+ 35,=238,-127), 38.5 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/3y6792ro ... 1.pgn/file

[mehmet123]

Fire vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Fire 8.NN x64 bmi2 : 2429 14 14 1100 58.4 % 2371 50.9 %
2 Stockfish 310720 x64 bmi2 : 2371 14 14 1100 41.6 % 2429 50.9 %

Individual statistics:

1 Fire 8.NN x64 bmi2 : 2429 1100 (+362,=560,-178), 58.4 %

Stockfish 310720 x64 bmi2 : 1100 (+362,=560,-178), 58.4 %

2 Stockfish 310720 x64 bmi2 : 2371 1100 (+178,=560,-362), 41.6 %

Fire 8.NN x64 bmi2 : 1100 (+178,=560,-362), 41.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/6izrspw3 ... 2.pgn/file

Stockfish 310720 is the last Stockfish Dev version without NNUE evaluation.

[mehmet123]

Ethereal vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Ethereal 12.75 NX1 : 2406 17 17 800 51.8 % 2394 49.4 %
2 Stockfish 310720 x64 bmi2 : 2394 17 17 800 48.2 % 2406 49.4 %

Individual statistics:

1 Ethereal 12.75 NX1 : 2406 800 (+217,=395,-188), 51.8 %

Stockfish 310720 x64 bmi2 : 800 (+217,=395,-188), 51.8 %

2 Stockfish 310720 x64 bmi2 : 2394 800 (+188,=395,-217), 48.2 %

Ethereal 12.75 NX1 : 800 (+188,=395,-217), 48.2 %

Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/rp5cxywm ... 3.pgn/file

Stockfish 310720 is the last Stockfish Dev version without NNUE evaluation.
Ethereal 12.75 NX1 is a non official Ethereal version. It plays with a NNUE net.

[mehmet123]

Honey vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Honey 13.2 x64 bmi2 : 2404 10 10 800 51.1 % 2396 83.9 %
2 Stockfish 280521 x64 bmi2 : 2396 10 10 800 48.9 % 2404 83.9 %

Individual statistics:

1 Honey 13.2 x64 bmi2 : 2404 800 (+ 73,=671,- 56), 51.1 %

Stockfish 280521 x64 bmi2 : 800 (+ 73,=671,- 56), 51.1 %

2 Stockfish 280521 x64 bmi2 : 2396 800 (+ 56,=671,- 73), 48.9 %

Honey 13.2 x64 bmi2 : 800 (+ 56,=671,- 73), 48.9 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/k7tmrghm ... 5.pgn/file

Great success for Honey chess engine at this test conditions.

[mehmet123]

Honey vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Honey 13.2 x64 bmi2 : 2403 8 7 800 50.9 % 2397 90.4 %
2 Stockfish 280521 x64 bmi2 : 2397 7 8 800 49.1 % 2403 90.4 %

Individual statistics:

1 Honey 13.2 x64 bmi2 : 2403 800 (+ 46,=723,- 31), 50.9 %

Stockfish 280521 x64 bmi2 : 800 (+ 46,=723,- 31), 50.9 %

2 Stockfish 280521 x64 bmi2 : 2397 800 (+ 31,=723,- 46), 49.1 %

Honey 13.2 x64 bmi2 : 800 (+ 31,=723,- 46), 49.1 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/dnslogcb ... 6.pgn/file