Stockfish NNUE SV Tests

[mehmet123]

Stockfish Dev vs Stockfish 13 (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 190321 x64 bmi2 : 2417 13 13 1000 54.9 % 2383 65.5 %
2 Stockfish 13 x64 bmi2 :2383 13 13 1000 45.1 % 2417 65.5 %

Individual statistics:

1 Stockfish 190321 x64 bmi2 : 2417 1000 (+221,=655,-124), 54.9 %

Stockfish 13 x64 bmi2 : 1000 (+221,=655,-124), 54.9 %

2 Stockfish 13 x64 bmi2 : 2383 1000 (+124,=655,-221), 45.1 %

Stockfish 190321 x64 bmi2 : 1000 (+124,=655,-221), 45.1 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, No Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/hqaqcfn6 ... 9.pgn/file

Another good performance (+34 elo) of Stockfish 190321 at FRC match.

Test with Chess960 Book 3 Moves Opening Book:
+2 elo (10 sec+ 0.2 sec)
+6 elo ( 1 minute)

No Opening Book Tests:
+34 elo (10 sec+ 0.2 sec)
+54 elo ( 1minute)

[mehmet123]

Sugar AI vs Stockfish Dev

Program Elo + - Games Score Av.Op. Draws

1 SugaR AI 1.60 bmi2 : 2403 8 8 1000 50.4 % 2399 85.6 %
2 Stockfish 190321 x64 bmi2 : 2400 8 8 1000 49.6 % 2401 85.6 %

Individual statistics:

1 SugaR AI 1.60 bmi2 : 2403 1000 (+ 76,=856,- 68), 50.4 %

Stockfish 190321 x64 bmi2 : 1000 (+ 76,=856,- 68), 50.4 %

2 Stockfish 190321 x64 bmi2 : 2400 1000 (+ 68,=856,- 76), 49.6 %

SugaR AI 1.60 bmi2 : 1000 (+ 68,=856,- 76), 49.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
Default Nets/Sugar 1.60 didn't use experience file
https://www.mediafire.com/file/5mtdwls6 ... 0.pgn/file

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 240321 x64 bmi2 : 2405 13 12 500 51.5 % 2395 83.0 %
2 Stockfish 190321 x64 bmi2 : 2395 12 13 500 48.5 % 2405 83.0 %

Individual statistics:

1 Cfish 240321 x64 bmi2 : 2405 500 (+ 50,=415,- 35), 51.5 %

Stockfish 190321 x64 bmi2 : 500 (+ 50,=415,- 35), 51.5 %

2 Stockfish 190321 x64 bmi2 : 2395 500 (+ 35,=415,- 50), 48.5 %

Cfish 240321 x64 bmi2 : 500 (+ 35,=415,- 50), 48.5 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 240321 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/eg14i4rp ... 1.pgn/file

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 240321 x64 bmi2 : 2407 10 10 500 51.0 % 2397 89.6 %
2 Stockfish 190321 x64 bmi2 : 2400 10 10 500 49.0 % 2403 89.6 %

Individual statistics:

1 Cfish 240321 x64 bmi2 : 2407 500 (+ 31,=448,- 21), 51.0 %

Stockfish 190321 x64 bmi2 : 500 (+ 31,=448,- 21), 51.0 %

2 Stockfish 190321 x64 bmi2 : 2400 500 (+ 21,=448,- 31), 49.0 %

Cfish 240321 x64 bmi2 : 500 (+ 21,=448,- 31), 49.0 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 240321 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/4iwhu5bz ... 2.pgn/file

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 110421 x64 bmi2 : 2405 7 7 1000 51.3 % 2395 88.8 %
2 Stockfish 060421 x64 bmi2 : 2395 7 7 1000 48.7 % 2405 88.8 %

Individual statistics:

1 Cfish 110421 x64 bmi2 : 2405 1000 (+ 69,=888,- 43), 51.3 %

Stockfish 060421 x64 bmi2 : 1000 (+ 69,=888,- 43), 51.3 %

2 Stockfish 060421 x64 bmi2 : 2395 1000 (+ 43,=888,- 69), 48.7 %

Cfish 110421 x64 bmi2 : 1000 (+ 43,=888,- 69), 48.7 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish110421 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/8bvmpt2r ... 0.pgn/file

[mehmet123]

Dragon 2 by Komodo vs. Stockfish Dev:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 020521 x64 bmi2 : 2459 19 18 500 66.3 % 2341 60.6 %
2 Dragon 2 x64 avx2 : 2341 18 19 500 33.7 % 2459 60.6 %


Individual statistics:

1 Stockfish 020521 x64 bmi2 : 2459 500 (+180,=303,- 17), 66.3 %

Dragon 2 x64 avx2 : 500 (+180,=303,- 17), 66.3 %

2 Dragon 2 x64 avx2 : 2341 500 (+ 17,=303,-180), 33.7 %

Stockfish 020521 x64 bmi2 : 500 (+ 17,=303,-180), 33.7 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/j4jemlov ... 1.pgn/file

[mehmet123]

Dragon 2 by Komodo vs. Stockfish Dev:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 020521 x64 bmi2 : 2436 20 18 300 60.3 % 2364 74.7 %
2 Dragon 2 x64 avx2 : 2364 18 20 300 39.7 % 2436 74.7 %


Individual statistics:

1 Stockfish 020521 x64 bmi2 : 2436 300 (+ 69,=224,- 7), 60.3 %

Dragon 2 x64 avx2 : 300 (+ 69,=224,- 7), 60.3 %

2 Dragon 2 x64 avx2 : 2364 300 (+ 7,=224,- 69), 39.7 %

Stockfish 020521 x64 bmi2 : 300 (+ 7,=224,- 69), 39.7 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/bf7esq2z ... 2.pgn/file

[mehmet123]

Dragon 2 by Komodo vs. Stockfish Dev:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 020521 x64 bmi2 : 2428 17 15 300 58.0 % 2372 81.3 %
2 Dragon 2 x64 avx2 : 2372 15 17 300 42.0 % 2428 81.3 %


Individual statistics:

1 Stockfish 020521 x64 bmi2 : 2428 300 (+ 52,=244,- 4), 58.0 %

Dragon 2 x64 avx2 : 300 (+ 52,=244,- 4), 58.0 %

2 Dragon 2 x64 avx2 : 2372 300 (+ 4,=244,- 52), 42.0 %

Stockfish 020521 x64 bmi2 : 300 (+ 4,=244,- 52), 42.0 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 5 min TC, Balsa 5 Move Opening Book, 512 Mb Hash, Ponder Off
https://www.mediafire.com/file/0cjagn67 ... 3.pgn/file


Elo difference between Stockfish Dev and Dragon 2:
10 sec + 0.2 sec TC: + 118
1 min+ 0.5 sec TC: +72
5 min+ 0 sec TC:+56

The elo difference is decreasing with increasing time control. It is not hard to guess that Dragon 2 will push for victory at TCEC Tournament.

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 090521x64 bmi2 : 2404 11 11 600 51.2 % 2396 83.3 %
2 Stockfish 070521 x64 bmi2 : 2396 11 11 600 48.8 % 2404 83.3 %


Individual statistics:

1 Cfish 090521 x64 bmi2 : 2404 600 (+ 57,=500,- 43), 51.2 %

Stockfish 070521 x64 bmi2 : 600 (+ 57,=500,- 43), 51.2 %

2 Stockfish 070521 x64 bmi2 : 2396 600 (+ 43,=500,- 57), 48.8 %

Cfish 090521 bmi2 : 600 (+ 43,=500,- 57), 48.8 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/pdygshxw ... 4.pgn/file

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 090521 x64 bmi2 : 2406 9 9 600 51.7 % 2394 89.3 %
2 Stockfish 070521 x64 bmi2 : 2394 9 9 600 48.3 % 2406 89.3 %


Individual statistics:

1 Cfish 090521 bmi2 : 2406 600 (+ 42,=536,- 22), 51.7 %

Stockfish 070521 x64 bmi2 : 600 (+ 42,=536,- 22), 51.7 %

2 Stockfish 070521 x64 bmi2 : 2394 600 (+ 22,=536,- 42), 48.3 %

Cfish 090521 bmi2 : 600 (+ 22,=536,- 42), 48.3 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/h2pwy75w ... 5.pgn/file