Page 1 of 4

Stockfish 12 has arrived!

Posted: Wed Sep 02, 2020 10:54 pm
by daniel71
Let the testing begin!
https://abrok.eu/stockfish/

Re: Stockfish 12 has arrived!

Posted: Wed Sep 02, 2020 11:17 pm
by lkaufman
daniel71 wrote: Wed Sep 02, 2020 10:54 pm Let the testing begin!
https://abrok.eu/stockfish/
I'm getting a 2 to 1 score ratio so far (246 to 123), which is +120 elo, for SF 12 vs SF 11 under CCRL blitz conditions (2' + 1" adapted to hardware), Hert lowdraws book, one thread. Of course direct match might give a somewhat different result than playing against unrelated engines.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 1:15 am
by lkaufman
My final result (SF 12 vs 11, 1 thread, 2' + 1" adapted by CCRL rules for hardware) was 180 wins, 19 losses, 301 draws, which is +116 elo. Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 1:31 am
by Vinvin
lkaufman wrote: Thu Sep 03, 2020 1:15 am Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.
I already saw this for a couple of weeks.
Probably because the moves at low depth are better with NNUE, so the tree is narrower and taller.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 9:34 am
by Rebel
Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 9:53 am
by Laskos
Rebel wrote: Thu Sep 03, 2020 9:34 am Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 10:01 am
by Raphexon
Vinvin wrote: Thu Sep 03, 2020 1:31 am
lkaufman wrote: Thu Sep 03, 2020 1:15 am Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.
I already saw this for a couple of weeks.
Probably because the moves at low depth are better with NNUE, so the tree is narrower and taller.
There have been a lot of pruning patches since NNUE too.
Because the NNUE eval is more reliable at low depth they can afford to cut away more of the tree.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 10:19 am
by Rebel
Laskos wrote: Thu Sep 03, 2020 9:53 am
Rebel wrote: Thu Sep 03, 2020 9:34 am Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.
It's basically a programmer tool, but you can also create a reasonable reliable rating list with it.

http://rebel13.nl/misc/nice.html

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 12:36 pm
by Laskos
Rebel wrote: Thu Sep 03, 2020 10:19 am
Laskos wrote: Thu Sep 03, 2020 9:53 am
Rebel wrote: Thu Sep 03, 2020 9:34 am Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.
It's basically a programmer tool, but you can also create a reasonable reliable rating list with it.

http://rebel13.nl/misc/nice.html
Thanks, will look carefully.

Re: Stockfish 12 has arrived!

Posted: Thu Sep 03, 2020 3:24 pm
by Jhoravi
Is Hyperthreading preferable in NNUE?