fixed nodes_starting_rating list

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Uri Blass
Posts: 10803
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

fixed nodes_starting_rating list

Post by Uri Blass »

generated by ordo.
# PLAYER : RATING POINTS PLAYED (%)
1 Stockfish 16.1 2048nodes : 858.5 75.5 82 92
2 Viridithas 12.0.0 2048 nodes : 738.2 70.5 82 86
3 Caissa 1.17 AVX2 2048nodes : 709.3 69.0 82 84
4 Alexandria-6.0 2048 nodes : 691.2 68.0 82 83
5 Stockfish 16.1 1024nodes : 657.5 66.0 82 80
6 PlentyChess 2048 nodes : 569.1 60.0 82 73
7 Seer 2.8.0 2048 nodes : 562.4 59.5 82 73
8 Viridithas 12.0.0 1024 nodes : 555.8 59.0 82 72
9 Koivisto 9.0 2048 nodes : 517.3 56.0 82 68
10 Altair 7.0.0 2048 nodes : 492.7 54.0 82 66
11 Altair 7.0.0 1024 nodes : 474.8 52.5 82 64
12 Berserk 12 2048 nodes : 468.9 52.0 82 63
13 Obsidian 11.0 2048nodes : 468.9 52.0 82 63
14 Caissa 1.17 AVX2 1024nodes : 451.4 50.5 82 62
15 PlentyChess 1024 nodes : 439.9 49.5 82 60
16 Alexandria-6.0 1024 nodes : 417.1 47.5 82 58
17 Black Marlin 9.0 2048 nodes : 417.1 47.5 82 58
18 Igel 3.5.0 2048 nodes : 411.5 47.0 82 57
19 Rubi20240112 2048nodes : 400.3 46.0 82 56
20 Altair 7.0.0 512 nodes : 389.1 45.0 82 55
21 Stockfish 16.1 512 nodes : 344.9 41.0 82 50
22 Viridithas 12.0.0 512 nodes : 344.9 41.0 82 50
23 Clover 6.1 2048 nodes : 322.9 39.0 82 48
24 Alexandria-6.0 512 nodes : 311.9 38.0 82 46
25 Seer 2.8.0 1024 nodes : 306.4 37.5 82 46
26 PlentyChess 512 nodes : 250.7 32.5 82 40
27 Obsidian 11.0 1024nodes : 250.7 32.5 82 40
28 RubiChess 20240112 1024nodes : 239.4 31.5 82 38
29 Koivisto 9.0 1024 nodes : 228.0 30.5 82 37
30 Caissa 1.17 512 nodes : 210.6 29.0 82 35
31 Berserk 12 1024 nodes : 204.8 28.5 82 35
32 Koivisto 9.0 512 nodes : 181.0 26.5 82 32
33 Clover 6.1 1024 nodes : 137.8 23.0 82 28
34 Rubi20240112 512nodes : 124.9 22.0 82 27
35 Black Marlin 9.0 1024 nodes : 118.3 21.5 82 26
36 Seer 2.8.0 512 nodes : 91.4 19.5 82 24
37 Igel 3.5.0 1024 nodes : 91.4 19.5 82 24
38 Igel 3.5.0 512 nodes : 70.2 18.0 82 22
39 Black Marlin 9.0 512 nodes : 70.2 18.0 82 22
40 Berserk 12 512 nodes : 63.0 17.5 82 21
41 Obsidian 11.0 512 nodes : 24.8 15.0 82 18
42 Clover 6.1 512 nodes : 0.0 13.5 82 16

White advantage = 35.65
Draw rate (equal opponents) = 50.00 %

Now the question is if the rating gap will become the same if I add more engines with 512,1024,2048 nodes or increase or decrease.

Note that I chose these engines because they seem to be deterministic and with 256 mbytes hash I always can reproduce the same results.
Uri Blass
Posts: 10803
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: fixed nodes_starting_rating list

Post by Uri Blass »

It seems that the rating of the top players improved when I added more players.

Stockfish 16.1 2048nodes had only rating of 858.5 earlier and now it has a higher rating(clover 512 nodes remained 0 by definition).
# PLAYER : RATING POINTS PLAYED (%)
1 Stockfish 16.1 4096nodes : 1176.0 113.5 118 96
2 Stockfish 16.1 2048nodes : 928.8 103.0 118 87
3 Caissa 1.17 AVX2 4096nodes : 912.9 102.0 118 86
4 Berserk 12 4096 nodes : 869.0 99.0 118 84
5 Alexandria-6.0 4096 nodes : 823.0 95.5 118 81
6 Seer 2.8.0 4096 nodes : 816.8 95.0 118 81
7 Viridithas 12.0.0 4096 nodes : 816.8 95.0 118 81
8 Black Marlin 9.0 4096 nodes : 810.6 94.5 118 80
9 Koivisto 9.0 4096 nodes : 792.6 93.0 118 79
10 PlentyChess 4096 nodes : 781.0 92.0 118 78
11 Obsidian 11.0 4096nodes : 781.0 92.0 118 78
12 Altair 7.0.0 4096 nodes : 747.3 89.0 118 75
13 Igel 3.5.0 4096 nodes : 720.5 86.5 118 73
14 Velvet v7.1.0 4096 nodes : 715.3 86.0 118 73
15 Viridithas 12.0.0 2048 nodes : 710.1 85.5 118 72
16 Caissa 1.17 AVX2 2048nodes : 679.7 82.5 118 70
17 RubiChess 20240112 4096nodes : 674.7 82.0 118 69
18 Clover 6.1 4096 nodes : 650.3 79.5 118 67
19 Alexandria-6.0 2048 nodes : 640.7 78.5 118 67
20 Stockfish 16.1 1024nodes : 603.0 74.5 118 63
21 Velvet v7.1.0 2048 nodes : 575.5 71.5 118 61
22 Seer 2.8.0 2048 nodes : 552.9 69.0 118 58
23 PlentyChess 2048 nodes : 543.9 68.0 118 58
24 Altair 7.0.0 2048 nodes : 521.7 65.5 118 56
25 Viridithas 12.0.0 1024 nodes : 521.7 65.5 118 56
26 Berserk 12 2048 nodes : 499.5 63.0 118 53
27 Velvet v7.1.0 512 nodes : 499.5 63.0 118 53
28 Velvet v7.1.0 1024 nodes : 486.3 61.5 118 52
29 Obsidian 11.0 2048nodes : 486.3 61.5 118 52
30 Caissa 1.17 AVX2 1024nodes : 473.1 60.0 118 51
31 Koivisto 9.0 2048 nodes : 473.1 60.0 118 51
32 Altair 7.0.0 1024 nodes : 451.2 57.5 118 49
33 Black Marlin 9.0 2048 nodes : 446.8 57.0 118 48
34 PlentyChess 1024 nodes : 420.3 54.0 118 46
35 Alexandria-6.0 1024 nodes : 415.9 53.5 118 45
36 Rubi20240112 2048nodes : 411.5 53.0 118 45
37 Altair 7.0.0 512 nodes : 380.4 49.5 118 42
38 Igel 3.5.0 2048 nodes : 380.4 49.5 118 42
39 Viridithas 12.0.0 512 nodes : 367.0 48.0 118 41
40 Stockfish 16.1 512 nodes : 330.7 44.0 118 37
41 Clover 6.1 2048 nodes : 330.7 44.0 118 37
42 Alexandria-6.0 512 nodes : 326.1 43.5 118 37
43 Seer 2.8.0 1024 nodes : 274.5 38.0 118 32
44 Obsidian 11.0 1024nodes : 235.4 34.0 118 29
45 PlentyChess 512 nodes : 230.4 33.5 118 28
46 Caissa 1.17 512 nodes : 220.3 32.5 118 28
47 RubiChess 20240112 1024nodes : 220.3 32.5 118 28
48 Koivisto 9.0 1024 nodes : 215.2 32.0 118 27
49 Berserk 12 1024 nodes : 194.4 30.0 118 25
50 Koivisto 9.0 512 nodes : 162.0 27.0 118 23
51 Black Marlin 9.0 1024 nodes : 139.4 25.0 118 21
52 Clover 6.1 1024 nodes : 139.4 25.0 118 21
53 Rubi20240112 512nodes : 121.9 23.5 118 20
54 Igel 3.5.0 1024 nodes : 97.5 21.5 118 18
55 Seer 2.8.0 512 nodes : 71.9 19.5 118 17
56 Black Marlin 9.0 512 nodes : 71.9 19.5 118 17
57 Igel 3.5.0 512 nodes : 58.5 18.5 118 16
58 Berserk 12 512 nodes : 51.6 18.0 118 15
59 Obsidian 11.0 512 nodes : 7.8 15.0 118 13
60 Clover 6.1 512 nodes : 0.0 14.5 118 12

White advantage = 34.02
Draw rate (equal opponents) = 50.00 %
Uri Blass
Posts: 10803
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: fixed nodes_starting_rating list

Post by Uri Blass »

It seems that based on my tests lc0 is not fully deterministic with fixed nodes so she cannot join my rating list by my rules

In one game it played 33...Kd5 and in another game it played 33...Ke5
Edit:it may be my fault because I did not change the default number of threads from 2 to 1.



Uri Blass
Posts: 10803
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: fixed nodes_starting_rating list

Post by Uri Blass »

It is still not deterministic even after changing the number of threads to 1.
part of the games are the same but not all of them.