Discussion of anything and everything relating to chess playing software and machines.
Moderators: hgm , Rebel , chrisw
Ferdy
Posts: 4833Joined: Sun Aug 10, 2008 3:15 pmLocation: Philippines
Post by Ferdy Tue Apr 20, 2021 12:02 pm
Maia Lichess 1546 has a blitz
Lichess rating of around 1546 . This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.
The formula to get FIDE Elo from Lichess Blitz Elo is,
Code: Select all
FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the
regression in 2019 .
Maia FIDE Elo = 65 + 0.87 x 1546 = 1410
Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.
Code: Select all
# Player : FIDE Elo Points Played Points(%)
1 Rybka v2.3.2a UCI_Elo 1500 : 2217 99.0 100 99.0
2 Minic 2.51 UCI_Elo 1500 : 2145 98.5 100 98.5
3 Cheese 2.1 UCI_Elo 1500 : 2094 98.0 100 98.0
4 Honey X5i UCI_Elo 1500 : 2054 97.5 100 97.5
5 Cheng 4.39 UCI_Elo 1500 : 2054 97.5 100 97.5
6 Ufim v8.02 UCI_Elo 1500 : 2021 97.0 100 97.0
7 Amyan 1.72 UCI_Elo 1500 : 1910 94.5 100 94.5
8 Wasp 4.5 UCI_Elo 1500 : 1840 92.0 100 92.0
9 MadChess 3.0 UCI_Elo 1500 : 1817 91.0 100 91.0
10 Deuterium v2021.1.38.29.4 UCI_Elo 1500 : 1753 87.5 100 87.5
11 Rhetoric 1.4.3 UCI_Elo 1500 : 1737 86.5 100 86.5
12 Discocheck 5.2 UCI_Elo 1500 : 1730 86.0 100 86.0
13 Arasan 21.1 UCI_Elo 1500 : 1716 85.0 100 85.0
14 Rodent IV 022 UCI_Elo 1500 : 1716 85.0 100 85.0
15 Deuterium v2019.2.37.73 UCI_Elo 1500 : 1599 74.5 100 74.5
16 Danasah 7.9 UCI_Elo 1500 : 1599 74.5 100 74.5
17 Stockfish 13 UCI_Elo 1500 : 1539 67.5 100 67.5
18 Hiarcs 14 UCI_Elo 1500 : 1449 55.5 100 55.5
19 Maia Lichess 1546 : 1410 312.5 1900 16.4
20 Deuterium v2014.2.33.276 UCI_Elo 1500 : 1171 20.5 100 20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
xr_a_y
Posts: 1871Joined: Sat Nov 25, 2017 2:28 pmLocation: France
Post by xr_a_y Tue Apr 20, 2021 12:44 pm
Thanks for this test, I'll work on Minic Elo tuning soon.
mar
Posts: 2554Joined: Fri Nov 26, 2010 2:00 pmLocation: Czech RepublicFull name: Martin Sedlak
Post by mar Tue Apr 20, 2021 12:54 pm
Ferdy, could you try Cheng 4.40 instead?
Martin Sedlak
Ferdy
Posts: 4833Joined: Sun Aug 10, 2008 3:15 pmLocation: Philippines
Post by Ferdy Tue Apr 20, 2021 1:40 pm
Added Cheng 4.40, much better than the previous version.
Code: Select all
# Player : FIDE Elo Points Played Points(%)
1 Rybka v2.3.2a UCI_Elo 1500 : 2217 99.0 100 99.0
2 Minic 2.51 UCI_Elo 1500 : 2145 98.5 100 98.5
3 Cheese 2.1 UCI_Elo 1500 : 2094 98.0 100 98.0
4 Cheng 4.39 UCI_Elo 1500 : 2054 97.5 100 97.5
5 Honey X5i UCI_Elo 1500 : 2054 97.5 100 97.5
6 Ufim v8.02 UCI_Elo 1500 : 2021 97.0 100 97.0
7 Amyan 1.72 UCI_Elo 1500 : 1910 94.5 100 94.5
8 Wasp 4.5 UCI_Elo 1500 : 1840 92.0 100 92.0
9 MadChess 3.0 UCI_Elo 1500 : 1817 91.0 100 91.0
10 Deuterium v2021.1.38.29.4 UCI_Elo 1500 : 1752 87.5 100 87.5
11 Rhetoric 1.4.3 UCI_Elo 1500 : 1737 86.5 100 86.5
12 Cheng 4.40 UCI_Elo 1500 : 1729 86.0 100 86.0
13 Discocheck 5.2 UCI_Elo 1500 : 1729 86.0 100 86.0
14 Rodent IV 022 UCI_Elo 1500 : 1715 85.0 100 85.0
15 Arasan 21.1 UCI_Elo 1500 : 1715 85.0 100 85.0
16 Deuterium v2019.2.37.73 UCI_Elo 1500 : 1599 74.5 100 74.5
17 Danasah 7.9 UCI_Elo 1500 : 1599 74.5 100 74.5
18 Stockfish 13 UCI_Elo 1500 : 1539 67.5 100 67.5
19 Hiarcs 14 UCI_Elo 1500 : 1449 55.5 100 55.5
20 Maia Lichess 1546 : 1410 326.5 2000 16.3
21 Deuterium v2014.2.33.276 UCI_Elo 1500 : 1171 20.5 100 20.5
MikeB
Posts: 4889Joined: Thu Mar 09, 2006 6:34 amLocation: Pen Argyl, Pennsylvania
Post by MikeB Tue Apr 20, 2021 5:25 pm
Ferdy wrote: ↑ Tue Apr 20, 2021 12:02 pm
Maia Lichess 1546 has a blitz
Lichess rating of around 1546 . This engine is run with maia-1100.pb.gz net at node 1 on a gauntlet test below.
The formula to get FIDE Elo from Lichess Blitz Elo is,
Code: Select all
FIDE rating = 65 + [0.87 x Lichess Blitz Rating]
based from the
regression in 2019 .
Maia FIDE Elo = 65 + 0.87 x 1546 = 1410
Maia gauntlet bullet at TC 60s+100ms and is set at FIDE Elo 1410.
Code: Select all
# Player : FIDE Elo Points Played Points(%)
1 Rybka v2.3.2a UCI_Elo 1500 : 2217 99.0 100 99.0
2 Minic 2.51 UCI_Elo 1500 : 2145 98.5 100 98.5
3 Cheese 2.1 UCI_Elo 1500 : 2094 98.0 100 98.0
4 Honey X5i UCI_Elo 1500 : 2054 97.5 100 97.5
5 Cheng 4.39 UCI_Elo 1500 : 2054 97.5 100 97.5
6 Ufim v8.02 UCI_Elo 1500 : 2021 97.0 100 97.0
7 Amyan 1.72 UCI_Elo 1500 : 1910 94.5 100 94.5
8 Wasp 4.5 UCI_Elo 1500 : 1840 92.0 100 92.0
9 MadChess 3.0 UCI_Elo 1500 : 1817 91.0 100 91.0
10 Deuterium v2021.1.38.29.4 UCI_Elo 1500 : 1753 87.5 100 87.5
11 Rhetoric 1.4.3 UCI_Elo 1500 : 1737 86.5 100 86.5
12 Discocheck 5.2 UCI_Elo 1500 : 1730 86.0 100 86.0
13 Arasan 21.1 UCI_Elo 1500 : 1716 85.0 100 85.0
14 Rodent IV 022 UCI_Elo 1500 : 1716 85.0 100 85.0
15 Deuterium v2019.2.37.73 UCI_Elo 1500 : 1599 74.5 100 74.5
16 Danasah 7.9 UCI_Elo 1500 : 1599 74.5 100 74.5
17 Stockfish 13 UCI_Elo 1500 : 1539 67.5 100 67.5
18 Hiarcs 14 UCI_Elo 1500 : 1449 55.5 100 55.5
19 Maia Lichess 1546 : 1410 312.5 1900 16.4
20 Deuterium v2014.2.33.276 UCI_Elo 1500 : 1171 20.5 100 20.5
The closest engines at FIDE Elo 1500 within 100 Elo are Stockfish, Hiarcs, Maia, Danasah and Deuterium v2019.2.37.73.
Looks like several engines are tuning to CCRL 1500 which is significantly stronger than 1500 FIDE . about 1890 +/- 100
Patrice Duhamel
Posts: 193Joined: Sat May 25, 2013 11:17 amLocation: FranceFull name: Patrice Duhamel
Post by Patrice Duhamel Tue Apr 20, 2021 6:31 pm
You should try Cheese 2.2, I changed UCI_Elo calculation, based on a formula from one of your previous post.
Anything that can go wrong will go wrong.
Uri Blass
Posts: 10268Joined: Thu Mar 09, 2006 12:37 amLocation: Tel-Aviv Israel
Post by Uri Blass Tue Apr 20, 2021 7:18 pm
I am not sure if regression from 2019 is reliable.
Ferdy
Posts: 4833Joined: Sun Aug 10, 2008 3:15 pmLocation: Philippines
Post by Ferdy Tue Apr 20, 2021 7:58 pm
Some engines are added. The top 3 are now CT800, Delfi and Stockfish.
Code: Select all
num engine games fide_elo diff
1 CT800 V1.42 UCI_Elo 1500 100 1515 15
2 Delfi 5.4 UCI_Elo 1500 100 1463 37
3 Stockfish 13 UCI_Elo 1500 100 1539 39
4 Hiarcs 14 UCI_Elo 1500 100 1449 51
5 Maia Lichess 1546 2500 1410 90
6 Danasah 7.9 UCI_Elo 1500 100 1599 99
7 Deuterium v2019.2.37.73 UCI_Elo 1500 100 1599 99
8 Rodent IV 022 UCI_Elo 1500 100 1716 216
9 Arasan 21.1 UCI_Elo 1500 100 1716 216
10 Cheng 4.40 UCI_Elo 1500 100 1730 230
11 Discocheck 5.2 UCI_Elo 1500 100 1730 230
12 Rhetoric 1.4.3 UCI_Elo 1500 100 1737 237
13 Deuterium v2021.1.38.29.4 UCI_Elo 1500 100 1753 253
14 MadChess 3.0 UCI_Elo 1500 100 1817 317
15 Deuterium v2014.2.33.276 UCI_Elo 1500 100 1171 329
16 Wasp 4.5 UCI_Elo 1500 100 1840 340
17 Amyan 1.72 UCI_Elo 1500 100 1910 410
18 Ufim v8.02 UCI_Elo 1500 100 2021 521
19 Cheng 4.39 UCI_Elo 1500 100 2054 554
20 Honey X5i UCI_Elo 1500 100 2054 554
21 Cheese 2.1 UCI_Elo 1500 100 2094 594
22 Cheese 2.2 UCI_Elo 1500 100 2146 646
23 Minic 2.51 UCI_Elo 1500 100 2146 646
24 Rybka v2.3.2a UCI_Elo 1500 100 2217 717
25 Spike 1.4 UCI_Elo 1500 100 2400 900
26 Equinox 3.30 UCI_Elo 1500 100 2400 900
diff : The absolute difference between 1500 and fide_elo, lower diff is better.
Ferdy
Posts: 4833Joined: Sun Aug 10, 2008 3:15 pmLocation: Philippines
Post by Ferdy Tue Apr 20, 2021 8:01 pm
Patrice Duhamel wrote: ↑ Tue Apr 20, 2021 6:31 pm
You should try Cheese 2.2, I changed UCI_Elo calculation, based on a formula from one of your previous post.
It's difficult to find a formula that works with all possible ELO values.
In Cheese 2.2 there are 2 modes for UCI_Elo, in cheese.ini, UCILimitMode=0 to reduce the speed, or UCILimitMode=1 to limit searched nodes.
If someone want to play with it, the formula is :
speed = exp((elo + B) / A)
and there are 2 hidden parameters in cheese.ini :
EloNodesParamA and EloNodesParamB, by default A = 242.573714, and B = 749.87557
the same formula is used when limiting nodes.
I have added 2.2 and the result is almost the same to previous version. I have not touched the ini file.
Ferdy
Posts: 4833Joined: Sun Aug 10, 2008 3:15 pmLocation: Philippines
Post by Ferdy Tue Apr 20, 2021 8:04 pm
Uri Blass wrote: ↑ Tue Apr 20, 2021 7:18 pm
I am not sure if regression from 2019 is reliable.
I am not sure if lichess rating X of 2019 is the same as lichess rating X of 2021.
What is your proposal to make the estimates more closer to the truth?
