Page 1 of 2
ELO progression measured by year
Posted: Wed Dec 13, 2017 5:11 pm
by Rebel
ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (
S)ingle (
P)rocessor and (
M)ulti (
P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.
...
http://rebel13.nl/misc/stats.html
Re: ELO progression measured by year
Posted: Wed Dec 13, 2017 7:58 pm
by duncan
Rebel wrote:ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (
S)ingle (
P)rocessor and (
M)ulti (
P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.
...
http://rebel13.nl/misc/stats.html
very useful. thanks.
were there hardware changes during those years?
Re: ELO progression measured by year
Posted: Wed Dec 13, 2017 8:51 pm
by mjlef
Do you have the same thing for the top 1 to 3 engines? I think averaging over 100 engines is going to make the progress look much slower than it was, at least for the stronger programs.
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 11:01 am
by Rebel
duncan wrote:Rebel wrote:ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (
S)ingle (
P)rocessor and (
M)ulti (
P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.
...
http://rebel13.nl/misc/stats.html
very useful. thanks.
were there hardware changes during those years?
That's a good question that only can be answered by the CCRL folks. If they provide information I could add an extra column to the table.
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 11:05 am
by Rebel
mjlef wrote:Do you have the same thing for the top 1 to 3 engines? I think averaging over 100 engines is going to make the progress look much slower than it was, at least for the stronger programs.
I made a start doing so, it's only for the years 2006-2008 currently, it's a lot of work. But interesting enough to finish it. Also the progress for the best engine will be measured.
http://rebel13.nl/misc/stats.html
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 11:19 am
by Ozymandias
Rebel wrote:That's a good question that only can be answered by the CCRL folks. If they provide information I could add an extra column to the table.
They adapt the TC to even out HW speed, so what machine each tester is using, becomes irrelevant.
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 11:58 am
by duncan
Rebel wrote:ELO progression measured by year based on CCRL 40/20 games which were played that year. ELO numbers are based on the average rating of the 100 best engines and splitted into a (
S)ingle (
P)rocessor and (
M)ulti (
P)rocessor list, follow the orange links to view the details. Furthermore the statistic of the opening lines shows the quality of the randomness.
...
http://rebel13.nl/misc/stats.html
the increase for best program for the period
single
2921 - Rybka 2.2 64-bit
3352 - asmFish 051117 64-bit
431 increase
multiple
3002 - Rybka 2.1 64-bit 4CPU
3426 - asmFish 051117 64-bit 4CPU
424 increase
for top 3
single
2921 - Rybka 2.2 64-bit
2779 - Fritz 10
2776 - Hiarcs 11
average 2825
3352 - asmFish 051117 64-bit
3341 - Houdini 6 64-bit
3327 - SugaR XPrO 1.3 64-bit
average 3340
increase 515
multiple
3002 - Rybka 2.1 64-bit 4CPU
2864 - Hiarcs 11 4CPU
2855 - Rybka 1.1 32-bit
average 2907
3426 - asmFish 051117 64-bit 4CPU
3414 - SugaR XPrO 1.2 64-bit 4CPU
3411 - Houdini 6 64-bit 4CPU
average 3417
increase 510
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 12:50 pm
by Rebel
Ozymandias wrote:Rebel wrote:That's a good question that only can be answered by the CCRL folks. If they provide information I could add an extra column to the table.
They adapt the TC to even out HW speed, so what machine each tester is using, becomes irrelevant.
I see, so basically they are running a 40/40 list based on the hardware of 2006?
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 3:54 pm
by Ozymandias
"Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU."
Note it's either "40/40" or "40/4", "40/20" would be CEGT.
Re: ELO progression measured by year
Posted: Thu Dec 14, 2017 5:24 pm
by Rebel