So far the score is equal, but I will NOT run 1000 games to find out, 20 games should give me an idea
Fire 8.NN.MC.3 x64
Engine Score Fi Et S-B
1: Fire_8_x64_pext 4.0/7 ······· ====101 12.00
2: Ethereal-pext-avx2 3.0/7 ====010 ······· 12.00
7 of 20 games played
Name of the tournament: Fire8
Site/ Country: MININT-UB2PIMJ, United States
Level: Blitz 5/5
Hardware: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 15.9 GB Memory
Operating system: Windows 10 Enterprise Professional (Build 9200) 64 bit
PGN-File: C:\Program Files (x86)\Arena\Tournaments\IGel.pgn
Website:
E-Mail Address:
Fire 8 = Ethereal 13.00 NNUE
Moderators: hgm, Rebel, chrisw
-
- Posts: 5589
- Joined: Wed Sep 05, 2018 2:16 am
- Location: Moving
- Full name: Jorge Picado
Fire 8 = Ethereal 13.00 NNUE
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
https://indianexpress.com/article/sport ... t-9281394/
-
- Posts: 2488
- Joined: Tue Aug 30, 2016 8:19 pm
- Full name: Rasmus Althoff
Re: Fire 8 = Ethereal 13.00 NNUE
You have no idea. 20 games is nothing.
Rasmus Althoff
https://www.ct800.net
https://www.ct800.net
-
- Posts: 883
- Joined: Sat Mar 13, 2021 1:47 am
- Full name: Amanj Sherwany
Re: Fire 8 = Ethereal 13.00 NNUE
-
- Posts: 5589
- Joined: Wed Sep 05, 2018 2:16 am
- Location: Moving
- Full name: Jorge Picado
Re: Fire 8 = Ethereal 13.00 NNUE
And you believe that if X engine is holding Y engine into an even score after 20 games that either X engine or y engines will eventually come up ahead by 20 games at the end of 1000 games, I do NOT think so, chess engines are not like human and if we use the same opening book (Perfect2021.abk) for both engines after 1000 games, unless we use stupid opening book like TCEC than we can see a big difference after 1000 games.
My conclusion is that Fire 8.NN.MC.3 x64 is equal in strength to Ethereal 13.00 NNUE using same opening book Perfect2021.abk
Engine Score Fi Et S-B
1: Fire_8_x64_pext 10.5/20 ···················· ====101===1=====0=== 99.75
2: Ethereal-pext-avx2 9.5/20 ====010===0=====1=== ···················· 99.75
20 games played / Tournament is finished
Name of the tournament: Fire8
Site/ Country: MININT-UB2PIMJ, United States
Level: Blitz 5/5
Hardware: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 15.9 GB Memory
Operating system: Windows 10 Enterprise Professional (Build 9200) 64 bit
PGN-File: C:\Program Files (x86)\Arena\Tournaments\IGel.pgn
Website:
E-Mail Address:
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
https://indianexpress.com/article/sport ... t-9281394/
-
- Posts: 2488
- Joined: Tue Aug 30, 2016 8:19 pm
- Full name: Rasmus Althoff
Re: Fire 8 = Ethereal 13.00 NNUE
I don't have to believe because I know how statistics work.
If both engines are about equal, you can expect +/-SQRT(N) as error margin. N=20 is very small for even that formula to apply, so it will give you an optimistic lower bound for your expected error. The expected result with even opponents will be between 5.5 and 14.5 points. Your error bar is 170 Elo at least.
So you're obviously talking nonsense. 20 games are ridiculous to conclude equal strength.
Rasmus Althoff
https://www.ct800.net
https://www.ct800.net
-
- Posts: 5589
- Joined: Wed Sep 05, 2018 2:16 am
- Location: Moving
- Full name: Jorge Picado
Re: Fire 8 = Ethereal 13.00 NNUE
Simply put it into a test, as I mentioned before the error bar is not 170 Elo unless you are using different opening books at the most it would be probably 70 Elo. Go ahead start your test of 1000 games and we will talk again next week.Ras wrote: ↑Sat Sep 04, 2021 9:11 pmI don't have to believe because I know how statistics work.
If both engines are about equal, you can expect +/-SQRT(N) as error margin. N=20 is very small for even that formula to apply, so it will give you an optimistic lower bound for your expected error. The expected result with even opponents will be between 5.5 and 14.5 points. Your error bar is 170 Elo at least.
So you're obviously talking nonsense. 20 games are ridiculous to conclude equal strength.
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
https://indianexpress.com/article/sport ... t-9281394/
-
- Posts: 1759
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Fire 8 = Ethereal 13.00 NNUE
Still waiting for you to confirm this is actually NNUE and not the github version.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )