Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
AlexChess
Posts: 664
Joined: Sat Feb 06, 2021 7:06 am
Full name: Alex Mora
Contact:

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess » Sun Jul 04, 2021 11:55 am

Hi!
Could you also test 12.75 official + perfectly compatible MikeB's nn-c4c306d60d95.nnue https://tests.stockfishchess.org/api/nn ... 60d95.nnue (Stockfish testing nets) . With it on my test the old version is incredibly strong! Since 13.00 github is 3 points weaker than 12.75 github, according to SPCC https://www.sp-cc.de/index.htm after 7000 games, it would be interesting to compare performances using NNUE on both versions.

Image

With nn-c4c306d60d95.nnue :
Image
Last edited by AlexChess on Sun Jul 04, 2021 12:22 pm, edited 6 times in total.
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
My engines SuperBlitz: https://bit.ly/3fIfp5H

AndrewGrant
Posts: 1392
Joined: Tue Apr 19, 2016 4:08 am
Location: U.S.A
Full name: Andrew Grant
Contact:

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant » Sun Jul 04, 2021 12:00 pm

AlexChess wrote:
Sun Jul 04, 2021 11:55 am
Hi!
Could you also test 12.75 official + perfectly compatible MikeB's nn-c4c306d60d95.nnue https://tests.stockfishchess.org/api/nn ... 60d95.nnue (Stockfish testing nets) . With it on my test the old version is incredible strong! Since 13.00 github is 3 points weaker than 12.75 github, according to SPCC https://www.sp-cc.de/index.htm after 7000 games, it would be interesting to compare performances using NNUE on both versions.
No need to do this. Its already known that a Stockfish network will massively out perform what I have now.

User avatar
AlexChess
Posts: 664
Joined: Sat Feb 06, 2021 7:06 am
Full name: Alex Mora
Contact:

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess » Sun Jul 04, 2021 12:26 pm

AndrewGrant wrote:
Sun Jul 04, 2021 12:00 pm
AlexChess wrote:
Sun Jul 04, 2021 11:55 am
Hi!
Could you also test 12.75 official + perfectly compatible MikeB's nn-c4c306d60d95.nnue https://tests.stockfishchess.org/api/nn ... 60d95.nnue (Stockfish testing nets) . With it on my test the old version is incredible strong! Since 13.00 github is 3 points weaker than 12.75 github, according to SPCC https://www.sp-cc.de/index.htm after 7000 games, it would be interesting to compare performances using NNUE on both versions.
No need to do this. Its already known that a Stockfish network will massively out perform what I have now.
Not always. I'm testing 12.75 also with more recents 21 MB net and often they do not reach the same performance. Zeus.nnue is very close. I'll test also other free nets.
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
My engines SuperBlitz: https://bit.ly/3fIfp5H

User avatar
AlexChess
Posts: 664
Joined: Sat Feb 06, 2021 7:06 am
Full name: Alex Mora
Contact:

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess » Mon Jul 05, 2021 2:41 pm

Just started a 100 games match (3 mins + 3 secs 10 mN/s on Banksiagui 0.45 mac M1 4 CPUs) between Ethereal 12.75 NNUE nn-c4c306d60d95.nnue and Ethereal 13.00 standard github (ELO 2400 according to SPCC) to extrapolate if it is stronger than Ethereal 13.00 NNUE commercial (rated 2475 ELO on the same list)

Image

Regards, AlexChess
https://www.chess.com/forum/view/game-a ... e-fritz-17
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
My engines SuperBlitz: https://bit.ly/3fIfp5H

User avatar
CMCanavessi
Posts: 1078
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by CMCanavessi » Mon Jul 05, 2021 4:02 pm

Hey Andrew, been doing some FRC (30m+5s) testing and Ethereal 13.07 (non-bmi avx2, non NNUE) has been crashing. As always, ponder on, 4gb hash, this time I added 6-men syzygy and updated windows 10 with latest bells and whistles. You can check on my twitch, the testing is ongoing but I've already played chiron vs ethereal like 5 times and it crashed in all of them. Maybe something to do with the start position? Dunno...

Here's the last crash:

Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

AndrewGrant
Posts: 1392
Joined: Tue Apr 19, 2016 4:08 am
Location: U.S.A
Full name: Andrew Grant
Contact:

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant » Mon Jul 05, 2021 4:18 pm

CMCanavessi wrote:
Mon Jul 05, 2021 4:02 pm
Hey Andrew, been doing some FRC (30m+5s) testing and Ethereal 13.07 (non-bmi avx2, non NNUE) has been crashing. As always, ponder on, 4gb hash, this time I added 6-men syzygy and updated windows 10 with latest bells and whistles. You can check on my twitch, the testing is ongoing but I've already played chiron vs ethereal like 5 times and it crashed in all of them. Maybe something to do with the start position? Dunno...

Here's the last crash:

Hmm.. odd. Cannot look into it right now, but launching two tests to see if any crashes occur. Both NNUE and non-NNUE. Any chance you send me the UCI logs from one of these games?

http://chess.grantnet.us/test/12274/ & http://chess.grantnet.us/test/12275/ (Selfplay, just seeing if it ever crashes)

Also that PGN confuses me. The final move made is by black (Ethereal). How would that be an Ethereal crash? I would expect the crashing engine to not make a move? It would have to be crashing on the ponder command it recieves after? UCI logs would be needed. Have you seen crashes against an engine other than Chiron?

User avatar
CMCanavessi
Posts: 1078
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by CMCanavessi » Mon Jul 05, 2021 4:32 pm

AndrewGrant wrote:
Mon Jul 05, 2021 4:18 pm
Hmm.. odd. Cannot look into it right now, but launching two tests to see if any crashes occur. Both NNUE and non-NNUE. Any chance you send me the UCI logs from one of these games?

http://chess.grantnet.us/test/12274/ & http://chess.grantnet.us/test/12275/ (Selfplay, just seeing if it ever crashes)

Also that PGN confuses me. The final move made is by black (Ethereal). How would that be an Ethereal crash? I would expect the crashing engine to not make a move? It would have to be crashing on the ponder command it recieves after? UCI logs would be needed. Have you seen crashes against an engine other than Chiron?
It just crashed again :D
Yes, last night I did a pre-test with shorter TC and it was also crashing (Minic 3.08 also). I don't have logs, but will try to get some. For now, I've replaced the avx2 for the plain avx binary, will report back if it crashes again. Ethereal vs Chiron again after current game.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

AndrewGrant
Posts: 1392
Joined: Tue Apr 19, 2016 4:08 am
Location: U.S.A
Full name: Andrew Grant
Contact:

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant » Mon Jul 05, 2021 4:33 pm

CMCanavessi wrote:
Mon Jul 05, 2021 4:32 pm
AndrewGrant wrote:
Mon Jul 05, 2021 4:18 pm
Hmm.. odd. Cannot look into it right now, but launching two tests to see if any crashes occur. Both NNUE and non-NNUE. Any chance you send me the UCI logs from one of these games?

http://chess.grantnet.us/test/12274/ & http://chess.grantnet.us/test/12275/ (Selfplay, just seeing if it ever crashes)

Also that PGN confuses me. The final move made is by black (Ethereal). How would that be an Ethereal crash? I would expect the crashing engine to not make a move? It would have to be crashing on the ponder command it recieves after? UCI logs would be needed. Have you seen crashes against an engine other than Chiron?
It just crashed again :D
Yes, last night I did a pre-test with shorter TC and it was also crashing (Minic 3.08 also). I don't have logs, but will try to get some. For now, I've replaced the avx2 for the plain avx binary, will report back if it crashes again. Ethereal vs Chiron again after current game.
Based on a quick few thousand games ... I can promise its a ponder issue. Why do I have pondering in this engine again? Time to rip it out smh.

User avatar
CMCanavessi
Posts: 1078
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by CMCanavessi » Mon Jul 05, 2021 5:33 pm

AndrewGrant wrote:
Mon Jul 05, 2021 4:33 pm
Based on a quick few thousand games ... I can promise its a ponder issue. Why do I have pondering in this engine again? Time to rip it out smh.
It's weird. I changed the avx2 binary to avx, and it still crashed. But now it's playing against Vajolet and so far it looks fine (vs Chiron it crashes almost instantly). Maybe it's opponent-dependant?
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

User avatar
CMCanavessi
Posts: 1078
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by CMCanavessi » Mon Jul 05, 2021 6:08 pm

Nope, crashed vs. vajolet2 too. Just took more time.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

Post Reply