CEGT-40/4: actual tests

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

CEGT-40/4: actual tests

Post by Wolfgang »

Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

Re: CEGT-40/4: actual tests

Post by Wolfgang »

Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: CEGT-40/4: actual tests

Post by lkaufman »

Am I correct in saying that the processor used for the Dragon test was too old for the AVX2 version? If so that would explain why the elo gain, although quite large, is still way below the elo gain on normal Dragon (on machines with AVX2).
Komodo rules!
Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

Re: CEGT-40/4: actual tests

Post by Wolfgang »

No.
ALL (!) tests with Dragon were played with the AVX2 compile.

We now have:

Dragon MCTS Linux: ~3462 (600 games only so far)
Dragon MCTS Windows: 3371
14.1 MCTS: 3299

So the ELO gain from Dragon MCTS Linux to (buggy) Dragon MCTS Windows is +91 and +163 to 14.1 MCTS
Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

Re: CEGT-40/4: actual tests

Post by Wolfgang »

Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

Re: CEGT-40/4: actual tests

Post by Wolfgang »

Wolfgang wrote: Thu Apr 29, 2021 7:55 pm ...
Seer 2.0.0NN x64 1CPU: https://cegt.forumieren.com/t1491-testing-seer-2-0-0nn
...
Switched to v2.0.1 due to the TM bug, all games replayed :)
https://cegt.forumieren.com/t1491-testing-seer-2-0-1nn
Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
connor_mcmonigle
Posts: 530
Joined: Sun Sep 06, 2020 4:40 am
Full name: Connor McMonigle

Re: CEGT-40/4: actual tests

Post by connor_mcmonigle »

Wolfgang wrote: Sun May 02, 2021 2:26 am
Wolfgang wrote: Thu Apr 29, 2021 7:55 pm ...
Seer 2.0.0NN x64 1CPU: https://cegt.forumieren.com/t1491-testing-seer-2-0-0nn
...
Switched to v2.0.1 due to the TM bug, all games replayed :)
https://cegt.forumieren.com/t1491-testing-seer-2-0-1nn
Thanks for testing again and my apologies for creating a bugged release. I'll be curious to see how the TM fixes influence the your elo estimate. Your elo for v2.0.0 is consistent with my expectation which is surprising.
Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

Re: CEGT-40/4: actual tests

Post by Wolfgang »

Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: CEGT-40/4: actual tests

Post by lkaufman »

So far +9 and +104 over Dragon 1 Windows in standard and MCTS mode; my predictions were + 10 and +100, not too bad!
Komodo rules!
Wolfgang
Posts: 893
Joined: Sat May 13, 2006 1:08 am

Re: CEGT-40/4: actual tests

Post by Wolfgang »

New Tournament with 4 new engines/versions:
- Stash 30.0
- Mr.Bob 1.0.0
- Clover 2.2
- Cheng 4.41
https://cegt.forumieren.com/t1502-tournament#2917
Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com