Torch V1 - Chess324 Testing Results

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2699
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Torch V1 - Chess324 Testing Results

Post by pohl4711 »

Modern Times wrote: Sat Oct 14, 2023 8:42 pm https://ccrl.chessdom.com/ccrl/Chess324/index.html

Just to recap, this is a Top 15 revolving round-robin tournament using SPCC's Anti-Draw Chess324 opening book - SPCC 3-move Chess324_xxl_big_+090_+119. The book contains 70355 lines. Each pairing plays 100 openings reversed sides, so 200 games per pairing. Thanks to Stefan for his excellent work in creating these Chess324 books.
My pleasure. Always good to see some of my openings out of my AntiDraw-openings in use. And this RoundRobin-tournament (-ratinglist) is really great. Awesome!
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: Torch V1 - Chess324 Testing Results

Post by Chessqueen »

CornfedForever wrote: Sun Oct 15, 2023 3:42 am
Chessqueen wrote: Sun Oct 15, 2023 3:18 am
Modern Times wrote: Sat Oct 14, 2023 10:23 pm If you prefer Ordo, using CS Tal 2.00 Elo 3620 as the point of equivalence in both:

Code: Select all

# PLAYER                  :  RATING  POINTS  PLAYED   (%)
   1 Stockfish 20230813      :  3824.2  2096.0    2800    75
   2 Torch v1                :  3791.3  1987.5    2800    71
   3 Dragon by Komodo 3.3    :  3759.7  1876.0    2800    67
   4 Berserk 11.1            :  3684.4  1588.0    2800    57
   5 Ethereal 14.00 FRC      :  3662.5  1500.5    2800    54
   6 RubiChess 20230918      :  3633.0  1381.5    2800    49
   7 Caissa 1.13.1           :  3623.1  1341.5    2800    48
   8 CS Tal 2.00 Elo         :  3620.0  1329.0    2800    47
   9 Clover 6.0              :  3609.1  1285.0    2800    46
  10 Koivisto 9.0            :  3593.4  1222.0    2800    44
  11 Rebel EAS               :  3570.7  1132.0    2800    40
  12 rofChade 3.1            :  3569.9  1128.5    2800    40
  13 Igel 3.5.0              :  3551.1  1055.5    2800    38
  14 Revenge 3.0             :  3550.1  1051.5    2800    38
  15 Viridithas 11.0.0       :  3543.3  1025.5    2800    37
So, Torch is rated between Stockfish and Dragon 3.3 ? And how long it will be before it is stronger than Stockfish ?
I suggest you need to go to a carnival and consult a soothsayer.
I visited a soothsayer 30 minutes after you recommended me to, and he asked me if I knew you and I responded why, and he told me that you were visiting 5 minutes before I arrived, and he told me that he gave you the possible numbers for the lottery winning ticket :roll:
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: Torch V1 - Chess324 Testing Results

Post by Chessqueen »

CornfedForever wrote: Sun Oct 15, 2023 3:42 am
Chessqueen wrote: Sun Oct 15, 2023 3:18 am
Modern Times wrote: Sat Oct 14, 2023 10:23 pm If you prefer Ordo, using CS Tal 2.00 Elo 3620 as the point of equivalence in both:

Code: Select all

# PLAYER                  :  RATING  POINTS  PLAYED   (%)
   1 Stockfish 20230813      :  3824.2  2096.0    2800    75
   2 Torch v1                :  3791.3  1987.5    2800    71
   3 Dragon by Komodo 3.3    :  3759.7  1876.0    2800    67
   4 Berserk 11.1            :  3684.4  1588.0    2800    57
   5 Ethereal 14.00 FRC      :  3662.5  1500.5    2800    54
   6 RubiChess 20230918      :  3633.0  1381.5    2800    49
   7 Caissa 1.13.1           :  3623.1  1341.5    2800    48
   8 CS Tal 2.00 Elo         :  3620.0  1329.0    2800    47
   9 Clover 6.0              :  3609.1  1285.0    2800    46
  10 Koivisto 9.0            :  3593.4  1222.0    2800    44
  11 Rebel EAS               :  3570.7  1132.0    2800    40
  12 rofChade 3.1            :  3569.9  1128.5    2800    40
  13 Igel 3.5.0              :  3551.1  1055.5    2800    38
  14 Revenge 3.0             :  3550.1  1051.5    2800    38
  15 Viridithas 11.0.0       :  3543.3  1025.5    2800    37
So, Torch is rated between Stockfish and Dragon 3.3 ? And how long it will be before it is stronger than Stockfish ?
I suggest you need to go to a carnival and consult a soothsayer.
Dragon 3.3 is still slightly better than Torch ===> https://ccrl.chessdom.com/ccrl/404/
Modern Times
Posts: 3699
Joined: Thu Jun 07, 2012 11:02 pm

Re: Torch V1 - Chess324 Testing Results

Post by Modern Times »

Chessqueen wrote: Mon Oct 16, 2023 4:23 am Dragon 3.3 is still slightly better than Torch ===> https://ccrl.chessdom.com/ccrl/404/
How do you figure that ? Torch is +28 Elo stronger than Dragon 3.3. Likelihood of superiority = 100%

https://ccrl.chessdom.com/ccrl/404/cgi/ ... librate=no
User avatar
pohl4711
Posts: 2699
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Torch V1 - Chess324 Testing Results

Post by pohl4711 »

Modern Times wrote: Sat Oct 14, 2023 8:42 pm https://ccrl.chessdom.com/ccrl/Chess324/index.html

Just to recap, this is a Top 15 revolving round-robin tournament using SPCC's Anti-Draw Chess324 opening book - SPCC 3-move Chess324_xxl_big_+090_+119. The book contains 70355 lines. Each pairing plays 100 openings reversed sides, so 200 games per pairing. Thanks to Stefan for his excellent work in creating these Chess324 books.
I downloaded the played games and started my EAS-Tool (Engines Aggressiveness Statistics Tool). Here the result:

Code: Select all

                                 bad  avg.win 
Rank  EAS-Score  sacs   shorts  draws  moves  Engine/player 
-------------------------------------------------------------------
   1    171153  24.44%  17.73%  11.40%   68   Stockfish 20230813  
   2    120869  18.41%  17.03%  15.16%   67   Torch v1  
   3    113403  20.91%  09.39%  16.54%   75   Igel 3.5.0  
   4    103289  17.68%  13.90%  16.04%   69   Dragon by Komodo 3.3  
   5     92083  20.97%  08.89%  16.23%   73   RubiChess 20230918  
   6     91753  12.79%  09.51%  17.88%   75   Revenge 3.0  
   7     79221  21.12%  07.38%  18.94%   82   Rebel EAS  
   8     79016  15.18%  06.38%  17.66%   78   Ethereal 14.00 FRC  
   9     78806  14.55%  08.58%  19.04%   76   CS Tal 2.00 Elo  
  10     60213  10.98%  07.39%  21.43%   75   Clover 6.0  
  11     59051  11.88%  06.60%  20.35%   76   Viridithas 11.0.0  
  12     57902  14.43%  07.33%  21.96%   78   rofChade 3.1  
  13     48195  10.48%  05.24%  22.35%   80   Koivisto 9.0  
  14     44760  09.19%  06.93%  23.17%   78   Berserk 11.1  
  15     42936  09.77%  05.58%  24.85%   81   Caissa 1.13.1  
-------------------------------------------------------------------
*** Average length of all won games:     74 moves
Modern Times
Posts: 3699
Joined: Thu Jun 07, 2012 11:02 pm

Re: Torch V1 - Chess324 Testing Results

Post by Modern Times »

pohl4711 wrote: Mon Oct 16, 2023 8:52 am
I downloaded the played games and started my EAS-Tool (Engines Aggressiveness Statistics Tool). Here the result:
Very interesting - Torch number 2 both on Elo rating and EAS. Igel just ahead of Komodo Dragon 3.3 which is surprising. It will be interesting to see your results - they will be more robust given the larger number of games that you play.
Ciekce
Posts: 190
Joined: Sun Oct 30, 2022 5:26 pm
Full name: Conor Anstey

Re: Torch V1 - Chess324 Testing Results

Post by Ciekce »

Modern Times wrote: Mon Oct 16, 2023 7:09 am
Chessqueen wrote: Mon Oct 16, 2023 4:23 am Dragon 3.3 is still slightly better than Torch ===> https://ccrl.chessdom.com/ccrl/404/
How do you figure that ? Torch is +28 Elo stronger than Dragon 3.3. Likelihood of superiority = 100%

https://ccrl.chessdom.com/ccrl/404/cgi/ ... librate=no
They're looking at the 8CPU Dragon result vs the singlethread Torch result.
User avatar
pohl4711
Posts: 2699
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Torch V1 - Chess324 Testing Results

Post by pohl4711 »

Modern Times wrote: Mon Oct 16, 2023 9:02 am
pohl4711 wrote: Mon Oct 16, 2023 8:52 am
I downloaded the played games and started my EAS-Tool (Engines Aggressiveness Statistics Tool). Here the result:
Very interesting - Torch number 2 both on Elo rating and EAS. Igel just ahead of Komodo Dragon 3.3 which is surprising. It will be interesting to see your results - they will be more robust given the larger number of games that you play.
Yes, because of the exponential scoring system of my EAS-Tool, the number of games played by the engines should be as high as possible.