Another fishy comparison

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Another fishy comparison

Post by IWB »

I tried the S8 version of ASM fish (4th of November) to see how much beef there really is.
At first I have to say that it is running rock stable with PONDER ON in a "networked" tourney! Not a single crash or time loss, not many enignes can do this that good!

This is the results:

Original modern SF8 compile:

Code: Select all

   # PLAYER             : RATING  ERROR     (%)    D(%)  OppAvg   CFS(next)    POINTS       W       D       L  PLAYED
   1 Stockfish 8        :   3294     10   79.6%    37.5    3036      96        2626.5    2008    1237      55    3300
   2 Houdini 5.01       :   3282     10   78.4%    36.2    3037     100        2587.0    1989    1196     115    3300
   3 Komodo 10.2        :   3257      9   75.9%    35.8    3038     100        2503.5    1912    1183     205    3300
   4 Shredder 13        :   3123      8   60.0%    49.8    3047     100        1981.5    1159    1645     496    3300
   5 Gull 3             :   3065      8   52.4%    47.7    3051     100        1729.0     942    1574     784    3300
   6 Ginkgo 1.9u        :   3041      8   49.2%    50.1    3053      97        1622.0     796    1652     852    3300
   7 Jonny 8.00         :   3030      8   47.6%    45.6    3053     100        1571.5     819    1505     976    3300
   8 Equinox 3.30       :   3008      8   44.6%    49.1    3055      97        1472.5     662    1621    1017    3300
   9 Fizbo 1.8          :   2997      8   43.1%    40.5    3056      67        1421.0     752    1338    1210    3300
  10 Fritz 15           :   2994      8   42.7%    47.7    3056      56        1408.5     622    1573    1105    3300
  11 Critter 1.6a       :   2993      8   42.6%    47.4    3056     100        1404.5     622    1565    1113    3300
  12 Andscacs 0.88      :   2966      8   39.0%    44.2    3058      63        1287.0     557    1460    1283    3300
  13 Hannibal 1.7       :   2964      8   38.7%    45.6    3058     100        1278.0     525    1506    1269    3300
  14 Booot 6.1          :   2946      8   36.3%    46.0    3059      85        1198.5     440    1517    1343    3300
  15 Chiron 3.01        :   2940      8   35.5%    43.6    3059      90        1171.5     452    1439    1409    3300
  16 Protector 1.9.0    :   2932      8   34.5%    43.8    3060     ---        1137.5     415    1445    1440    3300
asmFishW_2016-11-04_popcnt:

Code: Select all

   # PLAYER             : RATING  ERROR     (%)    D(%)  OppAvg   CFS(next)    POINTS       W       D       L  PLAYED
   1 asm_11-04_SYZ      :   3314     10   81.3%    34.6    3035     100        2682.5    2112    1141      47    3300
   2 Houdini 5.01       :   3284     10   78.4%    36.2    3037     100        2588.0    1991    1194     115    3300
   3 Komodo 10.2        :   3256      9   75.7%    35.4    3039     100        2497.0    1913    1168     219    3300
   4 Shredder 13        :   3122      8   59.8%    49.6    3048     100        1974.5    1156    1637     507    3300
   5 Gull 3             :   3064      8   52.2%    47.5    3052     100        1723.5     940    1567     793    3300
   6 Ginkgo 1.9u        :   3041      8   49.0%    49.8    3054      98        1618.0     797    1642     861    3300
   7 Jonny 8.00         :   3029      8   47.4%    45.4    3054     100        1564.5     816    1497     987    3300
   8 Equinox 3.30       :   3008      8   44.5%    49.2    3056      96        1470.0     659    1622    1019    3300
   9 Fizbo 1.8          :   2998      8   43.2%    40.7    3057      72        1424.0     753    1342    1205    3300
  10 Fritz 15           :   2994      8   42.7%    47.8    3057      57        1408.5     619    1579    1102    3300
  11 Critter 1.6a       :   2993      8   42.5%    47.4    3057     100        1403.5     622    1563    1115    3300
  12 Andscacs 0.88      :   2965      8   38.8%    43.9    3059      60        1282.0     557    1450    1293    3300
  13 Hannibal 1.7       :   2964      8   38.6%    45.4    3059     100        1275.0     526    1498    1276    3300
  14 Booot 6.1          :   2945      8   36.2%    45.7    3060      84        1194.5     441    1507    1352    3300
  15 Chiron 3.01        :   2939      9   35.4%    43.5    3060      95        1168.5     451    1435    1414    3300
  16 Protector 1.9.0    :   2929      8   34.1%    43.1    3061     ---        1126.0     415    1422    1463    3300
That is a gain of 20 Elo over the original (only +15 with Bayeselo)

For a while I was tempted to include it in my list, but then I realized that there are faster compiles than the original SF8 as well, which means that the difference is smaller in reality. Then I realized that that this is basicaly "just" another "compile" of the same thing without any chess related improvement - and then I decided to stick to my principle of orginality because this is not getting better without the original!

Nonetheless I post if for reference, maybe someone is interested. For exact conditions have a look at the IPON.

Ingo
Top
User avatar
lantonov
Posts: 216
Joined: Sun Apr 13, 2014 5:19 pm

Re: Another fishy comparison

Post by lantonov »

You can try also the yesterday's version of asmFish (2016-12-22)
https://github.com/lantonov/asmFish
Top
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: Another fishy comparison

Post by IWB »

lantonov wrote:You can try also the yesterday's version of asmFish (2016-12-22)
https://github.com/lantonov/asmFish
Yes, and then the version in a week and in two weeks ... ahh and of course the daily SF compiles.
It will always be approx. 20 Elo before the corrosponding SF, why bother.

Ingo
Top
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: Another fishy comparison

Post by IWB »

Ups, sorry.

This was ment to go to the "Tournament and matches" section! I was distracted somehow, please move it!

Thx
Ingo
Top
Lyudmil Tsvetkov
Posts: 6052
Joined: Tue Jun 12, 2012 12:41 pm

Re: Another fishy comparison

Post by Lyudmil Tsvetkov »

IWB wrote:I tried the S8 version of ASM fish (4th of November) to see how much beef there really is.
At first I have to say that it is running rock stable with PONDER ON in a "networked" tourney! Not a single crash or time loss, not many enignes can do this that good!

This is the results:

Original modern SF8 compile:

Code: Select all

   # PLAYER             : RATING  ERROR     (%)    D(%)  OppAvg   CFS(next)    POINTS       W       D       L  PLAYED
   1 Stockfish 8        :   3294     10   79.6%    37.5    3036      96        2626.5    2008    1237      55    3300
   2 Houdini 5.01       :   3282     10   78.4%    36.2    3037     100        2587.0    1989    1196     115    3300
   3 Komodo 10.2        :   3257      9   75.9%    35.8    3038     100        2503.5    1912    1183     205    3300
   4 Shredder 13        :   3123      8   60.0%    49.8    3047     100        1981.5    1159    1645     496    3300
   5 Gull 3             :   3065      8   52.4%    47.7    3051     100        1729.0     942    1574     784    3300
   6 Ginkgo 1.9u        :   3041      8   49.2%    50.1    3053      97        1622.0     796    1652     852    3300
   7 Jonny 8.00         :   3030      8   47.6%    45.6    3053     100        1571.5     819    1505     976    3300
   8 Equinox 3.30       :   3008      8   44.6%    49.1    3055      97        1472.5     662    1621    1017    3300
   9 Fizbo 1.8          :   2997      8   43.1%    40.5    3056      67        1421.0     752    1338    1210    3300
  10 Fritz 15           :   2994      8   42.7%    47.7    3056      56        1408.5     622    1573    1105    3300
  11 Critter 1.6a       :   2993      8   42.6%    47.4    3056     100        1404.5     622    1565    1113    3300
  12 Andscacs 0.88      :   2966      8   39.0%    44.2    3058      63        1287.0     557    1460    1283    3300
  13 Hannibal 1.7       :   2964      8   38.7%    45.6    3058     100        1278.0     525    1506    1269    3300
  14 Booot 6.1          :   2946      8   36.3%    46.0    3059      85        1198.5     440    1517    1343    3300
  15 Chiron 3.01        :   2940      8   35.5%    43.6    3059      90        1171.5     452    1439    1409    3300
  16 Protector 1.9.0    :   2932      8   34.5%    43.8    3060     ---        1137.5     415    1445    1440    3300
asmFishW_2016-11-04_popcnt:

Code: Select all

   # PLAYER             : RATING  ERROR     (%)    D(%)  OppAvg   CFS(next)    POINTS       W       D       L  PLAYED
   1 asm_11-04_SYZ      :   3314     10   81.3%    34.6    3035     100        2682.5    2112    1141      47    3300
   2 Houdini 5.01       :   3284     10   78.4%    36.2    3037     100        2588.0    1991    1194     115    3300
   3 Komodo 10.2        :   3256      9   75.7%    35.4    3039     100        2497.0    1913    1168     219    3300
   4 Shredder 13        :   3122      8   59.8%    49.6    3048     100        1974.5    1156    1637     507    3300
   5 Gull 3             :   3064      8   52.2%    47.5    3052     100        1723.5     940    1567     793    3300
   6 Ginkgo 1.9u        :   3041      8   49.0%    49.8    3054      98        1618.0     797    1642     861    3300
   7 Jonny 8.00         :   3029      8   47.4%    45.4    3054     100        1564.5     816    1497     987    3300
   8 Equinox 3.30       :   3008      8   44.5%    49.2    3056      96        1470.0     659    1622    1019    3300
   9 Fizbo 1.8          :   2998      8   43.2%    40.7    3057      72        1424.0     753    1342    1205    3300
  10 Fritz 15           :   2994      8   42.7%    47.8    3057      57        1408.5     619    1579    1102    3300
  11 Critter 1.6a       :   2993      8   42.5%    47.4    3057     100        1403.5     622    1563    1115    3300
  12 Andscacs 0.88      :   2965      8   38.8%    43.9    3059      60        1282.0     557    1450    1293    3300
  13 Hannibal 1.7       :   2964      8   38.6%    45.4    3059     100        1275.0     526    1498    1276    3300
  14 Booot 6.1          :   2945      8   36.2%    45.7    3060      84        1194.5     441    1507    1352    3300
  15 Chiron 3.01        :   2939      9   35.4%    43.5    3060      95        1168.5     451    1435    1414    3300
  16 Protector 1.9.0    :   2929      8   34.1%    43.1    3061     ---        1126.0     415    1422    1463    3300
That is a gain of 20 Elo over the original (only +15 with Bayeselo)

For a while I was tempted to include it in my list, but then I realized that there are faster compiles than the original SF8 as well, which means that the difference is smaller in reality. Then I realized that that this is basicaly "just" another "compile" of the same thing without any chess related improvement - and then I decided to stick to my principle of orginality because this is not getting better without the original!

Nonetheless I post if for reference, maybe someone is interested. For exact conditions have a look at the IPON.

Ingo
man, you almost got astray.

stick at least to the beautiful name Marco gave SF.
Top

Return to “Computer Chess Club: General Topics”