Stockfish 7 vs Komodo 9.3

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

beram wrote:
beram wrote:
beram wrote:Latest SFdev 130116 vs Komodo (contempt=0) +8-2=40
highest drawpercentage ever with same testbook
just 2 losses for SF in 50 games at intermediate TC avg Rapid 15m+10s game lenght 50 minutes

Code: Select all

SF 130116 - Komodo 9.3(ct=0) Rapid 15m+10s   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 130116 64 BMI2   +42  +8/=40/-2 56.00%   28.0/50
2   Komodo 9.3 64-bit          -42  +2/=40/-8 44.00%   22.0/50
SF 290116 with 59% against Komodo 9.3 (with contempt=0)
Highest score sofar in my testing with same book at intermediate time
control avg 50 min game.
At Blitz 3m2s score was 53,5% in 100 games

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m 10s     i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                               
1   Stockfish 290116 64 BMI2   +63  +14/=31/-5 59.00%   29.5/50
2   Komodo 9.3 64-bit          -63  +5/=31/-14 41.00%   20.5/50

Code: Select all

SF 290116 - Komodo 9.3(ct=0) Blitz 3m+2   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 290116 64 BMI2   +24  +18/=71/-11 53.50%   53.5/100
2   Komodo 9.3 64-bit          -24  +11/=71/-18 46.50%   46.5/100
The second run with 50 games same testbook resulted in smaller 52% win for SF
So conclusive over 100games at 15m10s SF290116 scores 55,5%
At the TC 3m2s SF scored 53,5 %
Komodo doesn't profit from the longer time control

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m  10s                                    
1   Stockfish 290116 64 BMI2   +38  +21/=69/-10 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +10/=69/-21 44.50%   44.5/100
SF 070216 55,5 %

Code: Select all

SF  070216 – Komodo 9.3 (ct=0) Blitz 3m+2s    i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                                                               
1   Stockfish 070216 64 BMI2   +38  +23/=65/-12 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +12/=65/-23 44.50%   44.5/100
Hai
Posts: 693
Joined: Sun Aug 04, 2013 1:19 pm

Re: Stockfish 7 vs Komodo 9.3

Post by Hai »

beram wrote:
JJJ wrote:Try longer time control.
:P :P that doesnt help

http://www.husvankempen.de/nunn/40120ne ... ion/1.html
Your increment is a joke. Take at least 30 seconds.
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

beram wrote:
beram wrote:
beram wrote:
beram wrote:Latest SFdev 130116 vs Komodo (contempt=0) +8-2=40
highest drawpercentage ever with same testbook
just 2 losses for SF in 50 games at intermediate TC avg Rapid 15m+10s game lenght 50 minutes

Code: Select all

SF 130116 - Komodo 9.3(ct=0) Rapid 15m+10s   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 130116 64 BMI2   +42  +8/=40/-2 56.00%   28.0/50
2   Komodo 9.3 64-bit          -42  +2/=40/-8 44.00%   22.0/50
SF 290116 with 59% against Komodo 9.3 (with contempt=0)
Highest score sofar in my testing with same book at intermediate time
control avg 50 min game.
At Blitz 3m2s score was 53,5% in 100 games

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m 10s     i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                               
1   Stockfish 290116 64 BMI2   +63  +14/=31/-5 59.00%   29.5/50
2   Komodo 9.3 64-bit          -63  +5/=31/-14 41.00%   20.5/50

Code: Select all

SF 290116 - Komodo 9.3(ct=0) Blitz 3m+2   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 290116 64 BMI2   +24  +18/=71/-11 53.50%   53.5/100
2   Komodo 9.3 64-bit          -24  +11/=71/-18 46.50%   46.5/100
The second run with 50 games same testbook resulted in smaller 52% win for SF
So conclusive over 100games at 15m10s SF290116 scores 55,5%
At the TC 3m2s SF scored 53,5 %
Komodo doesn't profit from the longer time control

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m  10s                                    
1   Stockfish 290116 64 BMI2   +38  +21/=69/-10 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +10/=69/-21 44.50%   44.5/100
SF 070216 55,5 %

Code: Select all

SF  070216 – Komodo 9.3 (ct=0) Blitz 3m+2s    i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                                                               
1   Stockfish 070216 64 BMI2   +38  +23/=65/-12 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +12/=65/-23 44.50%   44.5/100

SF 220216 57,5%

Code: Select all

SF 220216 - Komodo 9.3(ct=0), Blitz 3m+2s
                                    
1   Stockfish 210216 64 BMI2   +53  +28/=59/-13 57.50%   57.5/100
2   Komodo 9.3 64-bit          -53  +13/=59/-28 42.50%   42.5/100
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Stockfish 7 vs Komodo 9.3

Post by JJJ »

I think the next Komodo will be out soon.
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

beram wrote:
beram wrote:
beram wrote:Latest SFdev 130116 vs Komodo (contempt=0) +8-2=40
highest drawpercentage ever with same testbook
just 2 losses for SF in 50 games at intermediate TC avg Rapid 15m+10s game lenght 50 minutes

Code: Select all

SF 130116 - Komodo 9.3(ct=0) Rapid 15m+10s   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 130116 64 BMI2   +42  +8/=40/-2 56.00%   28.0/50
2   Komodo 9.3 64-bit          -42  +2/=40/-8 44.00%   22.0/50
SF 290116 with 59% against Komodo 9.3 (with contempt=0)
Highest score sofar in my testing with same book at intermediate time
control avg 50 min game.
At Blitz 3m2s score was 53,5% in 100 games

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m 10s     i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                               
1   Stockfish 290116 64 BMI2   +63  +14/=31/-5 59.00%   29.5/50
2   Komodo 9.3 64-bit          -63  +5/=31/-14 41.00%   20.5/50

Code: Select all

SF 290116 - Komodo 9.3(ct=0) Blitz 3m+2   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 290116 64 BMI2   +24  +18/=71/-11 53.50%   53.5/100
2   Komodo 9.3 64-bit          -24  +11/=71/-18 46.50%   46.5/100
The second run with 50 games same testbook resulted in smaller 52% win for SF
So conclusive over 100games at 15m10s SF290116 scores 55,5%
At the TC 3m2s SF scored 53,5 %
Komodo doesn't profit from longer time control

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m  10s                                    
1   Stockfish 290116 64 BMI2   +38  +21/=69/-10 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +10/=69/-21 44.50%   44.5/100
Another result of Komodo 9.3 vs SFdev070216 at very LTC
60 games at 40/120 on a 12CPU system, 56,67% for SF, presented here:
http://immortalchess.net/forum/showpost ... tcount=313
This just illustrates once more my case

Hardware: 2 x Intel Xeon x5690 / 3.46 GHz / 8GB RAM
OS: Ubuntu 15.10
TC 40/120
12 cores each, Ponder off, Hash 1024MB
TBs: 5 man Syzygy
Noomen Test Suite 2014 (30 openings)

Result: Komodo - 4 wins, Stockfish - 12 wins is 56,67% for Stockfish
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

beram wrote:
beram wrote:
beram wrote:
beram wrote:
beram wrote:Latest SFdev 130116 vs Komodo (contempt=0) +8-2=40
highest drawpercentage ever with same testbook
just 2 losses for SF in 50 games at intermediate TC avg Rapid 15m+10s game lenght 50 minutes

Code: Select all

SF 130116 - Komodo 9.3(ct=0) Rapid 15m+10s   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 130116 64 BMI2   +42  +8/=40/-2 56.00%   28.0/50
2   Komodo 9.3 64-bit          -42  +2/=40/-8 44.00%   22.0/50
SF 290116 with 59% against Komodo 9.3 (with contempt=0)
Highest score sofar in my testing with same book at intermediate time
control avg 50 min game.
At Blitz 3m2s score was 53,5% in 100 games

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m 10s     i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                               
1   Stockfish 290116 64 BMI2   +63  +14/=31/-5 59.00%   29.5/50
2   Komodo 9.3 64-bit          -63  +5/=31/-14 41.00%   20.5/50

Code: Select all

SF 290116 - Komodo 9.3(ct=0) Blitz 3m+2   i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)
1   Stockfish 290116 64 BMI2   +24  +18/=71/-11 53.50%   53.5/100
2   Komodo 9.3 64-bit          -24  +11/=71/-18 46.50%   46.5/100
The second run with 50 games same testbook resulted in smaller 52% win for SF
So conclusive over 100games at 15m10s SF290116 scores 55,5%
At the TC 3m2s SF scored 53,5 %
Komodo doesn't profit from the longer time control

Code: Select all

SF 290116 - Komodo 9.3(ct=0), Rapid 15m  10s                                    
1   Stockfish 290116 64 BMI2   +38  +21/=69/-10 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +10/=69/-21 44.50%   44.5/100
SF 070216 55,5 %

Code: Select all

SF  070216 – Komodo 9.3 (ct=0) Blitz 3m+2s    i5 4200M @2500Mhz, 2 cpu (Fritzmark 5,1)                                                               
1   Stockfish 070216 64 BMI2   +38  +23/=65/-12 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +12/=65/-23 44.50%   44.5/100

SF 220216 57,5%

Code: Select all

SF 220216 - Komodo 9.3(ct=0), Blitz 3m+2s
                                    
1   Stockfish 210216 64 BMI2   +53  +28/=59/-13 57.50%   57.5/100
2   Komodo 9.3 64-bit          -53  +13/=59/-28 42.50%   42.5/100
Latest somewhat lesser results for SF dev 280216 and 020316 against Komodo 9.3(ct=0)

Code: Select all

SF 280216 - Komodo 9.3(ct=0), Blitz 3m+2s                                    
1   Stockfish 280216 64 BMI2   +28  +19/=70/-11 54.00%   54.0/100
2   Komodo 9.3 64-bit          -28  +11/=70/-19 46.00%   46.0/100

SF 020316 - Komodo 9.3(ct=0), Blitz 3m+ 2s                                    
1   Stockfish 020316 64 BMI2   +10  +22/=59/-19 51.50%   51.5/100
2   Komodo 9.3 64-bit          -10  +19/=59/-22 48.50%   48.5/100
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

A second 100games run for SF0203 (first version of that day) 55,5% this time.
Making it a total of 53,5% over 200games

Code: Select all

SF 020316 - Komodo 9.3(ct=0), Blitz 3m+2s
                                    
1   Stockfish 020316 64 BMI2   +38  +22/=67/-11 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +11/=67/-22 44.50%   44.5/100
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

Last SF dev 020316(yellow) gets 58% against Komodo9.3(ct=0) on my AMD 1090T 4 cores TC 15m10s
The best for a SF dev against Komodo 9.3 sofar

Code: Select all

SF 020316 - Komodo 9.3(ct=0), Rapid 15m10s
                               
1   Stockfish 020316 64   +56  +23/=70/-7 58.00%   58.0/100
2   Komodo 9.3 64-bit     -56  +7/=70/-23 42.00%   42.0/100
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Stockfish 7 vs Komodo 9.3

Post by JJJ »

You could make a graph with all your result :)
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Stockfish 7 vs Komodo 9.3

Post by beram »

beram wrote:A second 100games run for SF0203 (first version of that day) 55,5% this time.
Making it a total of 53,5% over 200games

Code: Select all

SF 020316 - Komodo 9.3(ct=0), Blitz 3m+2s
                                    
1   Stockfish 020316 64 BMI2   +38  +22/=67/-11 55.50%   55.5/100
2   Komodo 9.3 64-bit          -38  +11/=67/-22 44.50%   44.5/100
SF100316 gets 57%, 100games, 3m2s

Code: Select all

SF 100316 - Komodo 9.3(ct=0), Blitz 3m+2s
                                    
1   Stockfish 100316 64 BMI2   +49  +28/=58/-14 57.00%   57.0/100
2   Komodo 9.3 64-bit          -49  +14/=58/-28 43.00%   43.0/100