TESTING KOMODO 10: 1920 GAMES
FIRST LEG: 960 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control 4+0
Komodo 10 64-bit_OK_X6_NOB - Stockfish 050516IP 64 POPCNT_ 29.5 - 30.5 +8/=43/-9 49.17%
Komodo 10 64-bit_OK_X6_NOB - SugaR 2.6 64 POPCNT_X6 24.5 - 35.5 +5/=39/-16 40.83%
Komodo 10 64-bit_OK_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 43.0 - 17.0 +30/=26/-4 71.67%
Komodo 10 64-bit_OK_X6_NOB - Gull 3 x64 XP_X6 44.0 - 16.0 +30/=28/-2 73.33%
Time Control 2+2
Komodo 10 64-bit_OK_X6_NOB - Stockfish 050516IP 64 POPCNT_ 26.0 - 34.0 +3/=46/-11 43.33%
Komodo 10 64-bit_OK_X6_NOB - SugaR 2.6 64 POPCNT_X6 26.5 - 33.5 +9/=35/-16 44.17%
Komodo 10 64-bit_OK_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 37.5 - 22.5 +21/=33/-6 62.50%
Komodo 10 64-bit_OK_X6_NOB - Gull 3 x64 XP_X6 45.5 - 14.5 +34/=23/-3 75.83%
Score after 480 Games using 6 cores= 276.5 – 203.5= 57.60%
480 Games= http://www.mediafire.com/download/820a9oyjap26dym
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10 64-bit_OK_NOB_X8 - Stockfish 050516IP 64 bmi2_8 27.5 - 32.5 +6/=43/-11 45.83%
Komodo 10 64-bit_OK_NOB_X8 - SugaR 2.6 64 BMI2_X8 27.5 - 32.5 +6/=43/-11 45.83%
Komodo 10 64-bit_OK_NOB_X8 - Houdini 4 Pro x64_Ct0_8 41.5 - 18.5 +25/=33/-2 69.17%
Komodo 10 64-bit_OK_NOB_X8 - Gull 3 x64 BMI2_X8 47.0 - 13.0 +34/=26/-0 78.33%
Incremental Time Control: 2+2
Komodo 10 64-bit_OK_NOB_X8 - Stockfish 050516IP 64 bmi2_8 27.0 - 33.0 +8/=38/-14 45.00%
Komodo 10 64-bit_OK_NOB_X8 - SugaR 2.6 64 BMI2_X8 31.0 - 29.0 +11/=40/-9 51.67%
Komodo 10 64-bit_OK_NOB_X8 - Houdini 4 Pro x64_Ct0_8 44.0 - 16.0 +30/=28/-2 73.33%
Komodo 10 64-bit_OK_NOB_X8 - Gull 3 x64 BMI2_X8 43.5 - 16.5 +30/=27/-3 72.50%
Score using 8 cores= 289.0 – 191.0= 60.21%
480 Games= http://www.mediafire.com/download/3d5nk99k8rmrt79
Global Score for Komodo 10 after 960 Games= 565.5- 394.5= 58.91%
Stockfish Ipman 050516 = 3.305
Sugar 2.6 = 3.291
Houdini 4.0 Pro= 3.136
Gull 3 XP= 3.103
AVERAGE = 3.209
Estimated ELO for Komodo 10 after 960 games= 3.271
The first half of this test shows an impromevent of 62 elo points for Komodo 10 over Komodo 9 and 10 elo points over Komodo 9.42 (3261).
Lets start the second leg.
Regards,
Tom.
TESTING KOMODO 10 - 1920 GAMES
Moderators: hgm, Rebel, chrisw
-
JJJ
- Posts: 1346
- Joined: Sat Apr 19, 2014 1:47 pm
Re: TESTING KOMODO 10 - 1920 GAMES
That's sound right to me and coherent with others test so far.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: TESTING KOMODO 10 - 1920 GAMES
TESTING KOMODO 10.2: 960 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 25.0 - 35.0 +3/=44/-13 41.67%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 25.0 - 35.0 +6/=38/-16 41.67%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.5 - 17.5 +27/=31/-2 70.83%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 46.0 - 14.0 +33/=26/-1 76.67%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 24.0 - 36.0 +4/=40/-16 40.00%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 29.5 - 30.5 +7/=45/-8 49.17%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.0 - 18.0 +26/=32/-2 70.00%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 45.5 - 14.5 +32/=27/-1 75.83%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 6 cores: 279.5 – 200.5 = 58.23%
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 22.5 - 37.5 +4/=37/-19 37.50%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 31.0 - 29.0 +10/=42/-8 51.67%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 47.0 - 13.0 +35/=24/-1 78.33%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 42.5 - 17.5 +29/=27/-4 70.83%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 24.5 - 35.5 +3/=43/-14 40.83%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 28.5 - 31.5 +5/=47/-8 47.50%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 44.5 - 15.5 +30/=29/-1 74.17%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 44.0 - 16.0 +31/=26/-3 73.33%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 8 cores: 284.5 – 195.5 = 59.27%
Global Score for Komodo 10.2 after 960 Games= 564.0 – 396.0 = 58.75%
Average score of Komodo 10.2 oponents= 3.216
Estimated ELO for Komodo 10.2 after 960 Games = 3.277
This is not a good score for Komodo 10.2. Only 6 elo point above Komodo 10 and almost exactly the same score than Komodo 10.1. I will keep testing this engine to reduce error bars.
Regards,
Tom.
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 25.0 - 35.0 +3/=44/-13 41.67%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 25.0 - 35.0 +6/=38/-16 41.67%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.5 - 17.5 +27/=31/-2 70.83%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 46.0 - 14.0 +33/=26/-1 76.67%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 24.0 - 36.0 +4/=40/-16 40.00%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 29.5 - 30.5 +7/=45/-8 49.17%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.0 - 18.0 +26/=32/-2 70.00%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 45.5 - 14.5 +32/=27/-1 75.83%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 6 cores: 279.5 – 200.5 = 58.23%
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 22.5 - 37.5 +4/=37/-19 37.50%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 31.0 - 29.0 +10/=42/-8 51.67%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 47.0 - 13.0 +35/=24/-1 78.33%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 42.5 - 17.5 +29/=27/-4 70.83%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 24.5 - 35.5 +3/=43/-14 40.83%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 28.5 - 31.5 +5/=47/-8 47.50%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 44.5 - 15.5 +30/=29/-1 74.17%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 44.0 - 16.0 +31/=26/-3 73.33%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 8 cores: 284.5 – 195.5 = 59.27%
Global Score for Komodo 10.2 after 960 Games= 564.0 – 396.0 = 58.75%
Average score of Komodo 10.2 oponents= 3.216
Estimated ELO for Komodo 10.2 after 960 Games = 3.277
This is not a good score for Komodo 10.2. Only 6 elo point above Komodo 10 and almost exactly the same score than Komodo 10.1. I will keep testing this engine to reduce error bars.
Regards,
Tom.
-
egiovannotti
- Posts: 38
- Joined: Wed Oct 31, 2012 9:28 am
Re: TESTING KOMODO 10 - 1920 GAMES
Hi Tom. There is a recurring error in links, these include the ellipsis ("..."), example:Tomcass wrote:TESTING KOMODO 10.2: 960 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 25.0 - 35.0 +3/=44/-13 41.67%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 25.0 - 35.0 +6/=38/-16 41.67%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.5 - 17.5 +27/=31/-2 70.83%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 46.0 - 14.0 +33/=26/-1 76.67%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 24.0 - 36.0 +4/=40/-16 40.00%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 29.5 - 30.5 +7/=45/-8 49.17%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.0 - 18.0 +26/=32/-2 70.00%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 45.5 - 14.5 +32/=27/-1 75.83%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 6 cores: 279.5 – 200.5 = 58.23%
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 22.5 - 37.5 +4/=37/-19 37.50%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 31.0 - 29.0 +10/=42/-8 51.67%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 47.0 - 13.0 +35/=24/-1 78.33%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 42.5 - 17.5 +29/=27/-4 70.83%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 24.5 - 35.5 +3/=43/-14 40.83%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 28.5 - 31.5 +5/=47/-8 47.50%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 44.5 - 15.5 +30/=29/-1 74.17%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 44.0 - 16.0 +31/=26/-3 73.33%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 8 cores: 284.5 – 195.5 = 59.27%
Global Score for Komodo 10.2 after 960 Games= 564.0 – 396.0 = 58.75%
Average score of Komodo 10.2 oponents= 3.216
Estimated ELO for Komodo 10.2 after 960 Games = 3.277
This is not a good score for Komodo 10.2. Only 6 elo point above Komodo 10 and almost exactly the same score than Komodo 10.1. I will keep testing this engine to reduce error bars.
Regards,
Tom.
http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Thank you!
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: TESTING KOMODO 10 - 1920 GAMES
Hi, Giovannotti!egiovannotti wrote:Hi Tom. There is a recurring error in links, these include the ellipsis ("..."), example:Tomcass wrote:TESTING KOMODO 10.2: 960 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 25.0 - 35.0 +3/=44/-13 41.67%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 25.0 - 35.0 +6/=38/-16 41.67%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.5 - 17.5 +27/=31/-2 70.83%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 46.0 - 14.0 +33/=26/-1 76.67%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X6_NOB - Stockfish 081016 64 POPCNT_6 24.0 - 36.0 +4/=40/-16 40.00%
Komodo 10.2 64-bit_X6_NOB - SugaR 2.6 64 POPCNT_X6 29.5 - 30.5 +7/=45/-8 49.17%
Komodo 10.2 64-bit_X6_NOB - Houdini 4 Pro x64_St_Ct0_X6 42.0 - 18.0 +26/=32/-2 70.00%
Komodo 10.2 64-bit_X6_NOB - Gull 3 x64 XP_X6 45.5 - 14.5 +32/=27/-1 75.83%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 6 cores: 279.5 – 200.5 = 58.23%
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 22.5 - 37.5 +4/=37/-19 37.50%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 31.0 - 29.0 +10/=42/-8 51.67%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 47.0 - 13.0 +35/=24/-1 78.33%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 42.5 - 17.5 +29/=27/-4 70.83%
Incremental Time Control 2+2
Komodo 10.2 64-bit_X8_NOB - Stockfish 081016 64 BMI2_8 24.5 - 35.5 +3/=43/-14 40.83%
Komodo 10.2 64-bit_X8_NOB - SugaR 2.6 64 BMI2_X8 28.5 - 31.5 +5/=47/-8 47.50%
Komodo 10.2 64-bit_X8_NOB - Houdini 4 Pro x64_Ct0_8 44.5 - 15.5 +30/=29/-1 74.17%
Komodo 10.2 64-bit_X8_NOB - Gull 3 x64 BMI2_X8 44.0 - 16.0 +31/=26/-3 73.33%
480 Games= http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Score using 8 cores: 284.5 – 195.5 = 59.27%
Global Score for Komodo 10.2 after 960 Games= 564.0 – 396.0 = 58.75%
Average score of Komodo 10.2 oponents= 3.216
Estimated ELO for Komodo 10.2 after 960 Games = 3.277
This is not a good score for Komodo 10.2. Only 6 elo point above Komodo 10 and almost exactly the same score than Komodo 10.1. I will keep testing this engine to reduce error bars.
Regards,
Tom.
http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
http://www.mediafire.com/file/e64t4m..._2_X8_480g.pgn
Thank you!
Thank you very much for pointing out my mistake. Here you have the right links:
Using 6 cores: 279.5 – 200.5 = 58.23%
http://www.mediafire.com/file/ik3jon8bwhgfott/
Using 8 cores 284.5 – 195.5 = 59,27%
http://www.mediafire.com/file/e64t4mdedvuum9p/
Regards,
Tom.
-
egiovannotti
- Posts: 38
- Joined: Wed Oct 31, 2012 9:28 am
Re: TESTING KOMODO 10 - 1920 GAMES
Thanks Tom!
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: TESTING KOMODO 10 - 1920 GAMES
TESTING KOMODO 10.3: 960 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 26.0 - 34.0 +3/=46/-11 43.33%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 28.0 - 32.0 +8/=40/-12 46.67%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 29.5 - 30.5 +8/=43/-9 49.17%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 44.5 - 15.5 +32/=25/-3 74.17%
Score using 6 cores (4+0)= 128.0 – 112.0 = 53.33%
Incremental Time Control 2+2
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 22.0 - 38.0 +2/=40/-18 36.67%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 27.5 - 32.5 +6/=43/-11 45.83%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 30.5 - 29.5 +12/=37/-11 50.83%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 44.0 - 16.0 +28/=32/-0 73.33%
Score using 6 cores (2+2)= 124.0 – 116.0 = 51.67%
480 Games = http://www.mediafire.com/file/v02ai2rvzgawp4w/
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 24.0 - 35.0 +5/=38/-16 40.68%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 27.5 - 32.5 +5/=45/-10 45.83%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 26.5 - 33.5 +7/=39/-14 44.17%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 42.0 - 19.0 +25/=34/-2 68.85%
Score using 8 cores (4+0) = 120.0 – 120.0 = 50%
Incremental Time Control= 2+2
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 29.5 - 30.5 +8/=43/-9 49.17%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 28.0 - 32.0 +7/=42/-11 46.67%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 32.5 - 27.5 +13/=39/-8 54.17%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 43.0 - 17.0 +27/=32/-1 71.67%
Score using 8 cores (2+2) = 133.0 – 107.0= 55.42%
480 Games= http://www.mediafire.com/file/xl894kcy1k8qqdg/
GLOBAL SCORE AFTER 960 GAMES = 505.0 – 455.0 = 52.60%
Against
Stockfish8 (3328) = 42.46%
Houdini 5 Pro (3319) = 46.25%
SugaR 2.6 (3291) = 49.59%
Deep Shredder 13 (3174) = 72.00%
Average ELO of rivals= 3278
Estimated ELO For Komodo 10.3 after 960 games= 3296
This is a great performance for Komodo 10.3. The best improvement I have found between two versions of Komodo so far: 19 Elo points over Komodo 10.2 and only 23 points below the extremely strong Houdini 5 Pro.
Let’s extend mi tests up to 2880 games to check if this substantial improvement is confirmed or not.
Regards from Barcelona.
Tom.
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 26.0 - 34.0 +3/=46/-11 43.33%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 28.0 - 32.0 +8/=40/-12 46.67%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 29.5 - 30.5 +8/=43/-9 49.17%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 44.5 - 15.5 +32/=25/-3 74.17%
Score using 6 cores (4+0)= 128.0 – 112.0 = 53.33%
Incremental Time Control 2+2
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 22.0 - 38.0 +2/=40/-18 36.67%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 27.5 - 32.5 +6/=43/-11 45.83%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 30.5 - 29.5 +12/=37/-11 50.83%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 44.0 - 16.0 +28/=32/-0 73.33%
Score using 6 cores (2+2)= 124.0 – 116.0 = 51.67%
480 Games = http://www.mediafire.com/file/v02ai2rvzgawp4w/
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 24.0 - 35.0 +5/=38/-16 40.68%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 27.5 - 32.5 +5/=45/-10 45.83%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 26.5 - 33.5 +7/=39/-14 44.17%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 42.0 - 19.0 +25/=34/-2 68.85%
Score using 8 cores (4+0) = 120.0 – 120.0 = 50%
Incremental Time Control= 2+2
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 29.5 - 30.5 +8/=43/-9 49.17%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 28.0 - 32.0 +7/=42/-11 46.67%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 32.5 - 27.5 +13/=39/-8 54.17%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 43.0 - 17.0 +27/=32/-1 71.67%
Score using 8 cores (2+2) = 133.0 – 107.0= 55.42%
480 Games= http://www.mediafire.com/file/xl894kcy1k8qqdg/
GLOBAL SCORE AFTER 960 GAMES = 505.0 – 455.0 = 52.60%
Against
Stockfish8 (3328) = 42.46%
Houdini 5 Pro (3319) = 46.25%
SugaR 2.6 (3291) = 49.59%
Deep Shredder 13 (3174) = 72.00%
Average ELO of rivals= 3278
Estimated ELO For Komodo 10.3 after 960 games= 3296
This is a great performance for Komodo 10.3. The best improvement I have found between two versions of Komodo so far: 19 Elo points over Komodo 10.2 and only 23 points below the extremely strong Houdini 5 Pro.
Let’s extend mi tests up to 2880 games to check if this substantial improvement is confirmed or not.
Regards from Barcelona.
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: TESTING KOMODO 10 - 1920 GAMES
TESTING KOMODO 10.3: 1920 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 54.5 - 65.5 +14/=81/-25 45.42%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 55.0 - 65.0 +15/=80/-25 45.83%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 63.5 - 56.5 +26/=75/-19 52.92%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 83.5 - 36.5 +53/=61/-6 69.58%
Score using 6 cores (4+0)= 256.5 – 223.5= 53.44%
480 Games= http://www.mediafire.com/file/fdk55s5rd5a6zzc/
Incremental Time Control 2+2
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 49.5 - 70.5 +10/=79/-31 41.25%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 55.0 - 65.0 +13/=84/-23 45.83%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 52.0 - 68.0 +10/=84/-26 43.33%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 80.0 - 40.0 +45/=70/-5 66.67%
Score using 6 cores (2+2)= 236.5 – 243.5= 49.27%
480 Games = http://www.mediafire.com/file/kwjbuus4ew1yxh4/
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 55.0 - 65.0 +13/=84/-23 45.83%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 60.5 - 59.5 +24/=73/-23 50.42%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 59.0 - 61.0 +18/=82/-20 49.17%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 83.0 - 37.0 +49/=68/-3 69.17%
Score using 8 cores (4+0)= 257.5 – 222.5= 53.65%
480 Games= http://www.mediafire.com/file/69sbd66ho3abihr/
Incremental Time Control 2+2
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 54.0 - 66.0 +10/=88/-22 45.00%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 57.0 - 63.0 +10/=94/-16 47.50%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 60.5 - 59.5 +18/=85/-17 50.42%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 85.0 - 35.0 +52/=66/-2 70.83%
Score using 8 cores (2+2)= 256.5 – 223.5 = 53.44%
480 Games = http://www.mediafire.com/file/c4rpah7mqo3my4k/
GLOBAL SCORE AFTER 1920 GAMES = 1007.0 – 913.0 = 52.45%
Average ELO of rivals= 3277
Estimated ELO For Komodo 10.3 after 1920= 3295
TOTAL SCORE AFTER 2 TESTS WITH 2880 GAMES= 1512 – 1368= 52.50%
Average ELO of rivals= 3277
Estimated ELO For Komodo 10.3 after 2880 GAMES= 3295
Against
Stockfish8 (3330) = 43.73%
Houdini 5 Pro (3318) = 47.01%
SugaR 2.6 (3291) = 49.17%
Deep Shredder 13 (3169) = 70.04%
My Short Rating List:
Stockfish 8= 3330
Houdini 5 Pro= 3318
Komodo 10.3 = 3295
Sugar2.6 = 3291
Komodo 10.2 = 3277
Komodo 10 = 3271
Stockfish 7 = 3.268
Komodo 9= 3209
Deep Shredder = 3.169
Houdini 4 Pro= 3136
Gull 3= 3103
Regards from Barcelona and a Happy New Year to all the TalkChess friends.
Tom.
6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Fixed Time Control 4+0
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 54.5 - 65.5 +14/=81/-25 45.42%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 55.0 - 65.0 +15/=80/-25 45.83%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 63.5 - 56.5 +26/=75/-19 52.92%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 83.5 - 36.5 +53/=61/-6 69.58%
Score using 6 cores (4+0)= 256.5 – 223.5= 53.44%
480 Games= http://www.mediafire.com/file/fdk55s5rd5a6zzc/
Incremental Time Control 2+2
Komodo 10.3 64-bit_X6_nob - Stockfish 8 64 POPCNT_X6 49.5 - 70.5 +10/=79/-31 41.25%
Komodo 10.3 64-bit_X6_nob - Houdini 5.01 Pro x64-popc_X6 55.0 - 65.0 +13/=84/-23 45.83%
Komodo 10.3 64-bit_X6_nob - SugaR 2.6 64 POPCNT_X6 52.0 - 68.0 +10/=84/-26 43.33%
Komodo 10.3 64-bit_X6_nob - Deep Shredder 13 x64_X6 80.0 - 40.0 +45/=70/-5 66.67%
Score using 6 cores (2+2)= 236.5 – 243.5= 49.27%
480 Games = http://www.mediafire.com/file/kwjbuus4ew1yxh4/
8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543
Fixed Time Control 4+0
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 55.0 - 65.0 +13/=84/-23 45.83%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 60.5 - 59.5 +24/=73/-23 50.42%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 59.0 - 61.0 +18/=82/-20 49.17%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 83.0 - 37.0 +49/=68/-3 69.17%
Score using 8 cores (4+0)= 257.5 – 222.5= 53.65%
480 Games= http://www.mediafire.com/file/69sbd66ho3abihr/
Incremental Time Control 2+2
Komodo 10.3 64-bit_X8_nob - Stockfish 8 64 BMI2_X8 54.0 - 66.0 +10/=88/-22 45.00%
Komodo 10.3 64-bit_X8_nob - Houdini 5 Pro x64-pext_X8 57.0 - 63.0 +10/=94/-16 47.50%
Komodo 10.3 64-bit_X8_nob - SugaR 2.6 64 BMI2_X8 60.5 - 59.5 +18/=85/-17 50.42%
Komodo 10.3 64-bit_X8_nob - Deep Shredder 13 x64_X8 85.0 - 35.0 +52/=66/-2 70.83%
Score using 8 cores (2+2)= 256.5 – 223.5 = 53.44%
480 Games = http://www.mediafire.com/file/c4rpah7mqo3my4k/
GLOBAL SCORE AFTER 1920 GAMES = 1007.0 – 913.0 = 52.45%
Average ELO of rivals= 3277
Estimated ELO For Komodo 10.3 after 1920= 3295
TOTAL SCORE AFTER 2 TESTS WITH 2880 GAMES= 1512 – 1368= 52.50%
Average ELO of rivals= 3277
Estimated ELO For Komodo 10.3 after 2880 GAMES= 3295
Against
Stockfish8 (3330) = 43.73%
Houdini 5 Pro (3318) = 47.01%
SugaR 2.6 (3291) = 49.17%
Deep Shredder 13 (3169) = 70.04%
My Short Rating List:
Stockfish 8= 3330
Houdini 5 Pro= 3318
Komodo 10.3 = 3295
Sugar2.6 = 3291
Komodo 10.2 = 3277
Komodo 10 = 3271
Stockfish 7 = 3.268
Komodo 9= 3209
Deep Shredder = 3.169
Houdini 4 Pro= 3136
Gull 3= 3103
Regards from Barcelona and a Happy New Year to all the TalkChess friends.
Tom.