School of Bullet Fish

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Gusev
Posts: 1476
Joined: Mon Jan 28, 2013 2:51 pm

School of Bullet Fish

Post by Gusev »

After the first half of the bullet 20"+1" tournament, 8 threads, hash=4096, Ponder=ON, with Move Overhead increased from 30 to 75 for all the fish and to 1 sec for Komodo 11.2,

Code: Select all

    Engine                                 Score  HoRaCfMcSuMcSyCoAsStNaBrEnGuSeBoAnFiFiIvKoSt    S-B
01: Houdini_5_Pro_pext_x64                 15.5/21 · 0 = 0 1 1 0 1 1 1 = 1 = 0 1 1 1 1 1 1 1 1  145.00
02: Raubfisch ME262_GTZ14c                 15.0/21 1 · = = = 1 1 = = = 0 1 1 0 = 1 1 1 = 1 1 1  146.50
03: Cfish_2017-07-20_YC_x64_bmi2_NUMA      15.0/21 = = · 0 1 = = = = 1 1 1 0 1 1 1 0 1 1 1 1 1  141.75
04: McBrain_2017_v26_x64_bmi2              14.5/21 1 = 1 · = = = = 0 = = 0 0 1 1 1 1 1 1 1 1 1  137.25
05: SugaR XPrO 1.0e 64 BMI2                14.0/21 0 = 0 = · 0 1 1 = 1 = 1 1 1 1 0 0 1 1 1 1 1  128.50
06: McBrain_2017_v25_x64_bmi2              13.5/21 0 0 = = 1 · = = = 1 1 = 0 = 1 0 1 1 1 1 1 1  123.00
07: Symphysodon_x64_220517_modern_710gcc   13.0/21 1 0 = = 0 = · 1 0 1 = 0 1 1 0 1 0 1 1 1 1 1  120.50
08: Corchess_1-8_x64_bmi2                  13.0/21 0 = = = 0 = 0 · 1 1 = 1 1 = 0 = 1 = 1 1 1 1  118.25
09: AsmFishW_2017-07-10_bmi2               12.5/21 0 = = 1 = = 1 0 · 0 0 = 0 = 1 1 = 1 1 1 1 1  113.50
10: Stockfish_170715_x64_bmi2              12.0/21 0 = 0 = 0 0 0 0 1 · = = 1 1 1 1 0 1 1 1 1 1  100.75
11: Nayeem 10.1 64 BMI2                    11.0/21 = 1 0 = = 0 = = 1 = · 1 0 0 0 1 1 0 1 1 1 0  112.00
12: BrainFish_170709_x64_bmi2              11.0/21 0 0 0 1 0 = 1 0 = = 0 · 1 1 = = = 1 0 1 1 1   97.25
13: EngineDeepShredder13UCIx64             10.0/21 = 0 1 1 0 1 0 0 1 0 1 0 · 1 0 0 = 0 1 0 1 1  100.00
14: Gull.3.1_JVx64                         10.0/21 1 1 0 0 0 = 0 = = 0 1 0 0 · = = 1 = 0 1 1 1   92.50
15: Seagull                                9.5/21  0 = 0 0 0 0 1 1 0 0 1 = 1 = · 0 1 0 = = 1 1   84.25
15: Booot6_popcnt                          9.5/21  0 0 0 0 1 1 0 = 0 0 0 = 1 = 1 · 1 = = 0 1 1   84.25
17: Andscacsb                              8.5/21  0 0 1 0 1 0 1 0 = 1 0 = = 0 0 0 · = = 0 1 1   82.50
18: Fizbo19x64_bmi2                        7.0/21  0 0 0 0 0 0 0 = 0 0 1 0 1 = 1 = = · 0 1 0 1   58.00
19: Fire 5 x64 popcnt                      6.5/21  0 = 0 0 0 0 0 0 0 0 0 1 0 1 = = = 1 · = 0 1   53.75
20: Ivanhoe1945a_x64_AVX2_Intel_2015-07-28 5.0/21  0 0 0 0 0 0 0 0 0 0 0 0 1 0 = 1 1 0 = · 0 1   38.00
21: Komodo-11.2-64bit                      3.0/21  0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 · 0   18.50
22: Sting-sf-85                            2.0/21  0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 ·   14.00

231 of 462 games played
Name of the tournament: Bullet02
Site/ Country: ASUS-DANDELION, United States
Level: Blitz 0:20/1
Hardware: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz with 16.0 GB Memory
Operating system: Windows 10 Home Home Edition (Build 9200) 64 bit
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: School of Bullet Fish

Post by lkaufman »

Gusev wrote:After the first half of the bullet 20"+1" tournament, 8 threads, hash=4096, Ponder=ON, with Move Overhead increased from 30 to 75 for all the fish and to 1 sec for Komodo 11.2,

Code: Select all

    Engine                                 Score  HoRaCfMcSuMcSyCoAsStNaBrEnGuSeBoAnFiFiIvKoSt    S-B
01: Houdini_5_Pro_pext_x64                 15.5/21 · 0 = 0 1 1 0 1 1 1 = 1 = 0 1 1 1 1 1 1 1 1  145.00
02: Raubfisch ME262_GTZ14c                 15.0/21 1 · = = = 1 1 = = = 0 1 1 0 = 1 1 1 = 1 1 1  146.50
03: Cfish_2017-07-20_YC_x64_bmi2_NUMA      15.0/21 = = · 0 1 = = = = 1 1 1 0 1 1 1 0 1 1 1 1 1  141.75
04: McBrain_2017_v26_x64_bmi2              14.5/21 1 = 1 · = = = = 0 = = 0 0 1 1 1 1 1 1 1 1 1  137.25
05: SugaR XPrO 1.0e 64 BMI2                14.0/21 0 = 0 = · 0 1 1 = 1 = 1 1 1 1 0 0 1 1 1 1 1  128.50
06: McBrain_2017_v25_x64_bmi2              13.5/21 0 0 = = 1 · = = = 1 1 = 0 = 1 0 1 1 1 1 1 1  123.00
07: Symphysodon_x64_220517_modern_710gcc   13.0/21 1 0 = = 0 = · 1 0 1 = 0 1 1 0 1 0 1 1 1 1 1  120.50
08: Corchess_1-8_x64_bmi2                  13.0/21 0 = = = 0 = 0 · 1 1 = 1 1 = 0 = 1 = 1 1 1 1  118.25
09: AsmFishW_2017-07-10_bmi2               12.5/21 0 = = 1 = = 1 0 · 0 0 = 0 = 1 1 = 1 1 1 1 1  113.50
10: Stockfish_170715_x64_bmi2              12.0/21 0 = 0 = 0 0 0 0 1 · = = 1 1 1 1 0 1 1 1 1 1  100.75
11: Nayeem 10.1 64 BMI2                    11.0/21 = 1 0 = = 0 = = 1 = · 1 0 0 0 1 1 0 1 1 1 0  112.00
12: BrainFish_170709_x64_bmi2              11.0/21 0 0 0 1 0 = 1 0 = = 0 · 1 1 = = = 1 0 1 1 1   97.25
13: EngineDeepShredder13UCIx64             10.0/21 = 0 1 1 0 1 0 0 1 0 1 0 · 1 0 0 = 0 1 0 1 1  100.00
14: Gull.3.1_JVx64                         10.0/21 1 1 0 0 0 = 0 = = 0 1 0 0 · = = 1 = 0 1 1 1   92.50
15: Seagull                                9.5/21  0 = 0 0 0 0 1 1 0 0 1 = 1 = · 0 1 0 = = 1 1   84.25
15: Booot6_popcnt                          9.5/21  0 0 0 0 1 1 0 = 0 0 0 = 1 = 1 · 1 = = 0 1 1   84.25
17: Andscacsb                              8.5/21  0 0 1 0 1 0 1 0 = 1 0 = = 0 0 0 · = = 0 1 1   82.50
18: Fizbo19x64_bmi2                        7.0/21  0 0 0 0 0 0 0 = 0 0 1 0 1 = 1 = = · 0 1 0 1   58.00
19: Fire 5 x64 popcnt                      6.5/21  0 = 0 0 0 0 0 0 0 0 0 1 0 1 = = = 1 · = 0 1   53.75
20: Ivanhoe1945a_x64_AVX2_Intel_2015-07-28 5.0/21  0 0 0 0 0 0 0 0 0 0 0 0 1 0 = 1 1 0 = · 0 1   38.00
21: Komodo-11.2-64bit                      3.0/21  0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 · 0   18.50
22: Sting-sf-85                            2.0/21  0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 ·   14.00

231 of 462 games played
Name of the tournament: Bullet02
Site/ Country: ASUS-DANDELION, United States
Level: Blitz 0:20/1
Hardware: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz with 16.0 GB Memory
Operating system: Windows 10 Home Home Edition (Build 9200) 64 bit
????? Why would you use 75 ms overhead for SF, and 1000 for Komodo? You are having Komodo play with no increment that way! No wonder it is near last place. Normally the default 30 should be enough, but if you need to raise SF to 75, you should do the same for Komodo.
Komodo rules!
Gusev
Posts: 1476
Joined: Mon Jan 28, 2013 2:51 pm

Re: School of Bullet Fish

Post by Gusev »

Hi Larry, I tried that setting before, K just keeps forfeiting on time under these conditions in Arena, no matter what.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: School of Bullet Fish

Post by lkaufman »

Gusev wrote:Hi Larry, I tried that setting before, K just keeps forfeiting on time under these conditions in Arena, no matter what.
Well, I don't use Arena so I don't know what's wrong, but on other GUIs Komodo doesn't normally need more Overhead than Stockfish. Try 100 or even 200 if necessary, but if you need to use 1000 or even 500 you might as well leave it out of the tournament. Playing 20" sudden death vs. 20" plus 1" increment is an enormous handicap; I'm surprised Komodo isn't dead last.

p.s If you are running 8 threads on a four core machine, using hyperthreading, that is probably the problem. It should be fine to use 6, maybe even 7, but using all 8 weakens all the engines and causes problems like this. I always run Komodo (or Stockfish or Houdini) on six threads on my i7 quad laptop. Kai did some studies that indicated that this was best, and I have confirmed his findings.
Komodo rules!
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: School of Bullet Fish

Post by jhellis3 »

It is even worse than that..... he is using 8 threads with ponder on... so god only knows what is going on with the two engines fighting over priority....
Gusev
Posts: 1476
Joined: Mon Jan 28, 2013 2:51 pm

Re: School of Bullet Fish

Post by Gusev »

jhellis3 wrote:It is even worse than that..... he is using 8 threads with ponder on... so god only knows what is going on with the two engines fighting over priority....
Exactly! This is a load that shows 100% of CPU utilization. Terrible. And this is how this extreme bullet contest ended. So, I suppose, it's God and Robert Houdart.:)

Code: Select all

    Engine                                 Score   Ho Mc Mc Cf Su Ra Br Sy St As Na Co En Bo Se Gu Fi An Fi Iv Ko St    S-B
01: Houdini_5_Pro_pext_x64                 30.0/42 ·· 00 11 =1 1= 0= 11 0= 10 11 == 1= =1 11 1= 01 10 11 1= 11 11 11  576.00
02: McBrain_2017_v26_x64_bmi2              28.5/42 11 ·· == 1= =0 == 01 == == 00 =1 =1 0= 10 11 11 1= 11 11 1= 11 11  539.00
03: McBrain_2017_v25_x64_bmi2              28.5/42 00 == ·· == 1= 01 =0 == 1= == 1= =1 01 01 11 =1 11 11 1= 11 11 11  525.00
04: Cfish_2017-07-20_YC_x64_bmi2_NUMA      28.5/42 =0 0= == ·· 10 == 10 =0 11 =1 1= == 0= 1= 11 11 11 01 11 11 11 11  523.75
05: SugaR XPrO 1.0e 64 BMI2                28.0/42 0= =1 0= 01 ·· =0 10 1= 11 =1 =1 11 11 01 10 10 10 01 1= 11 11 11  539.00
06: Raubfisch ME262_GTZ14c                 27.5/42 1= == 10 == =1 ·· 10 10 == =1 0= == 10 11 =1 0= 11 1= == 11 11 11  526.00
07: BrainFish_170709_x64_bmi2              27.0/42 00 10 =1 01 01 01 ·· 11 == =0 0= 01 11 =1 =1 11 1= =1 01 1= 11 11  509.00
08: Symphysodon_x64_220517_modern_710gcc   27.0/42 1= == == =1 0= 01 00 ·· 10 0= == 11 10 11 01 11 10 01 11 11 11 11  501.25
09: Stockfish_170715_x64_bmi2              25.5/42 01 == 0= 00 00 == == 01 ·· 11 =1 00 1= 10 11 11 1= 01 11 1= 11 11  463.50
10: AsmFishW_2017-07-10_bmi2               25.0/42 00 11 == =0 =0 =0 =1 1= 00 ·· 00 0= 00 11 11 =1 11 =1 11 11 11 11  440.00
11: Nayeem 10.1 64 BMI2                    24.5/42 == =0 0= 0= =0 1= 1= == =0 11 ·· =1 0= 11 01 01 0= 1= 11 11 11 01  468.25
12: Corchess_1-8_x64_bmi2                  22.0/42 0= =0 =0 == 00 == 10 00 11 1= =0 ·· 11 == 0= =1 =1 10 10 11 10 11  409.25
13: EngineDeepShredder13UCIx64             21.5/42 =0 1= 10 1= 00 01 00 01 0= 11 1= 00 ·· 01 0= 11 0= == 1= 01 1= 11  415.50
14: Booot6_popcnt                          18.0/42 00 01 10 0= 10 00 =0 00 01 00 00 == 10 ·· 10 == =1 11 == 0= 11 11  312.50
15: Seagull                                17.5/42 0= 00 00 00 01 =0 =0 10 00 00 10 1= 1= 01 ·· == 01 11 =0 =0 11 11  303.00
16: Gull.3.1_JVx64                         17.0/42 10 00 =0 00 01 1= 00 00 00 =0 10 =0 00 == == ·· == 10 01 11 11 11  282.50
17: Fizbo19x64_bmi2                        16.5/42 01 0= 00 00 01 00 0= 01 0= 00 1= =0 1= =0 10 == ·· =0 01 11 0= 11  299.50
18: Andscacsb                              16.0/42 00 00 00 10 10 0= =0 10 10 =0 0= 01 == 00 00 01 =1 ·· =0 01 11 11  283.25
19: Fire 5 x64 popcnt                      14.0/42 0= 00 0= 00 0= == 10 00 00 00 00 01 0= == =1 10 10 =1 ·· == 00 11  248.25
20: Ivanhoe1945a_x64_AVX2_Intel_2015-07-28 9.0/42  00 0= 00 00 00 00 0= 00 0= 00 00 00 10 1= =1 00 00 10 == ·· 00 1=  150.50
21: Komodo-11.2-64bit                      7.0/42  00 00 00 00 00 00 00 00 00 00 00 01 0= 00 00 00 1= 00 11 11 ·· 00  103.50
22: Sting-sf-85                            3.5/42  00 00 00 00 00 00 00 00 00 00 10 00 00 00 00 00 00 00 00 0= 11 ··   43.00

462 games played / Tournament is finished
Name of the tournament: Bullet02
Site/ Country: ASUS-DANDELION, United States
Level: Blitz 0:20/1
Hardware: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz with 16.0 GB Memory
Operating system: Windows 10 Home Home Edition (Build 9200) 64 bit
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: School of Bullet Fish

Post by jhellis3 »

.... You don't even understand why what you did is wrong. I guess there is no hope for a productive conversation. Ah well, carry on with your "tests"....
Gusev
Posts: 1476
Joined: Mon Jan 28, 2013 2:51 pm

Re: School of Bullet Fish

Post by Gusev »

There is nothing wrong with boundary testing. We take an edge case (100% CPU load), we test it. Some engines handle it more gracefully than others. There were no crashes in this tournament, mind you.
jhellis3 wrote:.... You don't even understand why what you did is wrong. I guess there is no hope for a productive conversation. Ah well, carry on with your "tests"....
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: School of Bullet Fish

Post by Adam Hair »

Gusev wrote:There is nothing wrong with boundary testing. We take an edge case (100% CPU load), we test it. Some engines handle it more gracefully than others. There were no crashes in this tournament, mind you.
jhellis3 wrote:.... You don't even understand why what you did is wrong. I guess there is no hope for a productive conversation. Ah well, carry on with your "tests"....
I don't understand the purpose of the test. What was learnt here?
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: School of Bullet Fish

Post by jhellis3 »

There is nothing wrong with boundary testing. We take an edge case (100% CPU load), we test it. Some engines handle it more gracefully than others. There were no crashes in this tournament, mind you.
Nope, you missed the point yet again... attempt number 3 on why the results are meaningless?