SPCC: Testrun of Seer 2.3.0 finished

[pohl4711]

AB-testrun of Seer 2.3.0 finished. New engine in my list: All 7000 games played without any problems.


https://www.sp-cc.de

(Perhaps you have to clear your browsercache or reload the website)

[connor_mcmonigle]

AB-testrun of Seer 2.3.0 finished.


https://www.sp-cc.de

(Perhaps you have to clear your browsercache or reload the website)

Thanks for testing! That result looks very consistent with my testing against other engines. The listing seems to indicate the AVX binary was used. It shouldn't make a significant difference (definitely not worth testing again), but was there a reason for choosing the AVX binary over the AVX2 binary?

[pohl4711]

AB-testrun of Seer 2.3.0 finished.


https://www.sp-cc.de

(Perhaps you have to clear your browsercache or reload the website)

Thanks for testing! That result looks very consistent with my testing against other engines. The listing seems to indicate the AVX binary was used. It shouldn't make a significant difference (definitely not worth testing again), but was there a reason for choosing the AVX binary over the AVX2 binary?

Yes, the avx-Binary was little bit faster on my AMD Ryzen 12core CPU, than the avx2-Binary. But only some percent - no big deal. I measured all 3 binaries twice. Avx was the fastest.

[Sylwy]

Yes, the avx-Binary was little bit faster on my AMD Ryzen 12core CPU, than the avx2-Binary. But only some percent - no big deal. I measured all 3 binaries twice. Avx was the fastest.

On my Intel i5-7400-3GHz (Kaby Lake):

AVX
===



AVX2
====



AVX2 is the fastest, of course !

[pohl4711]

Yes, the avx-Binary was little bit faster on my AMD Ryzen 12core CPU, than the avx2-Binary. But only some percent - no big deal. I measured all 3 binaries twice. Avx was the fastest.

On my Intel i5-7400-3GHz (Kaby Lake):

AVX2 is the fastest, of course !

So what? I have a total different CPU. I measured again: avx2 binary is around 5% slower than avx on my AMD Ryzen 3900 12core.
(5% speed difference is perhaps 2 Elo with my testing-conditions. Meaningless)

[connor_mcmonigle]

The hardware configuration is likely very relevant. It's possible that on Zen2 processors, FMA gets decoded into the same micro ops as a MUL followed by an ADD which would result in the behavior Pohl is observing.

Regardless, just one comparison of nps is insufficient as the variance is likely significant. Furthermore, just testing nps on the start position is also flawed. A more accurate picture is obtained by running bench several times and averaging across all trials. To compare NPS, I use this script: https://github.com/TerjeKir/EngineTests ... speedup.py. In any case, the percent nps difference is so tiny that it won't meaningfully influence the performance (certainly within error of a 100 game test, lol).

[Sylwy]

Yes, the avx-Binary was little bit faster on my AMD Ryzen 12core CPU, than the avx2-Binary. But only some percent - no big deal. I measured all 3 binaries twice. Avx was the fastest.

On my Intel i5-7400-3GHz (Kaby Lake):

AVX2 is the fastest, of course !

2.-So what? 1.- I have a total different CPU.

1.-I know.
2.-Just an info (I want to test also Seer 2.3.0).