Bishop Verses Knight EPD test suite

[swami]

Thanks for the testimonials, Edsel. I've now added your words into the testimonials page:

http://sites.google.com/site/strategict ... stimonials

[swami]

After hunting around for some time through the menu's of Arena, I found "Automatic Analysis...":

Rotor 0.5: 69/100 (10 s/move - Celeron-M 1.3 GHz)

This seems only to count the first move, not the alternative moves.
Is there a possibility with Arena to count the alternative solutions as well?
And add the move scores (..=10, etc.) in the epd file?

At some point, I plan to modify Bruce Moreland's EPD analyzer program to handle it automatically. The program GradualTest can use the EPD files if you reformat them a bit with a SED script or what have you.

Someone did that for us with some of the earlier tests.

Yeah those were from Matt Shoemaker. Epd in Gradtest format can be found in older STS threads/ or by search via programming forum. Many thanks to him, as usual.

[swami]

Plisk 0.1.1

Strategic Test Suite Conditions:

Arena GUI
10 seconds each move
500 positions
Core2Quad 32 bits, Q6600, 2 GB RAM, 2.4GHZ
Engine uses 134 Mb Hash.

Subject-wise Scores:

STS (v1.0) - Undermining:
50/100, Grade: C

STS (v2.0) - Open Files and Diagonals:
55/100, Grade C+

STS (v3.0) - Knight Outposts/Centralization/Repositioning:
43/100, Grade: E

STS (v4.0) - Square Vacancy:
52/100, Grade: C

STS (v5.0) - Bishop vs Knight:
57/100, Grade: C+

Overall Performance:

Total Score: 257/500

Overall Average: 51.4%

Grade: C

[jpqy]

This Strategic Test Suite is very interesting!

Like the example above from Plisk 0.1.1 has done the 5 STS..it would be interesting to make a list with all the engines we have.

Something named as the Talkchess STS list!
And everybody who wants can helps with this rating list and make a fix topic of it on the first page from this forum.
You can collect all the data for example in a excel file or open office and update the list on the forum.
Name Engine--The five STS scores---And total score--Hardware.
Highest score takes first place..and so on.

Just a idea...

JP.

[swami]

This Strategic Test Suite is very interesting!

Like the example above from Plisk 0.1.1 has done the 5 STS..it would be interesting to make a list with all the engines we have.

Something named as the Talkchess STS list!
And everybody who wants can helps with this rating list and make a fix topic of it on the first page from this forum.
You can collect all the data for example in a excel file or open office and update the list on the forum.
Name Engine--The five STS scores---And total score--Hardware.
Highest score takes first place..and so on.

Just a idea...

JP.

That would be a good idea. But I'd rather post number of positions solved in certain threads where the engine gets released/updated.

Ofcourse, I'd test a lot of chess engines and save the results list at my site in correct order.

[swami]

Hi,

let's see how the big guys perform :

Q6600 @3Ghz , 10sec/move

Rybka 3 x64 2CPU : 93/100
Zappa Mexico II x64 2 CPU : 85/100
Naum 4 x64 2CPU : 82/100
Deep Shredder 11 x64 2CPU: 79/100

Best
Johan

Thanks, Johan for the tests. These are really expected scores. Could anybody else post the results from Deep Fritz, Deep Sjeng, Onno and Hiarcs?

[Vinvin]

Hi,

let's see how the big guys perform :

Q6600 @3Ghz , 10sec/move

Rybka 3 x64 2CPU : 93/100
Zappa Mexico II x64 2 CPU : 85/100
Naum 4 x64 2CPU : 82/100
Deep Shredder 11 x64 2CPU: 79/100

Best
Johan

Thanks, Johan for the tests. These are really expected scores. Could anybody else post the results from Deep Fritz, Deep Sjeng, Onno and Hiarcs?

And with Stockfish, Grapefruit, Thinker and Bright ...

[El Gringo]

Hi,

let's see how the big guys perform :

Q6600 @3Ghz , 10sec/move

Rybka 3 x64 2CPU : 93/100
Zappa Mexico II x64 2 CPU : 85/100
Naum 4 x64 2CPU : 82/100
Deep Shredder 11 x64 2CPU: 79/100

Best
Johan

Thanks, Johan for the tests. These are really expected scores. Could anybody else post the results from Deep Fritz, Deep Sjeng, Onno and Hiarcs?

ok,

More results :

Bright 0.4a 2CPu : 80/100
Hiarcs 12 MP 2CPU : 77/100
Stockfish 1.4 x64 4CPU : 82/100

Best
Johan