GGT + Rybka wins Swiss, From, Sturm + Firebird leads

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

rainhaus
Posts: 185
Joined: Sun Feb 01, 2009 7:26 pm
Location: Germany
Full name: Rainer Neuhäusler

GGT + Rybka wins Swiss, From, Sturm + Firebird leads

Post by rainhaus »

+ Deep Rybka 3 wins the gambits Swiss, From, Sturm + Firebird leads +

GGT Interim report

There are played up to now 6 gambits, 252 games total, 72 games of each engine, 12 games by each engine pair.
Currently we have a head-to head between Firebird and Rybka. Rybka has won 4 gambits consecutively. However, the wins are very close (2x "Feinwertung") and therefore Firebird still leads by drawing from his previous advance. The present tendency is a tie but not a superiority of Firebird. But there are differences in scoring against the opponents.
While Stockfish and Zappa are clearly kept in check by Firebird, Rybka doesn't score so well against them. Against Naum, the other way is round.
You can already see a great gap between the leading duo and the third rank, and this will continue. The 3rd place of Stockfish is according to the published ranking lists. Zappa's 4th rank is a surprise, the engine performed well with Bird's opening variations, however, the midfield is still close together. Shredder, Zappa and Naum will even more change the places till their standing will be stabilized. Deep Fritz is growing old and waiting for a hefty Elo-injection.
In principle you should not change a running tournament. In the meantime Stockfish 1.6.3, Naum 4.1 and Firebird 1.1 are released. According to the authors statements Stockfish has no improved in playing strength. Therefore you can replace or not. Maybe Naum 4.1 will score a little better, I'll be watching the lists. Kranium's parameter screwing I face a little ambivalent, because there are a few disimprovements among his numerous engines and updates.
Hasty Blitz matches on small samples, springing up like mushrooms after a new engine update, convince me not a bit. The currently used engines will remain in GGT for now. But at a later time the replacement with new updates should be considered.

Total Scoring
GGTJan10_4221_10+12 Amar+Ware+Sokolsky+Swiss+From+Sturm

Code: Select all

                1         2         3         4         5         6         7 
1 Fireb 1B     **      5,5 6,5   9,5 2,5   9,5 2,5   7,5 4,5   9,5 2,5   9,0 3,0   50,5 / 72
2 Dp Ryb 3   6,5 5,5     **      6,5 5,5   7,0 5,0  10,0 2,0   9,0 3,0   9,5 2,5   48,5 / 72
3 Stofi 1.6  2,5 9,5   5,5 6,5      **     7,0,5,0   6,5 5,5   5,5 6,5   7,0 5,0   34,0 / 72
4 Zap Mx II  2,5 9,5   5,0 7,0   5,0 7,0      **     7,0 5,0   6,5 5,5   6,5 5,5   32,5 / 72
5 Naum 4     4,5 7,5   2,0 10    5,5 6,5   5,0 7,0     **      5,5 6,6   8.0 4,0   30,5 / 72
6 Dp Shr 12  2,5 9,5   3,0 9,0   6,5 5,5   5,5 6,5   6,5 5,5      **     6,0 6,0   30,0 / 72
7 Dp Fri 11  3,0 9,0   2,5 9,5   5,0 7,0   5,5 6,5   4,0 8,0   6,0 6,0      **     26,0 / 72
09.02.2010
EloStat

Code: Select all


    Program                          Elo    +   -   Games   Score   Av.Op.  Draws
  1 Firebird 1.0 beta x64          : 3206   67  65    72    70.1 %   3058   37.5 %
  2 Deep Rybka 3 x64               : 3187   63  61    72    67.4 %   3061   43.1 %
  3 Stockfish 1.6 x6               : 3062   60  61    72    47.2 %   3082   44.4 %
  4 Zappa Mexico II x64            : 3050   59  60    72    45.1 %   3084   45.8 %
  5 Naum 4 MP x64                  : 3033   63  63    72    42.4 %   3086   40.3 %
  6 Deep Shredder 12 x64           : 3029   71  72    72    41.7 %   3087   25.0 %
  7 Deep Fritz 11                  : 2994   65  67    72    36.1 %   3093   36.1 %
Start Elo 3080


AO2-A03 Bird Opening 1.f4
Swiss Gambit, Sturm Gambit, From Gambit

A02 Swiss gambit: 1.f4 f5 2.e4


Wikipedia(cut citation):
This gambit was named by Alexander Wagner (1868–1942), a Polish chess player and theoretician, who introduced it in the Swiss correspondence game Wagner–Kostin, 1910–11. Chess historian Edward Winter has criticized that usage, pointing out that 1.f4 f5 2.e4 was analyzed by F.A. Lange in the June 1859 Deutsche Schachzeitung, and was played by many players, including Adolf Anderssen, in the 19th century.

GGTJan10_4221_10+12_A00Swiss

Code: Select all

                                  1  2  3  4  5  6  7  
1   Rybka 3                       ** 10 ½½ 11 ½1 ½1 ½1   8.5/12
2   FireBird 1.0 beta x64 mp      01 ** ½1 10 1½ ½1 1½   8.0/12
3   Stockfish 1.6 JA 64bit_dec09  ½½ ½0 ** 1½ ½1 ½1 ½½   7.0/12
4   Deep Shredder 12 x64 FrGui    00 01 0½ ** 1½ 01 11   6.0/12
5   Zappa Mexico II               ½0 0½ ½0 0½ ** 11 10   5.0/12
6   Naum 4 MPx64                  ½0 ½0 ½0 10 00 ** 1½   4.0/12
7   Deep Fritz 11                 ½0 0½ ½½ 00 01 0½ **   3.5/12
A03 Sturm gambit: 1.f4 d5 2.c4

I've found nothing historical about this opening.

GGTJan10_4221_10+12_A03Sturm

Code: Select all

                                  1  2  3  4  5  6  7  
1   Rybka 3                       ** 1½ ½½ 1½ 11 ½1 1½   9.0/12  48.50
2   FireBird 1.0 beta x64 mp      0½ ** 1½ 11 ½1 1½ 11   9.0/12  44.75
3   Zappa Mexico II               ½½ 0½ ** ½½ ½1 01 11   7.0/12
4   Stockfish 1.6 JA 64bit_dec09  0½ 00 ½½ ** ½½ 11 ½1   6.0/12
5   Naum 4 MPx64                  00 ½0 ½0 ½½ ** 1½ 1½   5.0/12
6   Deep Shredder 12 x64 FrGui    ½0 0½ 10 00 0½ ** 01   3.5/12
7   Deep Fritz 11                 0½ 00 00 ½0 0½ 10 **   2.5/12

A02 From's Gambit: 1.f4 e5
So far the most popular gambit of this tournament.

(translation from the German text in Wikipedia):
Martin Severin Janus From (8 April 1828 – 6 May 1895) was a Danish chess master. At the middle of the 19-th century he had the reputation as the best chess player of his country. In 1862 the chess magazin Berliner Schachzeitung published a game between Magnus Oscar Møllerstrøm and From (played in 1862 in Copenhagen), in which From answered to the Bird opening 1. f2-f4 with the gambit e7-e5. Since then this opening variation was introduced as Froms Gambit into the chess literature. Severin From was in 1870, according to his historical Elo number(2427), one of the 20 best players worldwide.

Under the following link you can find a detailed Chessbase article about From and his gambit (available in German only): http://www.chessbase.de/nachrichten.asp?newsid=6878

GGTJan10_4221_10+12_A02From

Code: Select all

                                  1  2  3  4  5  6  7  
1   Rybka 3                       ** ½½ ½½ 11 ½½ 11 1½   8.5/12  45.50
2   FireBird 1.0 beta x64 mp      ½½ ** ½½ 1½ 11 ½1 ½1   8.5/12  45.25
3   Zappa Mexico II               ½½ ½½ ** 0½ ½½ ½½ 11   6.5/12
4   Deep Fritz 11                 00 0½ 1½ ** ½0 ½½ 11   5.5/12
5   Stockfish 1.6 JA 64bit_dec09  ½½ 00 ½½ ½1 ** 0½ 01   5.0/12  28.75
6   Naum 4 MPx64                  00 ½0 ½½ ½½ 1½ ** ½½   5.0/12  26.75
7   Deep Shredder 12 x64 FrGui    0½ ½0 00 00 10 ½½ **   3.0/12
Win%

Code: Select all

Games        :     42 (finished)

White Wins   :     13 (31.0 %)
Black Wins   :      6 (14.3 %)
Draws        :     23 (54.8 %)
Unfinished   :      0

White Perf.  : 58.3 %
Black Perf.  : 41.7 % 
41,7% (the gambit is here played by Black!), a clearly better performance in relation to the A00-gambits

From's Gambit, Human Chess

Internet Database

Code: Select all

                   Games      1-0     =-=     0-1    Score
-----------------------------------------------------------
 All report games   3528     1439     654     1435    50.0%
-----------------------------------------------------------
                               41%     18%     41%
The human balance is much better. Who plays it, is mostly well prepared and knows the theory. Of course you can get with an opening book a better black balance by the engines too.


Starting evaluation


After 2.fxc5:
- 0,01 to - 0,49 cp (for Black=Gambit player)
Average: - 0,21 cp
in comparison:
Average (Amar gambit): -0,50 (for White=Gambit player)
Average (Ware gambit): -0,56 (for White=Gambit player)
Average (Sokolsky) : - 0,19 (for White=Gambit player)

Could be there is a correlation between the performance and the mean of starting evaluations. We we'll see.


Opening Table From Gambit. First 8 moves played by all engines (SCID)
incl. game allocation

Code: Select all

-------------------------------------------------------------------------------
  +13 =23 -6 (24.5/42: 58%)
-------------------------------------------------------------------------------
       1        2        3        4        5        6        7        8     
-------------------------------------------------------------------------------
 1  f4       fe5      Sf3      Se5      Sf3      Sc3      g3       Lg2       4:
    e5       d6       de5      Ld6[1]   Sf6[2]   c5[3]    Sc6      Lg4[4]   50%

 2  ...      ...      ...      ...      ...      ...      e3       Ld3[6]    6:
    ...      ...      ...      ...      ...      OO       a6[5]    Sc6[7]   83%

 3  ...      ...      ed6      Sf3      d4[9]    e3       Lc4      OO        7:
    ...      ...      Ld6      Sc6[8]   De7[10]  Sf6      OO       Lg4[11]  71%

 4  ...      ...      ...      ...      d4[12]   Sc3[13]  g3       d5        7:
    ...      ...      ...      Sf6      OO       Te8[14]  c5       c4[15]   36%

 5  ...      ...      ...      ...      Sc3      d4[17]   e4[18]   Lg5       5:
    ...      ...      ...      ...      Sc6[16]  OO       Lb4      h6[19]   50%

 6  ...      ...      ...      ...      ...      g3[20]   Lg2      OO        4:
    ...      ...      ...      ...      OO       c5[21]   Sc6      h6[22]   38%

 7  ...      ...      ...      ...      ...      e3       b3       Lb2[24]   4:
    ...      ...      ...      ...      ...      c5[23]   Sc6      a6[25]   88%

 8  ...      ...      ...      ...      ...      ...      Ld3[26]  OO        5:
    ...      ...      ...      ...      ...      a6       Sc6      Te8[27]  50%

-------------------------------------------------------------------------------
[1] 4...Sc6 5.Sxc6 Dh4+ 6.g3 De4 7.Tg1 Dxc6 8.Lg2 Db6 9.Tf1 Sf6 1-0(72) Zappa Mexico II - Deep Shredder 12 x64 FrGui, ? 2010.

[2] 5...Sc6 6.Sc3 Sf6 7.e3 Sg4 8.Se4 Lf5 9.Sxd6+ Dxd6 0-1(70) Deep Shredder 12 x64 FrGui - Zappa Mexico II, ? 2010.

[3] 6...Sc6 7.e3 Sg4 8.d4 OO 9.Ld3 Te8 =-=(82) Stockfish 1.6 JA 64bit_dec09 - Rybka 3, ? 2010.

[4] 9.OO OO =-=(110) Zappa Mexico II - Deep Fritz 11, ? 2010.

[5] 7...Sg4 8.g3 Te8 9.Lg2 c5 1-0(68) FireBird 1.0 beta x64 mp - Stockfish 1.6 JA 64bit_dec09, ? 2010; 8...Sxh2 9.Txh2 Lxg3+ 1-0(83) Naum 4 MPx64 - Stockfish 1.6 JA 64bit_dec09, ? 2010.
7...h6 8.Lc4 c5 9.OO a6 =-=(92) Deep Shredder 12 x64 FrGui - FireBird 1.0 beta x64 mp, ? 2010.
7...c5 8.Ld3 Sc6 9.OO De7 1-0(135) Deep Shredder 12 x64 FrGui - Stockfish 1.6 JA 64bit_dec09, ? 2010.

[6] 8.Lc4 b5 9.Lb3 Sc6 1-0(56) Rybka 3 - Deep Shredder 12 x64 FrGui, ? 2010.

[7] 9.OO De7 =-=(72) Deep Shredder 12 x64 FrGui - Rybka 3, ? 2010.

[8] 4...g5 5.d4 g4 6.Se5 Lxe5 7.dxe5 Dxd1+ 8.Kxd1 Sc6 9.Sc3 Le6 =-=(233) Naum 4 MPx64 - Zappa Mexico II, ? 2010.
4...Sh6 5.g3 Lg4 6.Lg2 Sc6 7.Sc3 De7 8.Sd5 Dd7 9.c3 Lxg3+ 1-0(69) FireBird 1.0 beta x64 mp - Deep Shredder 12 x64 FrGui, ? 2010.

[9] 5.e3 g5 6.g3 h5 7.De2 h4 8.gxh4 g4 9.Sg5 Txh4 =-=(95) Rybka 3 - Zappa Mexico II, ? 2010.
5.Sc3 Sf6 6.d4 De7 7.Lg5 Lg4 8.Dd2 OOO 9.OOO h6 =-=(89) FireBird 1.0 beta x64 mp - Zappa Mexico II, ? 2010.

[10] 5...Sf6 6.Sc3 OO 7.e4 Lb4 8.Lg5 Te8 9.Le2 Lg4 1-0(47) Stockfish 1.6 JA 64bit_dec09 - Deep Shredder 12 x64 FrGui, ? 2010.
5...Lg4 6.e3 Sf6 7.Ld3 Dd7 8.Sc3 OO 9.OO a6 1-0(47) Deep Fritz 11 - Zappa Mexico II, ? 2010.

[11] 9.Sc3 Tae8 =-=(91) Stockfish 1.6 JA 64bit_dec09 - Zappa Mexico II, ? 2010.

[12] 5.g3 Sc6 6.Lg2 De7 7.OO Lg4 8.Sc3 OOO 9.d3 Lb4 =-=(75) Stockfish 1.6 JA 64bit_dec09 - Deep Fritz 11, ? 2010.
5.e3 Sg4 6.d4 De7 7.De2 Sc6 8.Sc3 OO 9.Ld2 Te8 =-=(78) Zappa Mexico II - Naum 4 MPx64, ? 2010.

[13] 6.e3 c5 7.Le2 Lg4 8.OO Sc6 9.c3 Lc7 =-=(87) Rybka 3 - Stockfish 1.6 JA 64bit_dec09, ? 2010.

[14] 6...c5 7.Lg5 cxd4 8.Lxf6 Dxf6 9.Se4 Lb4+ =-=(58) Deep Fritz 11 - Naum 4 MPx64, ? 2010.

[15] 9.Lg2 Lc5 0-1(27) Deep Fritz 11 - Stockfish 1.6 JA 64bit_dec09, ? 2010; =-=(65) Deep Fritz 11 - FireBird 1.0 beta x64 mp, ? 2010.
8...b5 9.Sxb5 Da5+ 0-1(57) Deep Fritz 11 - Rybka 3, ? 2010.

[16] 5...c5 6.e4 OO 7.Le2 Sc6 8.OO Sd4 9.d3 Lb8 =-=(110) Deep Shredder 12 x64 FrGui - Naum 4 MPx64, ? 2010; 6.e3 OO 7.b3 Sc6 8.Lb2 Te8 9.Ld3 Sb4 1-0(54) FireBird 1.0 beta x64 mp - Deep Fritz 11, ? 2010.

[17] 6.e3 Sg4 7.d4 OO 8.Lb5 Te8 9.e4 Lxh2 0-1(36) Deep Shredder 12 x64 FrGui - Deep Fritz 11, ? 2010.

[18] 7.e3 Te8 8.Lc4 Sa5 9.Ld3 c5 =-=(135) Naum 4 MPx64 - Deep Fritz 11, ? 2010.

[19] 9.Lxf6 Dxf6 =-=(107) Naum 4 MPx64 - Deep Shredder 12 x64 FrGui, ? 2010.

[20] 6.e4 Te8 7.d3 Sc6 8.De2 a6 9.Le3 b5 0-1(67) Stockfish 1.6 JA 64bit_dec09 - FireBird 1.0 beta x64 mp, ? 2010.
6.d4 Sg4 7.g3 c5 8.d5 c4 9.Dd4 Sa6 1-0(73) Deep Fritz 11 - Deep Shredder 12 x64 FrGui, ? 2010.

[21] 6...Sc6 7.Lg2 Lg4 8.OO h6 9.d4 Te8 0-1(77) Naum 4 MPx64 - Rybka 3, ? 2010.

[22] 9.d3 Le6 =-=(40) Rybka 3 - FireBird 1.0 beta x64 mp, ? 2010.

[23] 6...Sg4 7.g3 Te8 8.Lg2 c5 9.OO Sc6 1-0(48) Rybka 3 - Deep Fritz 11, ? 2010.

[24] 8.Le2 Te8 9.OO a6 =-=(50) Zappa Mexico II - Stockfish 1.6 JA 64bit_dec09, ? 2010.

[25] 9.Ld3 Sb4 1-0(147) Rybka 3 - Naum 4 MPx64, ? 2010.
8...Te8 9.Ld3 a6 1-0(146) FireBird 1.0 beta x64 mp - Naum 4 MPx64, ? 2010.

[26] 7.d4 c5 8.Ld3 Sc6 9.OO Te8 =-=(80) Naum 4 MPx64 - FireBird 1.0 beta x64 mp, ? 2010.
7.b3 Sc6 8.Le2 h6 9.Lb2 De7 =-=(152) Zappa Mexico II - Rybka 3, ? 2010.
7.Le2 c5 8.d3 Sc6 9.OO h6 =-=(91) Stockfish 1.6 JA 64bit_dec09 - Naum 4 MPx64, ? 2010.

[27] 9.b3 Sb4 =-=(35) Zappa Mexico II - FireBird 1.0 beta x64 mp, ? 2010.
8...De7 9.b3 Lg4 =-=(79) FireBird 1.0 beta x64 mp - Rybka 3, ? 2010


PGN-Links

http://www.file-upload.net/download-224 ... s.pgn.html

http://www.file-upload.net/download-224 ... m.pgn.html

http://www.file-upload.net/download-224 ... m.pgn.html


Next: Lisitsin Gambit

Test conditions
Starting positions: pool of 100 gambits sorted by Elo number.
Time Control: short tournament level with 40/20', 20/10', 10'+12''.
System: Intel Core i7 920, oc 3700 MHz, 6 GB RAM. Hyperthreading off, Turbo Mode off. Vista 64Bit
Parameter: 3 Threads, ponder off, 1,2 GB Hash, EGTB 3-4-5 (not used by Firebird and Stockfish, but sometimes used by the GUI, even for both engines)
Fritz11-GUI: remis never, resign late.

Rainer Neuhäusler
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: GGT + Rybka wins Swiss, From, Sturm + Firebird leads

Post by beram »

Very well done and very interesting.
Firebird still holds his lead of + 20 ELO at longer gametime and people who claimed Firebird(et al) is only well tuned against Rybka, now have one suggestive disapproval argument less.

keep on running please