LearningLemming 0.30X Gauntlet 40/40-40/20-40/10 Repeating

[swami]

I've just got a copy of LearningLemming 0.30x.
Since there are no games for this version of the engine at longer time controls, I decided to run the longer time controls tournament for the first time

Objective:

-To find the major weaknesses.
-Comment the games and send it to the author.
- Frequency of the weaknesses repeated by the engine in many games and mark it as 'critical'.

Condition:

Time Controls 40/40. (40 moves in 40 minutes repeating)
Engine uses its Own opening book.
GUI:Arena latest beta
Core 2 Quad Q6600 4x2.6GHZ, 2 GB RAM, 32 Bits.

Participants:

Code: Select all

  Engine                           Score Le
01: LearningLemming 0.30x32          0.0/0 · 
01: Hamsters_Extreme 0.7             0.0/0   
01: AnMon_5.60WB                     0.0/0   
01: Bright-0.3a                      0.0/0   
01: GarboChess2.20                   0.0/0   
01: Movei00_8_446                    0.0/0   
01: Pro Deo 1.6                      0.0/0   
01: TwistedLogic20080729             0.0/0   
01: Jonny 2.83                       0.0/0   
01: ZCT 0.3.2447                     0.0/0   
01: The King 3.50 Trail Blazer [001] 0.0/0   
01: Cerebro 3.03d                    0.0/0   
01: RomiChessP3k                     0.0/0   
01: Baron 2.23                       0.0/0   

0 of 78 games played
Name of the tournament: Lemming
Site/ Country: WELCOME-D2B6707, United States
Level: Tournament 40/40
Hardware: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz4x  2400 MHz with 2,032 MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: H:\Arena 1.99 beta 5\Tournaments\Lemming .pgn
Website: 
E-Mail Address: 

[swami]

Engines presumably stronger than Lemming: (CCRL Ratingslist Reference)

TwistedLogic
Chessmaster TrailBlazer
Movei
Pro Deo
Bright
Baron (2.23)

Of Similar Strength to the Lemming:

Hamsters
Anmon
Jonny
GarboChess

Little Weaker than the Lemming:

Cerebro
ZCT
Romichess

So, the tournament looks little bit tougher for LearningLemming, but I want it to be like that. So I could comment on both the winning and losing games.

[BubbaTough]

Thanks! Please note: The version I sent you is fairly experimental in the opening. This will have two effects: weaker opening play, and spending more time in the beginning (which hurts fast play much more than slower games). If you want, I can also send you a version which will always play the 'best' moves, such as I compiled for Olivier's ChessWar.

If you get a chance, a few games (even just fast ones) of increment, no increment, and ponder on / ponder off would also be interesting just to comment on time management in these conditions. Of course, the gold standard of how to manage time is how you as a human would have allocated it among the possible moves, not how other programs do it .

-Sam

[swami]

Thanks! Please note: The version I sent you is fairly experimental in the opening. This will have two effects: weaker opening play, and spending more time in the beginning (which hurts fast play much more than slower games). If you want, I can also send you a version which will always play the 'best' moves, such as I compiled for Olivier's ChessWar.

If you get a chance, a few games (even just fast ones) of increment, no increment, and ponder on / ponder off would also be interesting just to comment on time management in these conditions. Of course, the gold standard of how to manage time is how you as a human would have allocated it among the possible moves, not how other programs do it .

-Sam

Hi Sam,

You can send it to me the opening book, I would put it in the folder, the problem is that other engines are using comprehensive opening books, little opening knowledge maybe dangerous in this case. If not, I could even use Noomen/Sedat/Nunn starting positions test suites.

Ok, I will try the Blitz Time controls 4+2, 1+1 etc. 5+0, Ponder off and ponder on in other computer at home.

Regards.

[BubbaTough]

problem is that other engines are using comprehensive opening books, little opening knowledge maybe dangerous in this case.

The learning file I sent you (which includes all its book knowledge) does not need to change...a different executable would just use it differently (less speculatively). If the other engines are outbooking me to death, you can send me the tolearn.txt file that is generated, and I shall send you an improved learning file. If you tell me a public engine / book that really has my number, I can download it and within a day the engine will adjust pretty well. My experience on ICC is that my automatically generated book knowledge does not get me into as much trouble as one would think...but things can get a little funky when I change fundamental elements of the eval function and the learning file gets stuck in the middle of being adjusted to the engine's new perspective (such as is the case right now with my new changes). I expect you will see some odd experiments such as 1.d4 d5 2. a3 which look bad, but leave opponent engines having to think on their own early on which not all engines handle well.

In any case, I am not too worried about how my engine performs, just that I can learn as much as possible from your generous donation of time. Perhaps we can just see how the first few games go, and if you feel my book is distractingly bad against some of the opposition, I/we can take steps to rectify it.

I could even use Noomen/Sedat/Nunn starting positions test suites.

If you think the test positions would be interesting by all means, just remove the learning file during these tests (which may confuse it). I have never looked at those assumably they are popular for some good reasons.

[swami]

Hi Sam,

I've chosen the Noomen 100 opening test suite instead. Unfortunately it doesn't play with learning disabled, there was some windows error in pop up box that asks me to terminate the program, when I enabled the learning file, it plays just fine.

I think there are good opening book creators who may be generous to offer you their own opening book, also Harry Schnapp GUI book for Arena is pretty good I gather.

[BubbaTough]

some windows error in pop up box that asks me to terminate the program, when I enabled the learning file, it plays just fine.

you can use an empty learning.txt file and that problem will go away. Sorry about things not being very user friendly, the program is really just designed for me to tinker with right now and has lots of quirks like that .

I think there are good opening book creators who may be generous to offer you their own opening book, also Harry Schnapp GUI book for Arena is pretty good I gather.

I have no plans to get a human generated book currently, as working on methods for having the computer self-generate its book is part of my interest in writing this program. I am willing to suffer through the negatives and glory in the positiives (should they come).

-Sam

[swami]

No Problem, Sam. It's working ok with empty learning file. I will send you the learn file as well, you may add it to the already existing archives of the learning.txt.

yes, It's good for a computer to self generate the book based on learning file, and through experience. That way you could get the some kind of book that suits the engine's style just fine.

[swami]

Code: Select all

Engine              Score      Le
1: LemmingSwami0.30x32 15.0/24 ······ 
2: Movei00_8_446       4.0/6   1==011 
3: Aristarch 4.50      3.0/6   011100 
4: RomiChessP3k        2.0/6   0=00=1 
5: ZCT 0.3.2447        0.0/6   000000 
         

24 of 78 games played
Name of the tournament: Lemming
Site/ Country: WELCOME-D2B6707, United States
Level: Tournament 40/40 40/20 40/10
Hardware: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz4x  2400 MHz with 2,032 MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: H:\Arena 1.99 beta 5\Tournaments\Lemming.pgn
Website: 
E-Mail Address: 

Some more games left...

[swami]

Code: Select all

[Event "Computer chess game"]
[Site "WELCOME-D2B6707"]
[Date "2008.09.04"]
[Round "?"]
[White "ADMIN"]
[Black "LemmingSwami0.30x32"]
[Result "1/2-1/2"]
[WhiteElo "2400"]
[BlackElo "2200"]
[PlyCount "118"]
[EventDate "2008.??.??"]
[TimeControl "300+1"]

1. c4 e5 {(e7e5 Nb1c3 Ng8f6 Ng1f3 Nb8c6 e2e3 d7d5 d2d4 e5xd4 e3xd4 d5xc4
Bf1xc4 Qd8e7+ Bc1e3 Bc8f5) +0.03/14 5} 2. Nc3 Nf6 {
(Ng8f6 Ng1f3 Nb8c6 e2e4 Bf8b4 d2d3 d7d6 a2a3 Bb4c5) +0.01/15 7} 3. g3 Nc6 {
(Nb8c6 Bf1g2 Bf8c5 d2d3 d7d6 Ng1f3 h7h6 00 a7a6 Bc1d2 Bc8f5 Qd1b3 Bc5b6 Nf3h4)
+0.12/15 14} 4. Bg2 Bc5 {(Bf8c5 d2d3 d7d6 Ng1f3 h7h6 a2a3 a7a5 00 Bc8f5 Qd1b3
Qd8b8 Nf3h4 Nc6d4 Qb3xb7) +0.09/15 8} 5. d3 O-O {(00 Ng1f3 d7d6 Bc1d2 h7h6 00
a7a6 Qd1b3 Rf8e8 a2a3 e5e4 Nc3xe4 Nf6xe4 d3xe4 Re8xe4 e2e3) +0.13/15 6} 6. Nf3
d6 {(d7d6 Bc1d2 Rf8e8 00 e5e4 Nf3g5 e4xd3 e2xd3 Bc8f5 Ng5e4) +0.09/14 4} 7. O-O
a6 {(a7a6 a2a3 Bc8d7 Bc1d2 h7h6 Qd1b3 Qd8b8 e2e3 Bd7f5 Nc3d5 Nf6xd5 c4xd5) +0.
06/14 8} 8. a3 h6 {
(h7h6 Bc1d2 Rf8e8 b2b4 Bc5a7 Qd1c2 Bc8f5 Nf3h4 Bf5g4 e2e3) +0.05/14 10} 9. b4
Bb6 {(Bc5b6 Bc1d2 Bc8d7 Qd1c2 g7g5 Rf1b1) +0.07/15 10} 10. e4 Bg4 {
(Bc8g4 Qd1c2 Qd8d7 Bc1d2 Nc6d4) +0.12/15 10} 11. Be3 Nd4 {
(Nc6d4 Be3xd4 Bb6xd4 Qd1c2 Bd4a7) +0.24/16 10} 12. Bxd4 Bxd4 {
(Bb6xd4 Qd1d2 Bd4b6 Rf1c1 Qd8e7 h2h3 Bg4d7 Nf3h4 Qe7e6 Nh4f5) +0.22/15 12} 13.
Rc1 Bb6 {
(Bd4b6 Qd1b3 Qd8e7 h2h3 Bg4d7 Rf1d1 c7c6 d3d4 e5xd4 Nf3xd4 Qe7e5) +0.30/13 3}
14. h3 Be6 {(Bg4e6 Nc3d5 Bb6a7 Qd1e2 c7c6 Nd5xf6+ Qd8xf6) +0.26/14 3} 15. Nd5
Ba7 {(Bb6a7 a3a4 c7c6 Nd5xf6+ Qd8xf6 Rf1e1 Be6d7 a4a5 c6c5 Rc1b1 c5xb4 Rb1xb4
Rf8b8) +0.30/15 7} 16. Kh2 Nxd5 {(Nf6xd5 c4xd5 Be6d7 Kh2g1 f7f5 Rf1e1 a6a5
b4xa5 Ba7c5 Rc1b1 Qd8c8 Qd1b3) +0.37/14 3} 17. cxd5 Bd7 {(Be6d7 Qd1c2 Ba7b6
a3a4 a6a5 b4b5 f7f5 Rf1d1 Qd8f6 Kh2g1 f5xe4 d3xe4 Bd7xh3) +0.37/14 5} 18. d4
exd4 {(e5xd4 Nf3xd4 Ba7b6 Nd4f5 Bd7xf5 e4xf5 a6a5 Qd1d2 a5xb4 a3xb4 Qd8f6
Bg2e4 Rf8e8 Rf1e1 Ra8a3) +0.38/14 4} 19. Nxd4 Bb6 {(Ba7b6 Nd4f5 Bd7xf5 e4xf5
a6a5 Qd1d2 a5xb4 a3xb4 Qd8f6 Bg2e4 Ra8a3 Rf1e1 Qf6e5 f2f4 Qe5f6) +0.31/14 5}
20. f4 Qf6 {(Qd8f6 Nd4b3 h6h5 Qd1xh5 Qf6b2 Qh5f3 Bd7b5) +0.45/16 7} 21. Nf3 a5
{(a6a5 e4e5 Qf6e7 Rf1e1 a5xb4 a3xb4 Ra8a2 e5e6 f7xe6 Qd1b3 Rf8a8 d5xe6 Bd7b5
Rc1c2 Ra2a1 Re1xa1) +0.53/16 13} 22. Qb3 axb4 {(a5xb4 a3xb4 Bd7b5 Rf1e1 Rf8e8
Qb3c3 Qf6xc3 Rc1xc3 Ra8a4 Rc3b3 Ra4a2 Rb3c3 Re8a8 Re1d1 Kg8f8) +0.63/14 4} 23.
axb4 Ra6 {(Ra8a6 Qb3c3 Qf6xc3 Rc1xc3 Rf8e8 e4e5 d6xe5 Nf3xe5 Bd7b5 Rf1d1 f7f6
Ne5c4 Bb6f2) +0.61/15 20} 24. e5 Qe7 {(Qf6e7 Rf1e1 Rf8a8) +0.43/16 10} 25. Ra1
Rfa8 {(Rf8a8 Ra1xa6 Ra8xa6 Qb3c3 d6xe5 Nf3xe5 Bd7f5) +0.45/15 8} 26. Rxa6 Rxa6
{(Ra8xa6 Qb3c3 d6xe5 Nf3xe5 Bd7f5 Rf1e1 Bb6f2 Re1c1 f7f6 Qc3xc7 Qe7xc7 Rc1xc7
f6xe5) +0.40/15 4} 27. Re1 Ba4 {(Bd7a4 Qb3b2) +0.24/14 7} 28. Qc3 Ra8 {
(Ra6a8 Nf3d4 d6xe5 f4xe5 Ba4e8 Re1e2 Bb6xd4 Qc3xd4 Be8b5 Re2e1 Ra8a4 d5d6
c7xd6 Qd4xd6 Qe7d7) +0.18/145} 29. e6 Bb5 {(Ba4b5 Nf3d4 Bb6xd4 Qc3xd4 h6h5
e6xf7+ Qe7xf7 Re1a1 Ra8xa1 Qd4xa1 Qf7e8 Bg2f1 Bb5xf1 Qa1xf1 Kg8f7 Qf1c4 Qe8e7)
+0.11/13 3} 30. f5 Ra2 {
(Ra8a2 Nf3d4 Bb5e8 Qc3c4 Ra2a8 e6xf7+ Qe7xf7 g3g4 Qf7f6 Nd4e6 Qf6e7) +0.22/13 3
} 31. Nh4 Bf2 {(Bb6f2 Re1c1 Qe7g5 e6xf7+ Kg8xf7 f5f6 Bf2b6 f6xg7 Kf7g8 Rc1e1
Qg5xg7 Qc3xg7+) +0.36/13 5} 32. Re4 Ba7 {
(Bf2a7 f5f6 Qe7xf6 Qc3xf6 g7xf6 e6e7 Bb5e8 Nh4f5 h6h5 g3g4) -0.22/13 7} 33. Rg4
f6 {(f7f6 Nh4g6 Qe7d8 e6e7 Qd8e8 Qc3xc7 Bb5f1 Ng6f4 Bf1xg2 Nf4xg2 Ra2a1 Ng2h4
Ra1a2+ Kh2h1 Ra2a1+ Kh1g2 Ra1a2+ Kg2f1 Ra2a1+ Kf1e2 Qe8b5+ Qc7c4 Ra1a2+ Ke2f3)
-0.23/16 13} 34. Ng6 Qd8 {(Qe7d8 e6e7 Qd8e8 Qc3xc7) -0.10/17 3} 35. e7 Qe8 36.
Re4 Bf1 {(Bb5f1 Ng6f4 Ba7b6 Re4e1 Bf1b5) +0.05/16 2} 37. Nf4 Bb6 {
(Ba7b6 Re4e1 Bf1b5) +0.05/16 3} 38. Qf3 Bb5 {
(Bf1b5 Nf4h5 Ra2a1 Qf3g4 Bb6g1+ Kh2h1 Bg1e3+ Kh1h2 Be3g1+) 0.00/16 4} 39. Qg4
Qf7 {(Qe8f7 Qg4g6 Bb5e8 h3h4 Ra2a3 Bg2f1 Qf7xg6 Nf4xg6 Bb6f2 g3g4 Kg8f7 Kh2g2)
-0.22/13 4} 40. Nh5 Be8 {(Bb5e8 Nh5f4 Ra2a1 Bg2f3 c7c6 Qg4g6 Qf7xg6 f5xg6
Bb6g1+ Kh2g2 f6f5 Re4e2 Bg1d4 Kg2h2) 0.00/13 1} 41. Nf4 Bb5 {
(Be8b5 Qg4g6 Ra2a8 Qg6xf7+ Kg8xf7 Bg2f3 Ra8a2+ Nf4g2) 0.00/13 3} 42. h4 Ra3 {
(Ra2a3 Qg4g6 Ra3e3) -0.04/13 4} 43. Qg6 Re3 {
(Ra3e3 Re4e6 Bb5d7 Bg2f3 Qf7xg6 Nf4xg6 Kg8f7) -0.03/14 2} 44. Re6 Be8 {
(Bb5e8 Bg2f1 Bb6d4 Bf1c4 Qf7xg6 f5xg6 Re3e5 Re6xe5) 0.00/15 7} 45. Qg4 Ra3 {
(Re3a3 Qg4d1 Be8d7 Qd1h5 Qf7xh5 Nf4xh5 Kg8f7 Nh5xg7 Kf7xg7 e7e8Q Bd7xe8 Re6xe8
Ra3b3 Re8e4 Kg7f7 g3g4 Rb3a3) +0.08/132} 46. Ng6 Ra4 {
(Ra3a4 Kh2h3 Ra4a1 Ng6f8 Ra1b1 Bg2f3 Rb1b2 Bf3e2 Rb2d2 Qg4c4 c7c6) +0.25/12 2}
47. Nf8 Bc5 {(Bb6c5 Re6e4 h6h5 Qg4f4 Bc5b6 Qf4d2 Ra4a1 Re4e1 Ra1a3 Qd2c1 Ra3a8
Qc1c4 Be8a4 b4b5) +0.08/14 2} 48. Re4 Bb6 {
(Bc5b6 Qg4g6 Qf7xg6 Nf8xg6 Ra4a3 Bg2f1 Ra3e3 Re4xe3 Bb6xe3 b4b5) -0.19/15 4}
49. Bf1 c6 {(c7c6 d5xc6 b7xc6 Qg4d1 d6d5 Qd1xa4 d5xe4 Nf8g6 e4e3 Qa4a8 Bb6c7
Bf1c4 Qf7xc4) +0.01/13 4} 50. dxc6 bxc6 {(b7xc6 Qg4d1 Qf7a2+) 0.00/14 3} 51.
Qd1 Qa2+ {(Qf7a2+ Re4e2 Qa2a1 Qd1xd6 Qa1xf1 Qd6e6+ Kg8h8 Nf8g6+ Kh8h7 Ng6f8+
Kh7h8) 0.00/14 1} 52. Re2 Qa1 {(Qa2a1 Qd1xd6 Qa1xf1 Qd6e6+ Kg8h8) 0.00/16 1}
53. Qxd6 Qxf1 {(Qa1xf1 Qd6e6+ Kg8h8 Nf8g6+ Kh8h7 Ng6f8+ Kh7h8) 0.00/16 2} 54.
Qe6+ Kh8 {(Kg8h8 Nf8g6+ Kh8h7 Ng6f8+ Kh7h8) 0.00/19 1} 55. Ng6+ Kh7 {
(Kh8h7 Ng6f8+ Kh7h8) 0.00/23 1} 56. Nf8+ Kh8 57. Ng6+ Kh7 {
(Kh8h7 Ng6f8+) 0.00/24 0} 58. Nf8+ Kh8 {3-fold repetition} 59. Ng6+ {
3-fold repetition} Kh7 {(Kh8h7 Ng6f8+) 0.00/26 2 3-fold repetition} 1/2-1/2

13... Bb6?? Unneccessary. another comp like waiting move.

Hint: Qd7.

21.If some areas in the opponent's territory is unoccupied, place your piece there. It gives pressure on surroundings.

Hint: Qb2 - pawn on a3 and space.

30. Hint: Qf6. Queen trade is not bad. Ending looks good for black despite the doubled pawn and white's e6 passer. Queen side plus.

32. Bb6 better than Ba7. Two moves may look similar.

But Bishop on b6 Supports the c7 pawn and makes way for the rook.

42. + -. Key mistake. In Infinite analysis mode, the engine seems to see what the mistake that is. It takes a while to realize that it is indeed a mistake.

I will try to play more games as soon as the engine tournament is finished.

Code: Select all

   Engine               Score      Le
1: LemmingSwami0.30x32  21.0/37 ······ 
2: Movei00_8_446        4.0/6   1==011 
3: Aristarch 4.50       3.0/6   011100 
3: Pro Deo 1.6          3.0/6   010==1 
3: GarboChess2.20       3.0/5   01011  
6: RomiChessP3k         2.0/6   0=00=1 
7: Hamsters_Extreme 0.7 1.0/2   10     
8: ZCT 0.3.2447         0.0/6   000000 

37 of 42 games played
Name of the tournament: Lemming
Site/ Country: WELCOME-D2B6707, United States
Level: Tournament 40/40 40/20 40/10
Hardware: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz4x  2400 MHz with 2,032 MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: H:\Arena 1.99 beta 5\Tournaments\Lemming.pgn
Website: 
E-Mail Address: