geots wrote:5 more games finished and we are at the 39 game mark. Komodo 5.1r2 has managed to stretch his lead to 3 games, but with 61 games still to play I am not going to over-emphasize the meaning of it. Tho any lead is better than no lead at all. The million dollar question, with this dev. version of Stockfish being between 35 and 50 elo stronger than the last official Stockfish release- is just exactly how high can they go with elo increases. Well, enough talk and now to the update:
Alienware AURORA_R4 Intel i7 w/6 True Cores
Factory overclocked
Fritz 11 gui 6 Cores each/64bit
256MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 2012b.ctg w/12-move limit
40/19 Repeating- benchmarked to adapt to 40/40 Match=100 games
Paul, some nice work you have done. I only have one issue with it. Time controls such as the one you used here are fine, and they tell a programmer a lot about his engine during the beta testing process. He needs to get as many games as he possibly can. The problem is, there are a handful of engines that play much, much better at longer controls like 40/40 repeating or even the longer controls that FIDE uses. And Stockfish and Komodo are the 2 leaders in that respect. I know no engines that increase in strength with the longer controls anywhere close to the way Komodo and Stockfish do. The other that would come to mind that might be close to them is Deep Rybka 4.1. It too benefits greatly from the longer controls.
Again, there is not one thing wrong with your controls and your work. It just so happens that you are honing in on Stockfish in your tests- and for the reasons I gave- if you would use longer controls you would get a much better idea of the quality of play that Stockfish possesses. Just a thought you might consider.
All the best to you,
gts
George,
I understand about longer time controls, but in this case it is all the same engine (Stockfish) so ultra fast is fine to test the versions against each other to see which is better for selecting the version to put into a longer time control match like yours.
I do know that both Komodo and Stockfish are not as good at blitz or better when competing against lets say Houdini or other very strong engines.
I am not saying everyone agrees with me, but for me, I put no validity whatsoever in the results between engine versions from the same family. That is why I never run them against each other. Not even once. I am just not comfortable with the results.
We Have 67 games behind us, leaving 33 more to be played. Komodo has not increased his lead, but Stockfish has not been able to make a dent in it yet. And he may be beginning to run out of time. Stockfish was not "lucky" to beat Houdini, IMO. He has a style of play that Houdini cannot figure out how to handle. Komodo seems to do better with it. Another issue- this Stockfish dev. version was created on the 29th of June. If there are any stronger out there now, I wonder which ones and by how much. At any rate.......................
Alienware AURORA_R4
Intel i7 w/6 True Cores
Factory overclocked
Fritz 11 gui 6 Cores each/64bit
256MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 2012b.ctg w/12-move limit
40/19 Repeating- benchmarked to adapt to 40/40 Match=100 games
geots wrote: Another issue- this Stockfish dev. version was created on the 29th of June. If there are any stronger out there now, I wonder which ones and by how much. At any rate.......................
]
geots wrote: Another issue- this Stockfish dev. version was created on the 29th of June. If there are any stronger out there now, I wonder which ones and by how much. At any rate.......................
]
This was answered in my post.
No offense meant, Paul. But it was not answered in your post, as you will see if you reread mine.
I am afraid Stockfish has run out of time. At game 51- Komodo had a 4 game lead. At game 90- Komodo has a 4 game lead. Nothing has changed. Komodo cannot run away from him, but Stockfish cannot close the gap. They have played dead even for the last 40 games- but unfortunately that doesn't help Stockfish. To make up 4 games in the last 10, well..................................
Alienware AURORA_R4
Intel i7 w/6 True Cores
Factory overclocked
Fritz 11 gui 6 Cores each/64bit
256MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 2012b.ctg w/12-move limit
40/19 Repeating- benchmarked to adapt to 40/40 Match=100 games
This match is now completed and we definitely have a winner- no drawn match. As soon as the info can be coded and filed, the FINAL results will be posted right here. We are probably looking at the next hour or so- give or take a little.
The match is completed and once Komodo got a 3 game lead, he never let Stockfish close the gap. He carried a 4 game lead thru most of the 2nd half of the match, and in the last stages managed to increase that a slight bit.
I think we really have a perfect scenario here, with a match between Houdini 3 and Komodo 5.1r2. Houdini wins, then he is back at No.1 where most think he belongs anyway. OTOH, if Komodo can beat Houdini 3, that will help cement his place as No.1. Which would certainly be more credible than slapping a No.1 sticker on Hiarcs or Deep Junior. At any rate, to the games................
Alienware AURORA_R4 Intel i7 w/6 True Cores Factory overclocked
Fritz 11 gui 6 Cores each/64bit
256MB hash
Bases=NONE
Ponder_Learning=OFF
Perfect 2012b.ctg w/12-move limit
40/19 Repeating- benchmarked to adapt to 40/40
Match=100 games
Thanks for running such long slow time-control matches, George. Would it be possible to post the pgn as well if you get the chance? I'm sure some mighty strong chess was played. Much appreciated!
carldaman wrote:Thanks for running such long slow time-control matches, George. Would it be possible to post the pgn as well if you get the chance? I'm sure some mighty strong chess was played. Much appreciated!
Thanks,
Carl
Thanks for your interest Carl. Happy to make them available to you. 2 things to be aware of. I have never understood, but when you stop an engine-engine match in a chessbase gui, in the database the games still read 1-100. But in the PGNs, every time you stop and restart, it goes back to 1. I stopped maybe 3 times I believe- so in the PGNs it will show Round 1, 3 times and go from there. Other than that- it really doesn't matter, because there are a total of 100 games. When you restart, you just have to be sure you have the correct engine playing the white pieces. And also, I will admit I have not taken the time yet to check every game. I checked over half of them- but if you see anything wrong please alert me to it. The link:
