Dragon by Komodo Chess

[lkaufman]

Larry/Mark, in the Dragon UCI options it appears you can specify an nnue network. Do you use the same architecture as SF. Meaning, could I specify a SF network and have dragon work properly?

OK, I ran a test of a SF net from around the time of SF12 release (net 1705) running in Dragon vs. Dragon with its own embedded net. The SF net lost by 244 elo after 2200 bullet games. So it was still playing very strong chess, better than 99% of engines, but way below its true strength. So I guess the answer is, it works decently but not properly.

[lkaufman]

Since Komodo: Dragon (more natural to say) is all the talk when it comes to NNUE and one of the best it seems, I want to ask this...not just specifically of Dragon (we both have older Komodo engines), but NNUE in general.

A friend of mine called me last night to ask about a an idea he head in an opening he was preparing and we naturally wondered what an engine might think. Then he asked about these new breed of engines: "how do these engines actually chose a move"?

I gave a shamefully basic overview of the history of NNUE development and then realized...I could not actually with any great confidence how they actually do this in a given position! I said I would check with some people who know; but my initial thoughts were...lets say on a rare position on move 14 of any opening :

1. It looks for that specific piece positioning (pawn structure?) in a quick search of its NNUE file. If found, it takes the weights assigned to that position....and starts analyzing with those from there.
2. If the position is completely novel (or heavily in favor of one side)...it uses the A/B search and its evaluation function and calculates from there.

Again, that may be very off the mark. Could someone correct that if wrong with so very 'non-tech' words.

No, that's not at all right. It searches thru possible variations in just the same way as a normal A/B engine, but when it comes time to evaluate the terminal position of a line, it uses its NN to evaluate the position based on the weights it assigns in similar positions, rather than evaluating based on arbitrary rules. This has the huge advantage of "knowing" which features of a position are likely to be important and which are not. Standard chess engines evaluate things like pawn structure, king safety etc. based primarily on the stage of the game, but a NN can consider many details of the position in deciding how much weight to give to a backward pawn or an exposed king, for example. There are some situations where the NNUE engine will skip doing the NN eval, but that's a minor detail.

[mbabigian]

OK, I ran a test of a SF net from around the time of SF12 release (net 1705) running in Dragon vs. Dragon with its own embedded net. The SF net lost by 244 elo after 2200 bullet games. So it was still playing very strong chess, better than 99% of engines, but way below its true strength. So I guess the answer is, it works decently but not properly.

Yikes. 244 Elo is definitely not "properly." Good to know the two are not compatible before I started experimenting.

Thanks for the quick reply,
Mike

[Cornfed]

Since Komodo: Dragon (more natural to say) is all the talk when it comes to NNUE and one of the best it seems, I want to ask this...not just specifically of Dragon (we both have older Komodo engines), but NNUE in general.

A friend of mine called me last night to ask about a an idea he head in an opening he was preparing and we naturally wondered what an engine might think. Then he asked about these new breed of engines: "how do these engines actually chose a move"?

I gave a shamefully basic overview of the history of NNUE development and then realized...I could not actually with any great confidence how they actually do this in a given position! I said I would check with some people who know; but my initial thoughts were...lets say on a rare position on move 14 of any opening :

1. It looks for that specific piece positioning (pawn structure?) in a quick search of its NNUE file. If found, it takes the weights assigned to that position....and starts analyzing with those from there.
2. If the position is completely novel (or heavily in favor of one side)...it uses the A/B search and its evaluation function and calculates from there.

Again, that may be very off the mark. Could someone correct that if wrong with so very 'non-tech' words.

No, that's not at all right. It searches thru possible variations in just the same way as a normal A/B engine, but when it comes time to evaluate the terminal position of a line, it uses its NN to evaluate the position based on the weights it assigns in similar positions, rather than evaluating based on arbitrary rules. This has the huge advantage of "knowing" which features of a position are likely to be important and which are not. Standard chess engines evaluate things like pawn structure, king safety etc. based primarily on the stage of the game, but a NN can consider many details of the position in deciding how much weight to give to a backward pawn or an exposed king, for example. There are some situations where the NNUE engine will skip doing the NN eval, but that's a minor detail.

Exactly the kind of explanation I was hoping for - Thanks!

[mwyoung]

Still about 80 points behind a similar current Stockfish. Not bad.

At 5m+5s on a 32 thread 2950x. Dragon is doing much better then 80 Elo. Very good for the first release of Dragon.

Mark L. asked my to change the default setting for hash memory from default. I do not know if this changed the results. Default was 64, and was changed to 512. The suggested best setting for this many threads.

Here is the results playing the best Stockfish.

Dragon by Komodo Chess vs Stockfish 101120 (TC=5m+5s)

With 198 games played so far. Dragon vs Stockfish 101120 +6 =172 -20. 46.5% TP = -25 Elo.

Live Stream

End of match

Code: Select all

DESKTOP-CORSAIR, Blitz 5.0min+5.0sec  0

                                         
1   Stockfish 101120                +31  +35/=263/-8 54.41%  166.5/306
2   Dragon by Komodo Chess 64-bit   -31  +8/=263/-35 45.59%  139.5/306

[MikeB]

Larry,

I saw in the notes, you will have a K14 for the Android soon, any chance of seeing a Dragon for the Android?

MikeB

[lkaufman]

Larry,

I saw in the notes, you will have a K14 for the Android soon, any chance of seeing a Dragon for the Android?

MikeB

I haven't talked to our Android guy about this yet. I don't think it will happen soon.

[Werewolf]

Any news on a Komodo for iOS?

[Mars]

Speaking of SF NN: Comparing the two in their playing styles, can someone pls shed some light on the differences? Assuming Dragon being trained on an own, presumably handcrafted collection of games, does it play more positionally sound in quiet/equal positions than SF? Potentially at the cost of a slightly weaker search? Any opinions regarding their respective playing strengths and weaknesses, compared to each other?
Thx, Martin

[JJJ]

I would like to see penguin against Komodo at Bullet. It would be great !