Throwing out draws to calculate Elo

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Throwing out draws to calculate Elo

Post by Dann Corbit »

hgm wrote: Thu Jul 02, 2020 7:44 pm It is not trivial to do measurements at the 0.1% accuracy level. There are many issues that could potentially have an effect of that magnitude.
Are you quoting me? I believe I have said that very same thing in this thread.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
hgm
Posts: 27795
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Throwing out draws to calculate Elo

Post by hgm »

Dann Corbit wrote: Thu Jul 02, 2020 7:52 pm Another interesting factor is that the Elocalc output shows that the engines have the same Elo within the confidence interval.
Not really: it is at the very edge of the confidence interval. So one could just as well say the Elo calculation proves with confidence that one engine is stronger than the other.

Of course this is to be expected, as the confidence interval quoted by the Elo calculation is the 95% interval (i.e. 2 sigma) for two-sided error bars, i.e. 97.5% for one-sided excess. Which is exactly the LOS.

In other words, you are only within the eror bars because they were quite generous (95%) error bars. And the more generous the error bars are, the less it means to stay within them. Accepting error bars this large is tantamount to saying "I don't care is the result suggests with 97.5% confidence that A is stronger than B; I will still consider them the same in that case". But that should then apply to the LOS as well, or you are comparing apples and oranges. A LOS of 97.5% means the result is not conclusive enough for you, if you accept such large error bars on the calculated Elo.
Dann Corbit wrote: Thu Jul 02, 2020 7:53 pmAre you quoting me? I believe I have said that very same thing in this thread.
No, this is all well known to engine testers. See earlier discussions with Bob Hyatt some 10 years ago.
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Throwing out draws to calculate Elo

Post by Dann Corbit »

It is true that my result is rather unexpected (especially after only 14,000 games), but if I had let the games run all the way to 100,000 as I had originally intended, the LOS value would have been very close to either 0 or 1 as Ajedrecista proved in his analysis.
Edit: Last night, when I went to sleep, it was not as lopsided. I was surprised this morning when I took a look at it.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Ajedrecista
Posts: 1968
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Throwing out draws to calculate Elo.

Post by Ajedrecista »

Hello Dann:
Dann Corbit wrote: Thu Jul 02, 2020 7:23 pmI think this analysis is pretty good. Like I said, long matches destroy LOS.
Now, here is the burning question:
In a short, N game match, do you trust LOS since there is randomness in the outcome of chess games?
IOW, is there any reason to believe that the accuracy of wins, losses and draws of a ten game contest is higher for a LOS calculation than for an Elo calculation?
Thank you. I would say something that has been said before: LOS purpose should be for compare engines that we know that are different, not exact copies: Ctrl+C, Ctrl+V and rename the last one. You are watching dispersion, which is explained with the concept of standard deviation. If you flip a balanced coin twice, the most probable outcome will be one head and one tail (whatever the order of them), but it is not the only possible result! More probable does not imply uniqueness. The same when the number of coin tosses raise, already explained in my statement c).

Answering your questions: you can not conclude anything from short matches ('short' should be defined). Elo measure is fine but it is not an standalone measure: it comes with error bars, which are proportional to 1/sqrt(n) at first approximation. I mean, it is not the same to measure +40 Elo (some info missing from my POV) that with a given confidence level (for example 95%) you measure +40 ± 100 Elo or +40 ± 4 Elo. LOS is related with these error bars using scores instead of Elo:

Code: Select all

Using a trinomial distribution with:

W = wins/games
D = draws/games
L = loses/games

W + D + L = 1

Score = µ = W + D/2

Sample standard deviation = s = sqrt{[µ*(1-µ) - D/4]/(n - 1)}
D = 1 (100%) would bring s = 0: there is not dispersion in the sample. The same with µ = 0 (0%) and µ = 1 (100%), which represents L = 1 (100%) and W = 1 (100%), respectively.

Lower bound and upper bound of scores are µ - z*s and µ + z*s with a given confidence level represented by z (for example, z ~ 1.96 for 95% confidence level in a two-sided test).

If µ > 0.5:
Looking for superiority: lower bound = µ - z0*s > 0.5 (score > 50% --> Elo > 0).
z0 < (µ - 0.5)/s
LOS = Prob.(z < z0) = Prob.[z < (µ-0.5)/s] > 50% (one-sided test).

If µ < 0.5, one should search µ + z0*s > 0.5; z0 < -(µ - 0.5)/s; LOS = Prob.(z < z0) = Prob.[z < -(µ - 0.5)/s] < 50%.
Finally, I get +3.91177 Elo in your +3085 =7932 -2928 match instead of your +2.49297. LOS value looks fine. Although I want to advise: if you are measuring Elo with a fixed game match, never stop it before the match is finished or you will introduce a bias. Disgracefully, I can not prove it due to my limited statistics skills, but someone smarter can.

Regarding 'the engines have the same Elo within the confidence interval', well... if you have a measure of +x ± x Elo with 95% confidence (rounding of first and second x should be taken with care), then LOS = 0.5*(1 + 0.95) = 0.975 = 97.5%.

------------

@HGM: I get a sample standard deviation of 0.2780% from those 13945 games, which is in line with your 0.277%. Otherwise, I do not see anything wrong with z ~ 2.02 in a single trial... other thing is if it would have been |z| > 40. The wrong thing is stopping the match before it finishes: first design a size, then run it until the end. Otherwise you bias the result stopping when things are temporarily good or bad, just a sort of cherry picking.

Regards from Spain.

Ajedrecista.
Last edited by Ajedrecista on Thu Jul 02, 2020 8:32 pm, edited 6 times in total.
User avatar
hgm
Posts: 27795
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Throwing out draws to calculate Elo

Post by hgm »

Dann Corbit wrote: Thu Jul 02, 2020 8:20 pm It is true that my result is rather unexpected (especially after only 14,000 games), but if I had let the games run all the way to 100,000 as I had originally intended, the LOS value would have been very close to either 0 or 1 as Ajedrecista proved in his analysis.
Edit: Last night, when I went to sleep, it was not as lopsided. I was surprised this morning when I took a look at it.
No, why do you think that? For equal engines you expect the LOS to randomly fluctuate in the range 0.16-0.84 (i.e. between 50% +/- one standard deviation), only occasionally moving out of that interval, no matter how many games you do.
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Throwing out draws to calculate Elo

Post by Dann Corbit »

hgm wrote: Thu Jul 02, 2020 8:24 pm
Dann Corbit wrote: Thu Jul 02, 2020 8:20 pm It is true that my result is rather unexpected (especially after only 14,000 games), but if I had let the games run all the way to 100,000 as I had originally intended, the LOS value would have been very close to either 0 or 1 as Ajedrecista proved in his analysis.
Edit: Last night, when I went to sleep, it was not as lopsided. I was surprised this morning when I took a look at it.
No, why do you think that? For equal engines you expect the LOS to randomly fluctuate in the range 0.16-0.84 (i.e. between 50% +/- one standard deviation), only occasionally moving out of that interval, no matter how many games you do.
Because of this:
b) Since LOS can be related with z-score, which can be proportional to sqrt(n), which tends to infinity, z-score tends to ±infinity and LOS tends to 0 or 1.

This is the conclusion of Ajedrecista, backed by careful analysis.
Now, I can see why you do not believe me, since I apparently fail to grasp simple mathematical concepts like trichotomy (as multiple attempts to teach me seem to have not had the desired effect). But I know math well enough to follow someone else's work.

Incidentally, Ajedrecista is right that stopping the games short introduced a bias. It wasn't evil intent on my part, I simply wanted the cores to analyze 404 candidate mate positions for a test set that I am building.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Throwing out draws to calculate Elo

Post by Dann Corbit »

Dann Corbit wrote: Thu Jul 02, 2020 8:33 pm
hgm wrote: Thu Jul 02, 2020 8:24 pm
Dann Corbit wrote: Thu Jul 02, 2020 8:20 pm It is true that my result is rather unexpected (especially after only 14,000 games), but if I had let the games run all the way to 100,000 as I had originally intended, the LOS value would have been very close to either 0 or 1 as Ajedrecista proved in his analysis.
Edit: Last night, when I went to sleep, it was not as lopsided. I was surprised this morning when I took a look at it.
No, why do you think that? For equal engines you expect the LOS to randomly fluctuate in the range 0.16-0.84 (i.e. between 50% +/- one standard deviation), only occasionally moving out of that interval, no matter how many games you do.
Because of this:
b) Since LOS can be related with z-score, which can be proportional to sqrt(n), which tends to infinity, z-score tends to ±infinity and LOS tends to 0 or 1.

This is the conclusion of Ajedrecista, backed by careful analysis.
Now, I can see why you do not believe me, since I apparently fail to grasp simple mathematical concepts like trichotomy (as multiple attempts to teach me seem to have not had the desired effect). But I know math well enough to follow someone else's work.

Incidentally, Ajedrecista is right that stopping the games short introduced a bias. It wasn't evil intent on my part, I simply wanted the cores to analyze 404 candidate mate positions for a test set that I am building.
And in case you think I am not being truthful about the 404 mate positions, here they are:

Code: Select all

3R2Kn/5P2/Rp2p1pb/1np4p/1kP5/2p1p2r/B1p1NrbB/8 w - -
k3b2q/1RK1pnQ1/1Pnp3r/6R1/8/2N5/8/r7 w - -
1kr3n1/pp1R2NR/2p2p2/Q1NppPb1/8/8/1r2q1P1/6K1 w - -
1R6/1n1bp1p1/2k3p1/2np4/8/rq1NQ1BP/7K/8 w - -
2k1rr2/ppp3p1/7n/2N1p3/2Q5/2PP3p/1P1q3P/R4R1K w - -
4N3/K1p1p3/p7/2kBB1br/P1P1ppb1/P4p1n/8/3N4 w - -
5r1q/3Nppnb/1R1p4/3k1pr1/pp4p1/2PP4/2PP4/3KR1n1 w - -
6nB/3Q4/4p1b1/3Np3/1p1kN3/1n3p1P/6PK/q4r2 w - -
6rn/6N1/4Q1pp/pr2p1kp/1b4p1/2p3P1/3pnBP1/K2b4 w - -
7n/5pbp/3Q4/N3rk1K/b3ppN1/4pr1n/4B3/8 w - -
8/1ppK3b/5Bp1/3k1PP1/N2p1RN1/2bP3p/5p2/5n1q w - -
8/8/1p3p2/1p6/1p6/1B1NpK2/2npp3/3kb2R w - -
8/8/3r4/3p1p2/2pNB3/1p2Bp2/kp4b1/bN1K4 w - -
r1bqr1kb/3npp2/p2p2pB/1ppP4/4PQ2/2N3PB/PP3PK1/n6R w - -
r1n5/r7/R2p3B/3Pk1K1/3pP3/bRp2Pp1/7p/1N6 w - -
r6k/2p3pp/r1qn4/5n2/3p3N/5NP1/BQ6/KR1R2B1 w - -
rn3b2/3p1N2/4p1N1/4PkPK/p2B1PpP/1PPPRp1b/3n1p2/5r2 w - -
2n4k/6R1/3p1B1p/Kbp5/p5N1/3p3r/8/8 w - -
4r1b1/1rp1P3/q1p1k1P1/1pB3P1/1P3P2/p6p/8/3Q1K2 w - -
4r3/4Rb2/1pR1pp2/1P1pkpbn/p4p2/Q1K3n1/N1P3rq/2B4B w - -
5n2/1n2p3/4p3/7B/N1p5/b1rk1P2/q1p1pBRN/2rbK1R1 w - -
7k/4q1pp/4N3/2rBNQn1/4R3/4n3/4r3/K7 w - -
8/2r3n1/Q6p/8/3p1PP1/1P2n2K/Npk1p3/1N6 w - -
8/3p2n1/N4b2/1K1kPn2/7N/2PP4/p4B2/8 w - -
b7/1nK1Np2/pp2kp1r/2p2N2/3p1B2/1P5R/n7/3Bb2r w - -
br2N3/1Bp2rp1/1p3b1B/3ppPp1/4PkP1/2P4P/2P2K2/2N5 w - -
K6n/1BR1p1N1/1P1kP1br/3pnp1q/p1pP4/r6p/P4B2/2b5 w - -
KNk4b/R4p2/2p2p2/B1p2P2/1p1p4/8/2r3b1/4r3 w - -
6r1/1Q4p1/8/8/8/3Np3/4K2p/2bB2k1 w - -
7k/5K2/2p1p1PB/1bPP3p/p2b4/5R2/1pp1nP2/qn6 w - -
k7/1pK1p3/pPP5/BP2R3/5P1b/1b3P2/4p3/2r5 w - -
Qn6/1p3qP1/1kpp1p2/p1NPpK1p/5R2/2r1Pn2/b1PnB3/r1b5 w - -
r1rn2k1/4Qbpp/2p5/pp2B1N1/3b2PP/Pq6/1P2BR2/K3R3 w - -
r4rq1/5p1p/p5kn/1RB1Q1b1/6p1/5p2/PNP2P2/1K6 w - -
r5kr/6p1/p7/4p1N1/5pnq/8/1RBR1Qn1/3b1K2 w - -
1q4k1/1pnb3p/1P1pp1p1/r2P4/p3PQ2/6P1/1P3R1P/6K1 w - -
2b4k/p1b5/2p2q2/3p1PNp/3P2R1/3B4/P1Q2PKP/4r3 w - -
2R5/p7/8/3bpp2/2p2p2/5p2/5K1p/7k w - -
3q2kr/R1p2p1p/Bn1N1p1B/3bp3/6N1/4p2K/1R5P/2r5 w - -
8/8/6K1/8/5pp1/1p3p1n/1Q1ppppn/r2kbqrb w - -
8/p4K2/b7/3N4/kBpNRp2/6b1/2P2pr1/4R1r1 w - -
r1bqkb1r/ppp4p/2n2nN1/7Q/2BPp3/8/PPP2PPP/R1B1K2R w KQkq -
rn2Rb2/pp3k1p/5pp1/2pP1b2/2q2B2/2P1QN2/PP3PPP/6K1 w - -
2n1K3/4b3/3p2p1/3Q1Ppk/2ppbP2/2n3PP/5BP1/5q1r w - -
2nB1k2/2p3pp/3p2p1/n2K4/3Qp1N1/1Np4R/rb1p4/1Rq3r1 w - -
2r3k1/p1q2p1p/1p2p1p1/4P1B1/3r2P1/b1n1R2Q/P4P1P/1B2R1K1 w - -
3B2N1/1p4b1/2p2p2/4p2Q/6p1/3K4/p1p5/2k5 w - -
3n2K1/3p4/3BkN1p/1P2P3/3p3P/1Pbp1pN1/4p1b1/4nr2 w - -
3nq2r/p2k4/3pp3/B4pp1/P1Pp2n1/1Q4P1/4PPB1/5RK1 b - -
5r2/8/8/6PN/3Q4/1K3ppp/4prkb/4Bbnn w - -
7r/1Q5p/p2k1pb1/2r3q1/3N4/BP5P/5PP1/6K1 w - -
8/7p/b4ppk/1p1Rn1N1/4PR1B/2p3P1/p4P1K/n1r5 w - -
R1n4k/n1p5/1b2pN1P/2p4p/2P4p/p1p1p3/P1P1P2P/7K w - -
r3r1k1/1p1q1pp1/p1pb4/6Np/3PR2P/PP1Q2P1/1B3PK1/8 w - -
r3r1k1/pP1q1p2/2p2npb/1PPp4/3PpN2/2N1PpP1/1R1B1P1K/3Q1R2 b - -
r7/5p2/p1Kp2k1/3R3p/p5p1/6Q1/1Bp1r1PP/6q1 w - -
1K6/p1p5/8/8/6p1/6pp/4Nprr/B4Bbk w - -
2krr3/pp3ppp/1qn5/8/QPP5/3bPN2/1P1N1PPP/R1B1K2R b KQ -
2R5/4kn2/pp1ppp2/8/P4bQq/2p1N3/n1B4r/5K2 w - -
4r1k1/p4ppp/3B4/2P5/8/4nP2/PQq3PP/1R4K1 b - -
4R3/8/8/2R5/6BK/3p4/pp1k4/rrb5 w - -
6r1/1p3pk1/2p1p3/3NP2Q/2PR1P2/2P3Pb/1bKB4/q6r w - -
7k/p1p4P/2P2p1K/B4P2/P2N4/5PPp/4p3/8 w - -
7n/q1PN2p1/1n4k1/6P1/p6P/1p2NRpK/1r1p2R1/2b5 w - -
8/3P3P/1B3p2/7p/6pk/8/1pp2K2/8 w - -
r7/ppp1p3/2kp1B1q/3R1Q2/8/2pP4/P1K5/8 w - -
1k4r1/1p3b1r/1Pppp1p1/4PPbq/7n/5P2/2P3PP/RRR3QK w - -
1K4R1/B7/7p/5pn1/7n/6p1/5ppb/1R2Qqkr w - -
2kr3N/pppn2pp/8/3Ppq2/Q1BP2b1/8/PP1P2PP/RNB3KR b - -
2N4k/p2p2pb/4P1p1/4n1N1/8/8/7K/8 w - -
3B3r/5k1B/5P2/7K/8/5pp1/8/4Rn2 w - -
3r3k/1p1bb2p/1Pp2n2/P1Pp4/NQ1Pp3/1QB1PpPr/2N2P2/2R2RK1 b - -
4n3/3R1pk1/p3p1n1/1qr1P1Q1/1p5P/1P4P1/5PK1/3R4 w - -
4Nr1k/p4P2/2Rpq2r/4b1Q1/4P3/7p/5PP1/1R4K1 w - -
5nqb/3p1krr/1N1Pp1bn/4Pp1p/5PpP/1K4P1/8/R7 w - -
6bn/5p2/5Pp1/6P1/6K1/n5p1/rb1N2P1/k1nRN3 w - -
6k1/1pp3B1/3NbPpK/1B6/2P2Pp1/1p2p3/rp1PP3/4b3 w - -
6R1/8/5p2/5N2/5P2/4PkNp/4p1pr/B3K1nr w - -
7k/2pK2pp/2R4P/5P2/7B/4P2P/3pR3/3q4 w - -
7k/3K1bpp/3Bpp2/5N2/3p4/8/5p2/R5b1 w - -
7n/3P4/n2K2kp/2p4N/Bb6/2p1p1P1/8/8 w - -
7Q/3k1q1P/4p3/n1p1P3/p1Pp4/P2P2P1/5r2/4R1K1 w - -
8/2r5/8/NP6/6Q1/ppp3K1/bkrp4/nnbB4 w - -
8/B1p3Kp/2N4p/7P/p7/rkpP4/qprpP3/nbQB4 w - -
8/pP6/kpP3p1/brpPb1p1/1pP1PbP1/1P6/K5P1/8 w - -
k7/6pr/8/4P3/4K3/P4R2/ppppPpQ1/5r2 w - -
krb5/pr1p1p2/3P1p2/3B1P2/2K5/8/3B4/8 w - -
r2r2k1/6p1/3p2B1/2b5/1p4p1/q5p1/6K1/Q3R2R w - -
1K1N1b2/pp1R1p2/6p1/5np1/4k3/2r1Pp2/p1pR1P1P/5N2 w - -
3qr3/1p1pB2p/1P1P4/Pnb2B1N/p5P1/r1p1kN2/P3P3/5K2 w - -
7n/3P2k1/n2K3p/2p5/Bb3N2/2p1p1P1/8/8 w - -
8/5N2/3p1p2/pPpk1K1B/q7/2Pp4/3P4/8 w - -
8/p7/8/8/7P/1pk4P/P1P5/1K1Qbq1N b - -
r2b4/B7/n7/8/7p/p3QKpR/2ppn1P1/2qb1k2 w - -
r6r/3bkBp1/3q2P1/2Q5/4P3/8/P5PP/5RBK b - -
1qr2bk1/p4p1p/1p2pBn1/3pP1Q1/PP1P4/5NPB/2b2PK1/7R w - -
1r4r1/3q1npk/2b1pbnp/Rp1p4/1N1P3P/2PQ1pP1/1K3B2/5B1R w - -
2k5/3p4/1PpK4/pp1P1P1P/1p6/7p/8/8 w - -
2kr3r/pppb1ppp/B4q1n/n3p3/8/B1Q2N2/P4PPP/1R2R1K1 w - -
3K4/r4p2/2b5/5R2/2k5/3N3R/2pppp2/3Nr3 w - -
3nK3/3p4/pn1Npb2/k7/P3p3/P1p5/1N6/4B3 w - -
7k/B6p/6pN/4K3/B2p4/3pp3/3p4/2b5 w - -
8/3p4/2prp3/2pbPp2/2p1pP2/2P1N3/p5R1/rk1K4 w - -
8/8/1p4p1/p5kp/Pp1QP1Pq/1P6/6K1/8 w - -
1bN1r3/2pp4/P7/kP2n3/P7/1K6/8/6B1 w - -
1q3n1k/2N5/P1p2N1p/2Kp3p/pp6/n3p3/8/4Q3 w - -
2K5/1p6/1P2p3/4P3/B5P1/p7/rp4pp/bR4nk w - -
2R1K3/k2p1p2/p2p4/4p1B1/2p4p/r1r2B2/PNb1Ppn1/n1N1b2q w - -
8/K1R5/8/pkpN4/p1p2p2/n1p5/P1P1Pb2/1r6 w - -
8/p1p1p3/P1P1P1P1/5Kp1/8/3p3p/3P1ppr/3R1nkq w - -
R7/P7/1p6/5p2/1p6/p4pn1/2KP4/k7 w - -
1k1qBQ1n/p1p4p/1PK5/7p/8/8/P7/8 w - -
4N3/p3p3/8/P5p1/6Pn/1BP4k/1Q2Kp1p/4b3 w - -
4r1k1/p4ppp/1p1Bb3/3NP3/7Q/7P/q1P3PK/8 w - -
5R2/8/8/p3k2p/P5p1/1Pp3Pr/2P1p1KP/8 b - -
8/4B3/4Q3/1p6/4N1N1/4K3/1ppppppp/4k3 w - -
8/p1BP1k2/8/6pp/5p2/6PK/2r4b/3R4 b - -
8/p2q4/5Q2/p2pp3/p1pQ1K2/2p2b2/1N1N1n1p/2B4k w - -
8/Pk6/1P6/3p4/3Pb3/2p1K2p/4B3/8 b - -
r3k2r/ppp2Npp/8/3Bpb2/2Kn1q2/2P5/PP1P2PP/RNBQ3R b kq -
R7/2p5/1b3K2/2B4k/8/3P3n/3PppNp/5r2 w - -
1kNB3n/1P3n2/K1Bp3p/2ppP3/p1p5/N4p2/8/2rr1qb1 w - -
1r1bn3/8/3p4/3pp3/p2pk1Pp/1p3NpP/1PPBK3/1R5n w - -
5R2/7P/P1p2N2/2p2kpp/K1P1N1pr/p3n2p/qp1nP3/r2R4 w - -
7r/3r1kpp/q2p4/3p2p1/8/1pQ1R1PP/2p4K/6R1 w - -
8/1P1p1p1p/3P1P1P/1pK5/P7/Pp2p3/bpp1P2P/nkb4R w - -
8/B3p3/3p2K1/1P1k2N1/4p2P/1pR2P2/3p1pNr/q7 w - -
QK6/p2P4/pk1P4/1p6/P6b/2P5/1p2q3/N3r3 w - -
1r6/1pPp1pBp/1P1P1P1P/1K6/4p3/P7/ppp1P2P/qkn4R w - -
2r2k2/p2q2b1/2b2Np1/2p5/2B1PP2/1P4P1/P7/6KQ w - -
3K1R2/6p1/8/4B1p1/6pb/6pr/6kp/7b w - -
5B2/7p/1Nr5/2P1P1P1/p6p/k1Pb4/2P5/K7 w - -
7R/3r4/1P3P1p/kP2p1p1/7p/K7/1P3P2/8 w - -
8/6PK/2Q2P1P/8/1P6/1p1r3p/2Rp4/1k4q1 w - -
8/qp1N1bn1/3p4/Bn1p2R1/3pp2k/6R1/1pp1KP2/8 w - -
b2Nn2q/rBn3p1/6Rr/kpp3R1/1b2Q3/1p4B1/1K5P/8 w - -
N6k/q6p/7P/3p1P2/1P1n3P/8/1B4Rp/7K w - -
Q3b3/1p2q3/1p6/bp4NP/1p6/1p6/1P3PPp/4NK1k w - -
1n3k2/bK1p4/3P1p2/P2BpP2/5p2/2P2Pp1/1pP1Q1p1/4Rrrb w - -
1NQ5/k1p1p3/7p/pP2P1P1/2P5/2pq4/1n6/6K1 w - -
3R4/1r3pbk/4p1p1/p5Pp/qp2Q2P/8/1PP2P2/1K2R3 b - -
3R4/PPPP1k1K/5bn1/2pP1p2/n7/4r2p/6r1/8 w - -
3rk2r/p4pR1/7p/2p2P2/2QnqB1b/4N2P/1PP2R2/6K1 b k -
5B2/8/1pPPbp2/2k1qRp1/1pnrB3/1p3n2/3P4/2R2KQ1 w - -
6k1/3P1p2/2B1pQp1/4P1K1/P5P1/3r3P/5P2/2q5 w - -
7B/4p3/2P4q/3N1Ppk/4K2p/7p/5N1P/8 w - -
8/2p1p1p1/2P1P1Pp/P4K2/P7/p2p4/rppP3P/qkn4R w - -
8/4p3/3pPp2/pK1P1P2/1P2NP2/4p1p1/2B1pprb/4kbrn w - -
8/5K1p/8/1p1p2pk/2P1p3/4P3/6P1/8 w - -
8/p5p1/4p3/4Pp2/2R2P1K/3P1P2/pk1p4/qrbB4 w - -
k4r2/P4P2/Kp1r4/1P4P1/2B4p/1P1pB3/5P2/4b3 w - -
k7/2K5/3P4/3N1p2/2pp4/8/bp6/5B1n w - -
3R2K1/r1r2Bp1/p1pPPbbp/3kq2R/3Ppp1p/8/1P6/8 w - -
4k3/2p1p3/3PPPP1/5P2/8/3K4/p3r2p/b6b w - -
5k2/2p2n1p/1P6/4pK2/3Pp1PB/1p4P1/2p5/Rr6 w - -
6BK/1qp1p2p/p3PRPk/P3n1p1/2P3P1/R5P1/4P3/8 w - -
6R1/pq2pk1K/4p3/8/4N3/3P4/P7/8 w - -
8/1Q6/8/8/5pq1/1B1np3/N2pk3/1K2b3 w - -
2k5/p2p4/1P6/P3p3/1q2N3/2p5/K7/7Q w - -
8/2K3p1/2P5/5P2/4pp1k/1p6/2p3Pr/R1R5 w - -
8/4k3/8/p5p1/P1R1K1Pb/6p1/1n4P1/8 w - -
5K1B/8/8/8/p7/p4p2/pn1PpPp1/kb2R3 w - -
7q/1K2p3/p3R2p/5k1P/2B2pp1/4P1P1/3P2P1/8 w - -
8/8/8/1p4N1/P1p5/P2p4/K1p5/2kbRB2 w - -
B1k5/5P2/3p1rPp/3R4/3p4/6K1/6p1/8 w - -
q7/6pP/1R2K2k/7p/3B2Pp/7P/3P4/8 w - -
r5k1/1R3rb1/P2P2p1/4npq1/P3p3/4P1p1/3B1PB1/2Q2RK1 b - -
3B4/p2p1K1p/2pP3k/2P3pp/1P6/7b/7P/8 w - -
4k3/1p6/1r1p4/1p1P1B1P/1P6/2K5/8/8 w - -
5B2/2K4P/4p3/3k1p2/p1p5/8/4P1p1/8 w - -
6k1/1b2p3/2p1Prp1/2p2p2/8/2B5/8/2K4R w - -
7B/8/1K6/5R2/p1k3n1/p2N4/P1P2P2/1q5n w - -
8/1p1p4/1p6/1p1B4/1P6/3PP1PP/2Np1kpP/3Kbrrb w - -
8/1p6/7p/2RPP2p/pp1P3P/qp1B1P2/pk1K4/b7 w - -
8/1r1R4/k1Kp4/3pQ3/8/2pp4/2np4/1B6 w - -
8/pp2p3/1p6/PK6/1BR5/Pp1p1p1p/1k6/R2bnr1r w - -
1qk4K/Qp6/pBp5/P1P5/5pp1/8/5PP1/8 b - -
4Q3/6k1/1p1pP3/2p5/4R2r/5P2/6B1/2q3K1 w - -
4rN2/b1p5/pNP5/1k1P4/1P6/2P5/K7/8 w - -
5bq1/4p1p1/4P1P1/5K2/2P1P1B1/5RP1/4p3/3k4 w - -
6R1/4N1pk/5p1p/3B4/2NQ4/2n3Pb/4q2P/3n3K w - -
8/6p1/4p1K1/1k5P/8/4P3/1pr5/1R6 b - -
8/p1p5/3p4/p3p3/3k1p2/1K2b1p1/1NP4p/7B w - -
3k1n1b/8/K2pq1P1/N7/8/8/2B5/4Q3 w - -
4k3/2R5/6pq/1pK1p3/4N3/6P1/3P4/8 w - -
5K1n/5npb/2p1p1pb/6pp/2N1P1P1/2BkNB1P/1p1P4/1r6 w - -
6B1/p3K3/6p1/2p1k2p/P1P1pN2/1p2P2P/5P1r/8 w - -
8/8/rp3K2/4P3/4kp2/2RN2P1/1PBb4/q7 w - -
k1b5/1p1p4/p1bPp3/PP1pP3/2pP4/1pP3N1/1P6/K7 w - -
k7/8/1Q6/8/8/6p1/1p1pppp1/1Kbrqbrn w - -
R1K5/5p2/1kbR3p/8/2P4r/5P1p/2P5/8 w - -
r1q1k3/2p2Rp1/p3pPPN/6p1/7N/1pp1b3/8/K5B1 w - -
rn1k1r2/1Rpb2RQ/p3p3/3pPp2/3P4/1KPB4/5q2/8 w - -
1b2N3/4P3/6pp/8/2kr2N1/5P1p/P6K/8 w - -
5k2/8/r2b2p1/2BP4/1p6/6P1/1K6/7R w - -
7K/1pp3p1/6pk/2R2P1r/7P/6P1/6P1/8 w - -
7K/p7/4p3/8/2b3B1/2P1Q3/q4P2/7k w - -
7q/1Q1p4/8/5p1b/2N3kN/1p1K4/8/8 w - -
8/1p6/1Q6/8/2kp4/3p4/pp1p4/rrbK4 w - -
8/2p2k2/p1P1p3/P4b2/1P4pp/8/R7/7K w - -
8/6Pq/3K2k1/3p2p1/6P1/2R5/2P5/1B6 w - -
8/q1k5/1pP4p/pP1K3p/P1PB4/6pP/6P1/8 w - -
7R/3p1K1P/P6k/3p4/6P1/p4P2/3p4/b7 w - -
8/3p1p2/3p1p2/3pPp2/3pk3/6P1/2P1KP2/8 w - -
8/6p1/1kp1p2p/4Pp1P/1P1K1P2/6P1/8/8 w - -
R7/1K6/8/2kN4/p2p1p2/3P4/P1P2pP1/8 w - -
1K6/8/k7/1pp1Q3/8/3ppppp/p7/8 w - -
3Q4/6k1/2N1p3/P1p1pq2/4pb1P/1P6/5P2/5K2 w - -
3R4/8/8/4q1p1/8/3P1Bp1/1R4p1/4k1Kb w - -
7n/4Kp2/PN4pB/6Pp/1k1q4/8/2P5/8 w - -
8/5pp1/6n1/q7/2B3P1/4K3/1RNPPP1p/7k w - -
8/P6K/6pp/1p1P2pk/P2P4/1Pp3P1/2Bp3n/1b6 w - -
8/ppp3p1/5p2/PPP1kP1P/8/6P1/8/1K6 w - -
q7/3Qr3/8/8/3N2R1/1N6/p2p4/1R1rk2K w - -
2k5/3p4/1Q6/8/8/1p1p4/pp1p4/rrbK4 w - -
2K5/4B3/k3Pp2/p3p3/8/4p1b1/2P5/8 w - -
2K5/k7/4pp2/P1P3pP/1Ppp2p1/6R1/1pP3PB/8 w - -
4k3/3Rp3/QP2P2P/p1r2p1K/1R5p/2r1P3/2q3p1/8 w - -
4Q3/k1rP1N2/4r3/3pP3/B4n1q/1K1b4/3B4/8 w - -
7k/2p2K2/3p4/r4n2/2r4p/5B2/5R2/5R2 w - -
7n/5p1b/5Ppp/p1K3P1/k1p3P1/1p2Q3/p4P2/r7 w - -
k7/P4pp1/1P6/2p1P3/2P1n3/p5pB/P4n2/K5b1 w - -
N3k3/P2p3N/3P1p1K/2p2pP1/3p3b/2P4P/pP2n2P/1n5b w - -
2q2k2/2P2P2/bQ1P3K/3p4/2pN4/8/1p6/8 w - -
1rb5/Np1p1p2/1PpP1P2/3p1B2/6p1/1rP1PpPk/7P/6BK w - -
3Q4/3N4/1p2p3/3kp1P1/6Pn/q1P1P2p/4Kp2/8 w - -
4B2R/6Pp/4b2k/5P1p/5P1K/n2ppP2/4p3/4B3 w - -
4k3/K3p1r1/1P2P3/7P/p1N1N1p1/3P2p1/q7/8 w - -
8/3p2p1/6p1/p4P1k/3P4/1P5p/P7/6K1 w - -
8/4p3/3p1p2/1PpP2N1/2P3K1/p1p1N3/rpPpQ3/kn5r w - -
B4n2/2pqk3/6P1/p1Pn4/8/P2p4/1Q1Pp3/4K3 w - -
K7/3k4/8/5p2/5p1p/p1p2P2/P1Pp1P1P/1n1N4 w - -
1rb5/Np1p1p1B/1PpP1P2/3p2p1/8/1rP1PpPk/7P/6BK w - -
3R3K/5k1P/1p6/8/2p1p3/4P3/4nB1p/8 w - -
6k1/1p6/1p1p4/1P1Pp3/P3p3/4P2p/4P2P/K7 w - -
8/1Pk5/B1Pr4/1p1P4/8/7p/P2P3P/K7 w - -
8/b1p5/1kP5/R7/7p/2P2p1p/6p1/6K1 w - -
8/p7/8/Q1p5/1p6/8/ppPp2p1/qrbK2kb w - -
k1Kb3n/ppp5/rP5r/P1P5/8/8/1Q5p/1n6 w - -
k7/P7/p3p1p1/pPp1P3/P1P5/7p/P2r3p/K1Q5 w - -
1q1N4/3p4/k1pP1Bpp/1pP5/pP2K2P/P7/8/8 w - -
4k1nr/5RRp/3K1Pp1/8/6N1/8/r7/2b5 w k -
5K1k/2p3pp/4p3/2p2p1P/2p5/6P1/8/3N4 w - -
6k1/7p/5RpP/4K1N1/4P3/1q6/1B6/8 w - -
6kN/6p1/R7/1n3K2/p5p1/8/4p1B1/8 w - -
8/2p3b1/p7/2pP4/P2P4/1PB4k/8/7K w - -
k1b3n1/1p1p1p2/1P1P1PpB/6P1/4p3/p1p3P1/PpK1N2b/qB6 w - -
2K2Nqk/2N1pp2/6Pb/7P/2p1P1B1/2P5/8/6B1 w - -
7n/5p2/7p/QP6/p3p3/3b2K1/6p1/1q4k1 w - -
k7/rn1N4/n1B4p/8/5p1p/b1N1pP2/P3P1P1/3K4 w - -
5kb1/p2K1p2/2p4p/B4PpP/2pQP1P1/p7/1q6/8 w - -
7Q/8/8/2q5/1p1p4/1Kp5/3RP1N1/1k6 b - -
8/2q4p/p7/4pQ2/1pp5/6N1/8/1K4k1 w - -
8/6p1/4Q3/6k1/8/8/3p1pp1/3Kbrrb w - -
8/8/5p1p/5P1P/1p6/pP4P1/P5P1/k2K4 w - -
k7/1p4N1/4p3/1P6/7K/pp2P1r1/q4ppR/3Q4 w - -
8/5p2/2p5/2p2n2/p3Q3/K7/2r4p/1k5n w - -
8/1p3ppp/8/1p6/1P6/5p1p/kPK3pr/2B3Nb w - -
kq4B1/1p2K2p/1Pp4P/2PP4/p2B1Pp1/p2P4/8/8 w - -
8/5p1p/B2p1P2/p2P2NP/2rP3N/n5p1/3K1pP1/5kbn w - -
n6n/3B4/4K2p/7p/8/7k/1p2pR1p/b3B3 w - -
8/8/8/1p6/6k1/1p2Q3/p1p1p3/rbrbK3 w - -
kbK5/rrp5/p4pB1/P4pPp/5B2/5pN1/5P2/8 w - -
r2q1k2/1pb2p1n/1Pp4r/P2p3p/3Pp1p1/2B1P3/4BPPP/1R1Q1RK1 b - -
1Brb4/Pbn1p3/2pkP3/K1p2P2/2Pb1P2/1P3P2/1p5p/3R4 w - -
8/1R2p3/8/5PpK/N4P2/4pkP1/3p4/8 w - -
8/2p4p/7p/2p2n1p/p3Q2p/K6p/2r5/1k5n w - -
2B2bk1/p1p1p1p1/2P1P1Pp/p1P5/2P4p/Pp5P/bP1K4/8 w - -
8/2Q5/8/8/1k1p4/4p1p1/3prpp1/3Kbbrn w - -
qn6/rk1p4/brpP4/1pP5/pP6/P4K2/N7/7R w - -
5R2/p7/4k3/3pN3/5pNP/2P1pKp1/PP1q2P1/8 w - -
8/8/3Q1r2/6PN/8/3K1ppp/4prkb/4Bbnn w - -
8/5p2/5P2/P7/3B4/8/pp2KPp1/r1k1N3 w - -
1k6/2Rpp3/1K2p3/2p5/1BprP3/8/2B4p/8 w - -
4Q3/1ppr4/brk5/1p1p4/1PpP1p2/2p2p2/K1P2P2/1B6 w - -
8/1p6/8/3p3k/3p4/6Q1/pp1p4/rrbK4 w - -
krb1K1n1/1pBp1p2/P1p2p1n/P2P1p2/5Pp1/2N3P1/8/8 w - -
1n6/3p3k/p1pPpP2/P1P1K3/1P6/8/5P2/8 w - -
8/1p2k3/8/8/5Q2/8/ppp1p3/bqrbK3 w - -
8/1p2k3/8/8/5Q2/8/ppp1p3/qrrbK3 w - -
8/1P1k4/q6p/3B4/3bPP2/6P1/6K1/8 w - -
8/2p3p1/8/1p4Q1/3p4/8/pppp2K1/br1k3n w - -
kb6/2p2p2/1Pp4p/2K4P/2B3P1/8/8/8 w - -
3N4/5Qpk/7p/1q3P2/8/1pp5/5P1K/8 w - -
8/7p/7p/7p/K4Q1p/p1p5/pbpr4/qrk5 w - -
k1b3n1/1p1pBp2/1P1PpPp1/6P1/8/p1p3P1/PpK1N2b/qB6 w - -
8/1p6/4k3/8/3p1Q2/3p4/pp1p4/rrbK4 w - -
8/6pp/5p2/k7/3p4/1Q2p3/3prpp1/3Kbqrb w - -
8/5p1p/8/6K1/p7/rp5p/1p3ppr/bQ1N1bqk w - -
8/1pp3p1/8/8/3pQ3/8/pppp2K1/br1k3n w - -
8/8/6Pp/3pb2p/p7/k7/P7/1K2B3 w - -
8/4K3/4NN2/p3p3/rnp1p3/1pk5/bp1n4/qrb1N3 w - -
k1bB2n1/1p1p1p2/1P1P1Pp1/4p1P1/8/p1p3P1/PpK1N2b/qB6 w - -
8/1pp3p1/8/6Q1/3p4/8/pppp2K1/br1k3n w - -
5Q2/p1p5/p1p5/6rp/7k/6p1/p1p3P1/rbK5 w - -
rnk5/p2p3p/p1pPp3/2P1Pp2/5P2/6p1/6Pb/3NBK2 w - -
1kb3n1/1p1p1pB1/1P1P1Pp1/4p1P1/8/p1p3P1/PpK1N2b/qB6 w - -
8/1pp3p1/8/8/3p1Q2/p7/1ppp2K1/brk4n w - -
3Nk1K1/5p2/1RP5/6P1/6n1/1Bq5/5P2/8 w - -
1kb3n1/1p1pBp2/1P1PpPp1/6P1/8/p1p3P1/PpK1N2b/qB6 w - -
K7/6p1/1p6/1p6/1p5p/p2NN1p1/rb4pr/qkn3Rb w - -
1kb3n1/1p1p1p2/1P1PpPpB/6P1/8/p1p3P1/PpK1N2b/qB6 w - -
3R4/8/8/8/6p1/2p5/1pP2P1p/1K1Nb2k w - -
7k/2b5/P1p5/8/3KR3/5P1p/2B5/2r5 w - -
1kb2Bn1/1p1p1p2/1P1PpPp1/6P1/8/p1p3P1/PpK1N2b/qB6 w - -
3K4/1k6/1P3nQ1/qPB1b3/8/3p1R2/8/7r w - -
8/1pp3p1/8/p7/3p2Q1/8/1ppp2K1/br2k2n w - -
k7/4N1n1/1Kpp4/1p6/2p5/P7/2r1BN2/8 w - -
1kb5/1p1p3p/pP1Pp3/Pp2Pp2/1p3P2/1P6/1P6/1K6 w - -
1r1b2R1/8/3pk3/1P1Np3/4P3/3K4/8/8 w - -
5n1k/2B2P2/3P3p/1P6/8/7n/2K1P3/8 w - -
8/1pp3p1/8/p5Q1/3p4/8/1ppp2K1/br1k3n w - -
8/n2p4/2NR4/B2p4/p6P/K1p5/8/1k2b3 w - -
k7/2p1N1n1/2pP4/1pK5/2p5/P7/r4N2/3B4 w - -
8/1pp3p1/8/p7/3p1Q2/8/1ppp2K1/brk4n w - -
8/8/p3k1p1/1p2p2p/1P2K1PP/5P2/P7/8 b - -
8/p2pp2K/p2Pk3/7R/3BP3/2P4p/1p5P/8 w - -
5B2/5n2/2p5/7p/4N2k/8/qpp3PP/2R1R2K w - -
8/8/p4p1k/P1p5/3pP1Pp/3P3P/4K3/8 w - -
1b4b1/3p4/1PPP3P/8/5K1p/4p1P1/8/7k w - -
3r3k/2n2K1p/pR6/8/2p5/5p2/5p2/7R w - -
8/2K1pp2/2P5/3k4/1b2pP2/8/P2P4/8 w - -
8/2n5/2Kp3p/k6p/5R2/8/3pbN2/4N3 w - -
8/2pp1p2/1p6/1kPP4/5Pp1/8/6PP/3K4 w - -
8/8/1p3p2/1r1p1kpp/1P1P3P/2KN2P1/5P2/8 w - -
2br4/k5r1/P1K3p1/2N2p2/3B4/1B6/8/8 w - -
rk1b4/p2p2p1/1P6/2R2P2/8/2K5/8/5B2 w - -
7K/1p1R4/1pP5/8/P7/P7/P1k3r1/3r4 w - -
8/1pp3p1/p7/6Q1/3p4/8/1ppp2K1/br1k3n w - -
2R2Q2/6pk/1p3q2/7p/1p1P4/8/5PPK/1r6 w - -
8/1pp3p1/p7/8/3p1Q2/8/1ppp2K1/brk4n w - -
q7/p7/3ppB2/6p1/4k1P1/8/4P1P1/3RK3 w - -
4K1k1/8/1p5p/1Pp5/5b2/1P6/P1B2P2/8 w - -
8/2p1ppp1/6p1/P3kP1P/3p4/5P1K/8/8 w - -
8/8/p1p5/2p2k2/1pP3pp/1P1K2P1/P6P/8 w - -
8/pp2k1pp/2p5/2P1p3/2P1P2P/6P1/P7/2K5 b - -
8/ppp3p1/8/8/3p2Q1/8/1ppp2K1/br2k2n w - -
6k1/1N5p/2p5/5p2/4p3/3p2P1/2pK1P1P/8 w - -
8/ppp3p1/8/6Q1/3p4/8/1ppp2K1/br1k3n w - -
8/ppp3p1/8/8/3pQ3/8/1ppp2K1/br1k3n w - -
8/1N3p2/5p2/5pN1/5P1P/P7/pPK5/4k3 w - -
4Q3/ppp3p1/8/8/3p4/8/1ppp2K1/br1k3n w - -
5Bk1/1PP5/5P2/7P/n6p/4r2P/r7/6K1 w - -
8/1b2k3/p6p/1p2p2P/1P1P2P1/4Kp2/2B5/8 w - -
6kr/2r2p1p/3pP2B/pp1B4/8/5PKP/P7/8 w - -
1q4k1/3Pn1r1/6Pn/3PP2p/2Q5/8/R5KP/8 w - -
8/p4B2/2p1p1p1/2p1PkP1/2P4P/8/Pp6/bK6 w - -
4k3/5p2/R7/p2PK1p1/6P1/r4P2/8/8 w - -
6k1/6pp/8/1p2pP1P/p2pP3/3P1K2/PP6/8 w - -
8/5r2/4Q3/6PN/8/3K1ppp/4prkb/4Bbnn w - -
8/6p1/2Nq1k1n/B2P3B/8/3K4/1P3P2/8 w - -
n7/b1p1K3/1pP4p/1P4p1/6p1/1p4Pn/1P2N1br/3NRn1k w - -
2B5/n1p5/p7/1P5R/P7/rk6/6P1/2K5 w - -
8/3q1r1p/1K6/4k3/7Q/1p2P3/8/2N3N1 w - -
3K4/8/r5b1/1q3p2/k7/2P2B1Q/4R3/8 w - -
4b3/2p5/2p5/B7/1K1N4/8/pp2N3/k7 w - -
3B3k/8/3r3p/R7/7P/6p1/7b/3B3K w - -
5k1r/1rp2P2/1p3p2/1P1N4/1P3K2/5P2/8/6R1 w - -
8/4K2k/8/4p1PB/1p2p1p1/1N4p1/8/8 w - -
1Rb5/7R/6k1/8/1p3r2/5N1B/K7/1r6 w - -
5N1k/1p6/8/4K1p1/1p3Npp/7p/7B/8 w - -
8/2R2p2/7p/6qk/4Kp1p/2RpP3/6P1/8 w - -
qkb5/8/PK1N4/3Q4/8/6R1/1b2r2B/8 w - -
8/5B2/8/B2n1P2/3n2Pb/p7/4k3/1K6 b - -
2R5/4p2K/1k6/NP1P1P2/1q5b/8/4P3/5B2 w - -
K3n3/3P1r2/3pq3/7Q/P7/k6b/5R2/8 w - -
4N3/4Np2/1p3p2/5P2/8/1K4p1/3P4/1k6 w - -
8/1p4k1/1p5N/8/3K4/5pn1/2PPPp2/5R2 w - -
R7/5p1B/1p6/3pP3/6pp/7p/2N4p/1K5k w - -
2k5/rpq5/1Q6/8/1P1p4/7p/1K6/1R6 w - -
8/4B3/1p2k1p1/4N1P1/3PP3/4K2p/8/1n6 w - -
1Q6/3pq3/1p3pK1/1k6/4PB2/1P1P4/2P5/1r6 w - -
2K5/7P/rp6/1pR5/4k2r/4P3/4P3/6R1 w - -
2q5/1ppk4/5R2/1P1p4/4PN2/7P/P7/2K5 w - -
5N2/5R2/r1b2B1p/7k/2p5/p2p2KP/1n6/8 w - -
r1B3KR/pPp5/1P2p2B/1P6/5p2/8/6p1/5k1b w - -
R7/R7/4Q3/1p6/1Pp5/2r5/3q4/K4b1k w - -
4kn2/5p2/7B/ppp1P2P/8/1K6/6P1/8 w - -
5k2/4nP2/7r/8/2B5/5R2/K1p1pR2/8 w - -
2k1K3/5Np1/1p6/2p4P/2p1p3/2B5/2B4q/2R4b w - -
8/Kp6/1pB4p/4Nq1P/P4kN1/8/7P/8 w - -
8/4B3/3p1p2/3PkP2/1pP3p1/6P1/1p4P1/bK6 w - -
1N4nn/5p2/5Pp1/3k2B1/8/p5P1/K5P1/8 w - -
q2b3k/1p3p1P/5p1K/BP1n1P1P/Q1P1p3/4P3/3P4/8 w - -
8/K2P3p/6P1/5P2/4p3/5P2/3r1P2/k7 w - -
8/p4rp1/p1P5/P6p/7k/7P/3BP1K1/8 w - -
2K5/5B2/7B/2p5/1p1R4/1p6/1p2r3/1k6 w - -
1K6/6p1/1p2P3/3p4/8/6Pk/2BP4/r7 w - -
3k4/8/p1B4p/8/4P1p1/2N3Pq/P6P/6K1 w - -
4B3/5p2/1p2n1p1/1P2k3/6P1/5P2/4K3/8 b - -
4r3/8/1k6/1Pp1n3/1P6/8/1PK1NR2/8 w - -
5N2/6p1/1p2Pk2/p2p4/3P4/3P4/K7/8 w - -
5Q2/1r3p1k/p7/2R3P1/Pq6/3b2P1/5p1K/2R5 b - -
7k/5pR1/8/1K2P3/P4r2/6P1/7n/B5b1 w - -
8/1p2B3/3p3q/6Np/1P4kN/1K6/1P5P/8 w - -
8/pk1p1p2/1P1P4/r1P3Pp/8/8/1Rp2P2/2K5 w - -
r3k2r/Q7/3p2p1/1p2pp2/2p3p1/1P1P1p1B/6PK/8 w - -
5n1n/1p1p3q/3P4/1p6/1p1B2Q1/1P1p4/7k/K7 w - -
8/1P1pk2P/K1p3p1/p1p2p2/2p3P1/n7/7q/4NR2 w - -
8/2K4N/1p3n1p/5p1p/2P1kP2/1n4PP/3P1p1P/6B1 w - -
8/2p2Pp1/p3pN2/2p1P3/2Pk4/3P4/2PK1Pq1/8 w - -
8/5b2/P2pnK2/ppr1P3/1N2k3/1N3nP1/3r1BP1/8 w - -
n2r2bK/1B6/pB1P3R/4k1b1/2q5/N1R1p3/2P2n2/8 w - -
8/p2R4/p2n1B1p/pp1NN2K/Rb1k2nQ/2p1p1rr/2P5/8 w - -
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Ajedrecista
Posts: 1968
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Throwing out draws to calculate Elo.

Post by Ajedrecista »

Hello:
hgm wrote: Thu Jul 02, 2020 8:24 pm
Dann Corbit wrote: Thu Jul 02, 2020 8:20 pm It is true that my result is rather unexpected (especially after only 14,000 games), but if I had let the games run all the way to 100,000 as I had originally intended, the LOS value would have been very close to either 0 or 1 as Ajedrecista proved in his analysis.
Edit: Last night, when I went to sleep, it was not as lopsided. I was surprised this morning when I took a look at it.
No, why do you think that? For equal engines you expect the LOS to randomly fluctuate in the range 0.16-0.84 (i.e. between 50% +/- one standard deviation), only occasionally moving out of that interval, no matter how many games you do.
I think there has been a bit of misunderstanding: I was talking about the tails of the distribution, where |z| value should be high with 10^100 games in the most extreme cases. Since z = (2*score - 1)*sqrt(n) according with my previous analysis (corrections are always welcome!), it does not imply that sqrt(n) dominates z because 2*score - 1 is an infinitesimal of similar order most of the time and the multiplication of them is not ±infinity always. I was trying to say that LOS could be very, very close to 0% or 100% between equal engines in long matches, but not always!

Regards from Spain.

Ajedrecista.
User avatar
hgm
Posts: 27795
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Throwing out draws to calculate Elo

Post by hgm »

Dann Corbit wrote: Thu Jul 02, 2020 8:33 pmBecause of this:
b) Since LOS can be related with z-score, which can be proportional to sqrt(n), which tends to infinity, z-score tends to ±infinity and LOS tends to 0 or 1.
Sorry, that is bullshit. z-scores will remain on the order of 1 during the entire test. By definition. They are the ratio of the actual deviation and the standard deviation. And the standard deviation is defined as a typical magnitude of the actual deviation. They will fluctuate, for sure, and sometimes stray out of the interval [-1, 1] (namely 32% of the time), and even more rarely out of [-2, 2] (5% of the time), but they will always return to within [-1, 1] when you continue the match.
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: Throwing out draws to calculate Elo

Post by Alayan »

Either the math predict that the LoS of a given run converges on average towards 50% (i.e., despite the expected divergence in absolute wins and losses, the LoS goes towards 50% faster, and an increasingly small proportion of random runs would show a LoS beyond 50 +- delta %) or LoS is broken.

Doing 100K runs of 100K coinflips is deceptive because of course you'd expect about 1K runs to have a LoS >= 99%.

But if you just take a single run and increase the number N of coinflips, either LoS converges to 50% as N goes towards infinity (assuming the coinflip is perfectly fair) or it's broken.

I'm not convinced at all LoS has such a diverging behavior as claimed earlier in this thread, however.