A community project CCMT

[Dann Corbit]

I am hoping to get 100 positions out of the 404 that are worth keeping.
I don't think it has to be a titantically difficult set like the vinvin tough problem set, so that you have to have very expensive hardware or a lot of patience (though I would like enough tough problems to keep it interesting and relevant so that machines won't solve 100% at five seconds two years from now.)

[MOBMAT]

I am hoping to get 100 positions out of the 404 that are worth keeping.
I don't think it has to be a titantically difficult set like the vinvin tough problem set, so that you have to have very expensive hardware or a lot of patience (though I would like enough tough problems to keep it interesting and relevant so that machines won't solve 100% at five seconds two years from now.)

Can the "polls" ask multiple questions? If so, you could offer a FEN then ask a number of questions about it as you laid out before. that way, users would get a lot less poll requests and answering questions while examining the FEN won't take too long.

[Ovyron]

Can the "polls" ask multiple questions?

Yes, there's no limit on the questions that can be put forward. However only "vote for your favorite one" could work for this.

I think first he'd need to gather the people that would be interested in answering the polls, then the optimal planning can be made. For instance, if he gathers 100 people, each would just need to answer 16 polls (16x100=1616), and 16 of them an extra one. And you are done.

Sort them well before hand so that the best positions get matches against the worst position, you can assume you already voted for the best ones, and if people agree with you, you can cut the polls in half, so 8 polls per people and an extra poll for 8 users would do it.

Note I'm just being very rigorous to ensure you end with the "top 100" positions and get rid of the 304 that were certainly worse than them, if false positives are allowed (maybe you have the top 80 positions and 20 random ones) polling can be reduced significantly.

Suggestion:

Sort the positions from hardest to easiest, then pair them in the style of Round Robin. If the hardest ones beat the easiest ones consistently there'll be a great indication of correlation with artistry and then you can assume people already voted for the hard ones and cut the polls again to 404 (4 polls per people, with 1 extra poll for 4 people seems very reasonable).

[Dann Corbit]

I filtered out a very large percent with a SQL query that found alternative winning moves.

The much shortened list is:

Code: Select all

R1n4k/n1p5/1b2pN1P/2p4p/2P4p/p1p1p3/P1P1P2P/7K w - - bm Rb8; 
7n/3P4/n2K2kp/2p4N/Bb6/2p1p1P1/8/8 w - - bm Bc2+; 
8/pP6/kpP3p1/brpPb1p1/1pP1PbP1/1P6/K5P1/8 w - - bm d6; 
8/p7/8/8/7P/1pk4P/P1P5/1K1Qbq1N b - - bm Bf2; 
2kr3r/pppb1ppp/B4q1n/n3p3/8/B1Q2N2/P4PPP/1R2R1K1 w - - bm Rec1; 
1qr2bk1/p4p1p/1p2pBn1/3pP1Q1/PP1P4/5NPB/2b2PK1/7R w - - bm Bf5; 
3nK3/3p4/pn1Npb2/k7/P3p3/P1p5/1N6/4B3 w - - bm Kf8; 
r3k2r/ppp2Npp/8/3Bpb2/2Kn1q2/2P5/PP1P2PP/RNBQ3R b kq - bm b5+; 
1k1qBQ1n/p1p4p/1PK5/7p/8/8/P7/8 w - - bm Bf7; 
8/4B3/4Q3/1p6/4N1N1/4K3/1ppppppp/4k3 w - - bm Ne5; 
7R/3r4/1P3P1p/kP2p1p1/7p/K7/1P3P2/8 w - - bm f4; 
2r2k2/p2q2b1/2b2Np1/2p5/2B1PP2/1P4P1/P7/6KQ w - - bm Nxd7+; 
5R2/7P/P1p2N2/2p2kpp/K1P1N1pr/p3n2p/qp1nP3/r2R4 w - - bm Ne8+; 
7r/3r1kpp/q2p4/3p2p1/8/1pQ1R1PP/2p4K/6R1 w - - bm Qc6; 
8/1P1p1p1p/3P1P1P/1pK5/P7/Pp2p3/bpp1P2P/nkb4R w - - bm a5; 
3R2K1/r1r2Bp1/p1pPPbbp/3kq2R/3Ppp1p/8/1P6/8 w - - bm dxc7+; 
5B2/7p/1Nr5/2P1P1P1/p6p/k1Pb4/2P5/K7 w - - bm Nc4+; 
1r6/1pPp1pBp/1P1P1P1P/1K6/4p3/P7/ppp1P2P/qkn4R w - - bm cxb8=N; 
3rk2r/p4pR1/7p/2p2P2/2QnqB1b/4N2P/1PP2R2/6K1 b k - bm Bxf2+; 
8/6PK/2Q2P1P/8/1P6/1p1r3p/2Rp4/1k4q1 w - - bm Rxd2; 
b2Nn2q/rBn3p1/6Rr/kpp3R1/1b2Q3/1p4B1/1K5P/8 w - - bm Nc6+; 
7B/4p3/2P4q/3N1Ppk/4K2p/7p/5N1P/8 w - - bm Bf6; 
8/2p1p1p1/2P1P1Pp/P4K2/P7/p2p4/rppP3P/qkn4R w - - bm a6; 
3R4/PPPP1k1K/5bn1/2pP1p2/n7/4r2p/6r1/8 w - - bm Rg8; 
8/5K1p/8/1p1p2pk/2P1p3/4P3/6P1/8 w - - bm c5; 
3R4/1r3pbk/4p1p1/p5Pp/qp2Q2P/8/1PP2P2/1K2R3 b - - bm Bxb2; 
k4r2/P4P2/Kp1r4/1P4P1/2B4p/1P1pB3/5P2/4b3 w - - bm g6; 
1NQ5/k1p1p3/7p/pP2P1P1/2P5/2pq4/1n6/6K1 w - - bm b6+; 
6k1/3P1p2/2B1pQp1/4P1K1/P5P1/3r3P/5P2/2q5 w - - bm f4; 
8/1Q6/8/8/5pq1/1B1np3/N2pk3/1K2b3 w - - bm Bd1+; 
8/b1p5/1kP5/R7/7p/2P2p1p/6p1/6K1 w - - bm Ra4; 
5k2/2p2n1p/1P6/4pK2/3Pp1PB/1p4P1/2p5/Rr6 w - - bm b7; 
6BK/1qp1p2p/p3PRPk/P3n1p1/2P3P1/R5P1/4P3/8 w - - bm g7+; 
3B4/p2p1K1p/2pP3k/2P3pp/1P6/7b/7P/8 w - - bm b5; 
8/2K3p1/2P5/5P2/4pp1k/1p6/2p3Pr/R1R5 w - - bm f6; 
B1k5/5P2/3p1rPp/3R4/3p4/6K1/6p1/8 w - - bm Kh2; 
8/8/8/1p4N1/P1p5/P2p4/K1p5/2kbRB2 w - - bm Bxd3; 
7q/1K2p3/p3R2p/5k1P/2B2pp1/4P1P1/3P2P1/8 w - - bm e4+; 
r5k1/1R3rb1/P2P2p1/4npq1/P3p3/4P1p1/3B1PB1/2Q2RK1 b - - bm Nf3+; 
4k3/1p6/1r1p4/1p1P1B1P/1P6/2K5/8/8 w - - bm Bd3; 
6k1/1b2p3/2p1Prp1/2p2p2/8/2B5/8/2K4R w - - bm Bxf6; 
4Q3/6k1/1p1pP3/2p5/4R2r/5P2/6B1/2q3K1 w - - bm Kf2; 
7B/8/1K6/5R2/p1k3n1/p2N4/P1P2P2/1q5n w - - bm Nb4; 
5B2/2K4P/4p3/3k1p2/p1p5/8/4P1p1/8 w - - bm e4+; 
8/1r1R4/k1Kp4/3pQ3/8/2pp4/2np4/1B6 w - - bm Qf4; 
6B1/p3K3/6p1/2p1k2p/P1P1pN2/1p2P2P/5P1r/8 w - - bm Be6; 
8/pp2p3/1p6/PK6/1BR5/Pp1p1p1p/1k6/R2bnr1r w - - bm Bc3+; 
8/p1p5/3p4/p3p3/3k1p2/1K2b1p1/1NP4p/7B w - - bm c3+; 
1qk4K/Qp6/pBp5/P1P5/5pp1/8/5PP1/8 b - - bm Qxa7; 
4rN2/b1p5/pNP5/1k1P4/1P6/2P5/K7/8 w - - bm Kb3; 
8/6p1/4p1K1/1k5P/8/4P3/1pr5/1R6 b - - bm Rg2+; 
5bq1/4p1p1/4P1P1/5K2/2P1P1B1/5RP1/4p3/3k4 w - - bm Rf4; 
R1K5/5p2/1kbR3p/8/2P4r/5P1p/2P5/8 w - - bm Ra4; 
5K1n/5npb/2p1p1pb/6pp/2N1P1P1/2BkNB1P/1p1P4/1r6 w - - bm Ke7; 
3k1n1b/8/K2pq1P1/N7/8/8/2B5/4Q3 w - - bm g7; 
rn1k1r2/1Rpb2RQ/p3p3/3pPp2/3P4/1KPB4/5q2/8 w - - bm Bb5; 
4k3/2R5/6pq/1pK1p3/4N3/6P1/3P4/8 w - - bm Rh7; 
8/8/rp3K2/4P3/4kp2/2RN2P1/1PBb4/q7 w - - bm Nb4+; 
1b2N3/4P3/6pp/8/2kr2N1/5P1p/P6K/8 w - - bm Kxh3; 
8/2p2k2/p1P1p3/P4b2/1P4pp/8/R7/7K w - - bm Rf2; 
5k2/8/r2b2p1/2BP4/1p6/6P1/1K6/7R w - - bm Ra1; 
7K/1pp3p1/6pk/2R2P1r/7P/6P1/6P1/8 w - - bm g4; 
7q/1Q1p4/8/5p1b/2N3kN/1p1K4/8/8 w - - bm Ng6; 
7K/p7/4p3/8/2b3B1/2P1Q3/q4P2/7k w - - bm Qe1+; 
8/2R2p2/7p/6qk/4Kp1p/2RpP3/6P1/8 w - - bm R3c5; 
8/6p1/1kp1p2p/4Pp1P/1P1K1P2/6P1/8/8 w - - bm Ke3; 
7R/3p1K1P/P6k/3p4/6P1/p4P2/3p4/b7 w - - bm Rg8; 
R7/1K6/8/2kN4/p2p1p2/3P4/P1P2pP1/8 w - - bm Kc7; 
8/P6K/6pp/1p1P2pk/P2P4/1Pp3P1/2Bp3n/1b6 w - - bm Bd1+; 
8/3p1p2/3p1p2/3pPp2/3pk3/6P1/2P1KP2/8 w - - bm e6; 
3Q4/6k1/2N1p3/P1p1pq2/4pb1P/1P6/5P2/5K2 w - - bm Qg8+; 
8/ppp3p1/5p2/PPP1kP1P/8/6P1/8/1K6 w - - bm b6; 
7n/4Kp2/PN4pB/6Pp/1k1q4/8/2P5/8 w - - bm c3+; 
3R4/8/8/4q1p1/8/3P1Bp1/1R4p1/4k1Kb w - - bm Re8; 
q7/3Qr3/8/8/3N2R1/1N6/p2p4/1R1rk2K w - - bm Kh2; 
1K6/8/k7/1pp1Q3/8/3ppppp/p7/8 w - - bm Qc7; 
2K5/k7/4pp2/P1P3pP/1Ppp2p1/6R1/1pP3PB/8 w - - bm b5; 
8/5pp1/6n1/q7/2B3P1/4K3/1RNPPP1p/7k w - - bm Kf3; 
4Q3/k1rP1N2/4r3/3pP3/B4n1q/1K1b4/3B4/8 w - - bm Be3+; 
2K5/4B3/k3Pp2/p3p3/8/4p1b1/2P5/8 w - - bm c4; 
k7/P4pp1/1P6/2p1P3/2P1n3/p5pB/P4n2/K5b1 w - - bm e6; 
4k3/3Rp3/QP2P2P/p1r2p1K/1R5p/2r1P3/2q3p1/8 w - - bm Rd8+; 
7k/2p2K2/3p4/r4n2/2r4p/5B2/5R2/5R2 w - - bm Bd5; 
N3k3/P2p3N/3P1p1K/2p2pP1/3p3b/2P4P/pP2n2P/1n5b w - - bm Nc7+; 
2q2k2/2P2P2/bQ1P3K/3p4/2pN4/8/1p6/8 w - - bm Kg5; 
K7/3k4/8/5p2/5p1p/p1p2P2/P1Pp1P1P/1n1N4 w - - bm Kb8; 
8/4p3/3p1p2/1PpP2N1/2P3K1/p1p1N3/rpPpQ3/kn5r w - - bm Qd1; 
4k3/K3p1r1/1P2P3/7P/p1N1N1p1/3P2p1/q7/8 w - - bm h6; 
B4n2/2pqk3/6P1/p1Pn4/8/P2p4/1Q1Pp3/4K3 w - - bm Qe5+; 
8/3p2p1/6p1/p4P1k/3P4/1P5p/P7/6K1 w - - bm f6; 
4B2R/6Pp/4b2k/5P1p/5P1K/n2ppP2/4p3/4B3 w - - bm f6; 
3Q4/3N4/1p2p3/3kp1P1/6Pn/q1P1P2p/4Kp2/8 w - - bm Nxe5+; 
1rb5/Np1p1p2/1PpP1P2/3p1B2/6p1/1rP1PpPk/7P/6BK w - - bm Bd3; 
8/1Pk5/B1Pr4/1p1P4/8/7p/P2P3P/K7 w - - bm a4; 
k1Kb3n/ppp5/rP5r/P1P5/8/8/1Q5p/1n6 w - - bm Qg2; 
k7/P7/p3p1p1/pPp1P3/P1P5/7p/P2r3p/K1Q5 w - - bm b6; 
3R3K/5k1P/1p6/8/2p1p3/4P3/4nB1p/8 w - - bm Rd7+; 
k1b3n1/1p1p1p2/1P1P1PpB/6P1/4p3/p1p3P1/PpK1N2b/qB6 w - - bm Bg7; 
8/2p3b1/p7/2pP4/P2P4/1PB4k/8/7K w - - bm d6; 
5K1k/2p3pp/4p3/2p2p1P/2p5/6P1/8/3N4 w - - bm Ne3; 
6k1/7p/5RpP/4K1N1/4P3/1q6/1B6/8 w - - bm Rxg6+; 
4k1nr/5RRp/3K1Pp1/8/6N1/8/r7/2b5 w k - bm Rc7; 
6kN/6p1/R7/1n3K2/p5p1/8/4p1B1/8 w - - bm Ra8+; 
2K2Nqk/2N1pp2/6Pb/7P/2p1P1B1/2P5/8/6B1 w - - bm Bd4+; 
7n/5p2/7p/QP6/p3p3/3b2K1/6p1/1q4k1 w - - bm Qd2; 
8/2q4p/p7/4pQ2/1pp5/6N1/8/1K4k1 w - - bm Qf3; 
5kb1/p2K1p2/2p4p/B4PpP/2pQP1P1/p7/1q6/8 w - - bm Qc5+; 
8/8/5p1p/5P1P/1p6/pP4P1/P5P1/k2K4 w - - bm Kc1; 
7Q/8/8/2q5/1p1p4/1Kp5/3RP1N1/1k6 b - - bm Qd5+; 
k7/1p4N1/4p3/1P6/7K/pp2P1r1/q4ppR/3Q4 w - - bm b6; 
kq4B1/1p2K2p/1Pp4P/2PP4/p2B1Pp1/p2P4/8/8 w - - bm d6; 
8/3q1r1p/1K6/4k3/7Q/1p2P3/8/2N3N1 w - - bm Nf3+; 
5N2/6p1/1p2Pk2/p2p4/3P4/3P4/K7/8 w - - bm Nd7+; 
8/5p1p/B2p1P2/p2P2NP/2rP3N/n5p1/3K1pP1/5kbn w - - bm Kd1; 
2B2bk1/p1p1p1p1/2P1P1Pp/p1P5/2P4p/Pp5P/bP1K4/8 w - - bm Kc1; 
1Brb4/Pbn1p3/2pkP3/K1p2P2/2Pb1P2/1P3P2/1p5p/3R4 w - - bm Ka4; 
r2q1k2/1pb2p1n/1Pp4r/P2p3p/3Pp1p1/2B1P3/4BPPP/1R1Q1RK1 b - - bm Bxh2+; 
kbK5/rrp5/p4pB1/P4pPp/5B2/5pN1/5P2/8 w - - bm Be8; 
8/1R2p3/8/5PpK/N4P2/4pkP1/3p4/8 w - - bm Rd7; 
2K5/7P/rp6/1pR5/4k2r/4P3/4P3/6R1 w - - bm Rg4+; 
8/2p4p/7p/2p2n1p/p3Q2p/K6p/2r5/1k5n w - - bm Qe1+; 
qn6/rk1p4/brpP4/1pP5/pP6/P4K2/N7/7R w - - bm Nc3; 
8/4K2k/8/4p1PB/1p2p1p1/1N4p1/8/8 w - - bm Nd4; 
5R2/p7/4k3/3pN3/5pNP/2P1pKp1/PP1q2P1/8 w - - bm Re8+; 
8/5p2/5P2/P7/3B4/8/pp2KPp1/r1k1N3 w - - bm Be3+; 
1k6/2Rpp3/1K2p3/2p5/1BprP3/8/2B4p/8 w - - bm Rb7+; 
krb1K1n1/1pBp1p2/P1p2p1n/P2P1p2/5Pp1/2N3P1/8/8 w - - bm a7; 
4Q3/1ppr4/brk5/1p1p4/1PpP1p2/2p2p2/K1P2P2/1B6 w - - bm Qe6+; 
rnk5/p2p3p/p1pPp3/2P1Pp2/5P2/6p1/6Pb/3NBK2 w - - bm Ba5; 
1n6/3p3k/p1pPpP2/P1P1K3/1P6/8/5P2/8 w - - bm f7; 
K3n3/3P1r2/3pq3/7Q/P7/k6b/5R2/8 w - - bm Rf3+; 
8/1p2k3/8/8/5Q2/8/ppp1p3/qrrbK3 w - - bm Qd2; 
kb6/2p2p2/1Pp4p/2K4P/2B3P1/8/8/8 w - - bm b7+; 
3N4/5Qpk/7p/1q3P2/8/1pp5/5P1K/8 w - - bm Ne6; 
k1b3n1/1p1pBp2/1P1PpPp1/6P1/8/p1p3P1/PpK1N2b/qB6 w - - bm Bf8; 
8/8/6Pp/3pb2p/p7/k7/P7/1K2B3 w - - bm Bg3; 
3K4/8/r5b1/1q3p2/k7/2P2B1Q/4R3/8 w - - bm Bc6; 
1kb3n1/1p1p1pB1/1P1P1Pp1/4p1P1/8/p1p3P1/PpK1N2b/qB6 w - - bm Bf8; 
8/1pp3p1/8/8/3p1Q2/p7/1ppp2K1/brk4n w - - bm Qg5; 
3Nk1K1/5p2/1RP5/6P1/6n1/1Bq5/5P2/8 w - - bm Nxf7; 
1kb3n1/1p1pBp2/1P1PpPp1/6P1/8/p1p3P1/PpK1N2b/qB6 w - - bm Bd8; 
K7/6p1/1p6/1p6/1p5p/p2NN1p1/rb4pr/qkn3Rb w - - bm Ka7; 
1kb3n1/1p1p1p2/1P1PpPpB/6P1/8/p1p3P1/PpK1N2b/qB6 w - - bm Bf8; 
3R4/8/8/8/6p1/2p5/1pP2P1p/1K1Nb2k w - - bm Ne3; 
7k/2b5/P1p5/8/3KR3/5P1p/2B5/2r5 w - - bm a7; 
1kb2Bn1/1p1p1p2/1P1PpPp1/6P1/8/p1p3P1/PpK1N2b/qB6 w - - bm Bg7; 
8/1pp3p1/8/p7/3p2Q1/8/1ppp2K1/br2k2n w - - bm Qe4+; 
3K4/1k6/1P3nQ1/qPB1b3/8/3p1R2/8/7r w - - bm Qg7+; 
k7/4N1n1/1Kpp4/1p6/2p5/P7/2r1BN2/8 w - - bm Bg4; 
8/1pp3p1/8/p5Q1/3p4/8/1ppp2K1/br1k3n w - - bm Qg4+; 
5n1k/2B2P2/3P3p/1P6/8/7n/2K1P3/8 w - - bm d7; 
8/n2p4/2NR4/B2p4/p6P/K1p5/8/1k2b3 w - - bm Nd4; 
k7/2p1N1n1/2pP4/1pK5/2p5/P7/r4N2/3B4 w - - bm Bg4; 
2B5/n1p5/p7/1P5R/P7/rk6/6P1/2K5 w - - bm Rh3+; 
1r1b2R1/8/3pk3/1P1Np3/4P3/3K4/8/8 w - - bm Kc4; 
8/1pp3p1/8/p7/3p1Q2/8/1ppp2K1/brk4n w - - bm Qg5; 
8/p2pp2K/p2Pk3/7R/3BP3/2P4p/1p5P/8 w - - bm Kg7; 
8/8/p3k1p1/1p2p2p/1P2K1PP/5P2/P7/8 b - - bm g5; 
5B2/5n2/2p5/7p/4N2k/8/qpp3PP/2R1R2K w - - bm h3; 
8/8/p4p1k/P1p5/3pP1Pp/3P3P/4K3/8 w - - bm e5; 
8/8/1p3p2/1r1p1kpp/1P1P3P/2KN2P1/5P2/8 w - - bm f3; 
1b4b1/3p4/1PPP3P/8/5K1p/4p1P1/8/7k w - - bm Kf3; 
8/1pp3p1/p7/6Q1/3p4/8/1ppp2K1/br1k3n w - - bm Qg4+; 
8/2K1pp2/2P5/3k4/1b2pP2/8/P2P4/8 w - - bm Kb6; 
8/2pp1p2/1p6/1kPP4/5Pp1/8/6PP/3K4 w - - bm c6; 
8/2n5/2Kp3p/k6p/5R2/8/3pbN2/4N3 w - - bm Nf3; 
8/K2P3p/6P1/5P2/4p3/5P2/3r1P2/k7 w - - bm Kb6; 
2br4/k5r1/P1K3p1/2N2p2/3B4/1B6/8/8 w - - bm Nd7+; 
rk1b4/p2p2p1/1P6/2R2P2/8/2K5/8/5B2 w - - bm Rc8+; 
8/1pp3p1/p7/8/3p1Q2/8/1ppp2K1/brk4n w - - bm Qg5; 
7K/1p1R4/1pP5/8/P7/P7/P1k3r1/3r4 w - - bm c7; 
2R2Q2/6pk/1p3q2/7p/1p1P4/8/5PPK/1r6 w - - bm Qh8+; 
q7/p7/3ppB2/6p1/4k1P1/8/4P1P1/3RK3 w - - bm Rd4+; 
8/8/p1p5/2p2k2/1pP3pp/1P1K2P1/P6P/8 w - - bm gxh4; 
8/ppp3p1/8/8/3p2Q1/8/1ppp2K1/br2k2n w - - bm Qe4+; 
8/2p1ppp1/6p1/P3kP1P/3p4/5P1K/8/8 w - - bm f6; 
8/pp2k1pp/2p5/2P1p3/2P1P2P/6P1/P7/2K5 b - - bm g5; 
4K1k1/8/1p5p/1Pp5/5b2/1P6/P1B2P2/8 w - - bm Kd7; 
8/ppp3p1/8/8/3pQ3/8/1ppp2K1/br1k3n w - - bm Qf3+; 
8/ppp3p1/8/6Q1/3p4/8/1ppp2K1/br1k3n w - - bm Qg4+; 
6k1/1N5p/2p5/5p2/4p3/3p2P1/2pK1P1P/8 w - - bm Nc5; 
8/1N3p2/5p2/5pN1/5P1P/P7/pPK5/4k3 w - - bm Nf3+; 
5Bk1/1PP5/5P2/7P/n6p/4r2P/r7/6K1 w - - bm Bb4; 
4Q3/ppp3p1/8/8/3p4/8/1ppp2K1/br1k3n w - - bm Qh5+; 
8/1b2k3/p6p/1p2p2P/1P1P2P1/4Kp2/2B5/8 w - - bm dxe5; 
6kr/2r2p1p/3pP2B/pp1B4/8/5PKP/P7/8 w - - bm f4; 
1q4k1/3Pn1r1/6Pn/3PP2p/2Q5/8/R5KP/8 w - - bm d6+; 
8/p4B2/2p1p1p1/2p1PkP1/2P4P/8/Pp6/bK6 w - - bm Be8; 
4k3/5p2/R7/p2PK1p1/6P1/r4P2/8/8 w - - bm Ra8+; 
6k1/6pp/8/1p2pP1P/p2pP3/3P1K2/PP6/8 w - - bm h6; 
8/5r2/4Q3/6PN/8/3K1ppp/4prkb/4Bbnn w - - bm Qd5; 
8/6p1/2Nq1k1n/B2P3B/8/3K4/1P3P2/8 w - - bm Bd8+; 
n7/b1p1K3/1pP4p/1P4p1/6p1/1p4Pn/1P2N1br/3NRn1k w - - bm Kf6; 
4b3/2p5/2p5/B7/1K1N4/8/pp2N3/k7 w - - bm Kc3; 
3B3k/8/3r3p/R7/7P/6p1/7b/3B3K w - - bm Rd5; 
5k1r/1rp2P2/1p3p2/1P1N4/1P3K2/5P2/8/6R1 w - - bm Rg8+; 
5N1k/1p6/8/4K1p1/1p3Npp/7p/7B/8 w - - bm Kf6; 
qkb5/8/PK1N4/3Q4/8/6R1/1b2r2B/8 w - - bm Nb7; 
1Rb5/7R/6k1/8/1p3r2/5N1B/K7/1r6 w - - bm Rc7; 
8/5B2/8/B2n1P2/3n2Pb/p7/4k3/1K6 b - - bm Bd8; 
2R5/4p2K/1k6/NP1P1P2/1q5b/8/4P3/5B2 w - - bm Rc6+; 
4N3/4Np2/1p3p2/5P2/8/1K4p1/3P4/1k6 w - - bm Nc7; 
8/1p4k1/1p5N/8/3K4/5pn1/2PPPp2/5R2 w - - bm Nf5+; 
R7/5p1B/1p6/3pP3/6pp/7p/2N4p/1K5k w - - bm Ne3; 
2k5/rpq5/1Q6/8/1P1p4/7p/1K6/1R6 w - - bm Qe6+; 
8/4B3/1p2k1p1/4N1P1/3PP3/4K2p/8/1n6 w - - bm Bb4; 
1Q6/3pq3/1p3pK1/1k6/4PB2/1P1P4/2P5/1r6 w - - bm c4+; 
2q5/1ppk4/5R2/1P1p4/4PN2/7P/P7/2K5 w - - bm Rf7+; 
R7/R7/4Q3/1p6/1Pp5/2r5/3q4/K4b1k w - - bm Rh7+; 
5N2/5R2/r1b2B1p/7k/2p5/p2p2KP/1n6/8 w - - bm Bd8; 
r1B3KR/pPp5/1P2p2B/1P6/5p2/8/6p1/5k1b w - - bm Bg5; 
5k2/4nP2/7r/8/2B5/5R2/K1p1pR2/8 w - - bm Ra3; 
4kn2/5p2/7B/ppp1P2P/8/1K6/6P1/8 w - - bm Bxf8; 
2k1K3/5Np1/1p6/2p4P/2p1p3/2B5/2B4q/2R4b w - - bm Be5; 
8/Kp6/1pB4p/4Nq1P/P4kN1/8/7P/8 w - - bm Ng6+; 
8/4B3/3p1p2/3PkP2/1pP3p1/6P1/1p4P1/bK6 w - - bm Bf8; 
2K5/5B2/7B/2p5/1p1R4/1p6/1p2r3/1k6 w - - bm Rd6; 
q2b3k/1p3p1P/5p1K/BP1n1P1P/Q1P1p3/4P3/3P4/8 w - - bm Bb4; 
1N4nn/5p2/5Pp1/3k2B1/8/p5P1/K5P1/8 w - - bm Nd7; 
8/p4rp1/p1P5/P6p/7k/7P/3BP1K1/8 w - - bm Bb4; 
4B3/5p2/1p2n1p1/1P2k3/6P1/5P2/4K3/8 b - - bm Nd8; 
4r3/8/1k6/1Pp1n3/1P6/8/1PK1NR2/8 w - - bm Rf6+; 
7k/5pR1/8/1K2P3/P4r2/6P1/7n/B5b1 w - - bm e6; 
8/1p2B3/3p3q/6Np/1P4kN/1K6/1P5P/8 w - - bm h3+; 
8/1P1pk2P/K1p3p1/p1p2p2/2p3P1/n7/7q/4NR2 w - - bm Rf4; 
8/2p2Pp1/p3pN2/2p1P3/2Pk4/3P4/2PK1Pq1/8 w - - bm Ne4; 
1K6/6p1/1p2P3/3p4/8/6Pk/2BP4/r7 w - - bm Be4; 
3k4/8/p1B4p/8/4P1p1/2N3Pq/P6P/6K1 w - - bm Be8; 
r3k2r/Q7/3p2p1/1p2pp2/2p3p1/1P1P1p1B/6PK/8 w - - bm Qxa8+; 
8/2K4N/1p3n1p/5p1p/2P1kP2/1n4PP/3P1p1P/6B1 w - - bm Nxf6+; 
n2r2bK/1B6/pB1P3R/4k1b1/2q5/N1R1p3/2P2n2/8 w - - bm Nxc4+; 
8/5b2/P2pnK2/ppr1P3/1N2k3/1N3nP1/3r1BP1/8 w - - bm gxf3+; 

[Ovyron]

Can you sort them by time to solution? I reckon the easiest ones (say, anybody in old hardware can find it in <10 seconds) can go.

[Dann Corbit]

Can you sort them by time to solution? I reckon the easiest ones (say, anybody in old hardware can find it in <10 seconds) can go.

That is not so easy, and here is why.
I have run engines against some of them for more than one hour, and another tool solves it in ten seconds. So which is the time for elimination?
I think that in general, positions that give some leading engine fits are valuable because they help the engine writers to fix defects.

But it is hard to know what to keep and what to save, based on time with one or two engines, especially if the engines are related.
But if you have specific criteria, i am all ears to listen. I think that community guildelines are probably better than some arbitrary crap I pull out of a hat

[Ovyron]

I have run engines against some of them for more than one hour, and another tool solves it in ten seconds. So which is the time for elimination?

Those are interesting positions and keepers. I meant to get rid of the ones that no tool takes a lot to solve. If you already have all positions that are hard for some tool then disregard the idea.

Sorting would be done taking into account the slowest tool, but such a tool shouldn't be so weak that it's slow to find everything (the criteria can be that if the tool is slow in all positions then it's bad tool).

[Dann Corbit]

These positions were all chosen because they game *some* engine fits, but the tragic problem is I do not know when and I do not know which engine since they are not recorded in the database.

So it could be crafty in 1990 that had a hard time, but it is laughable today because engines and machines have advanced exponentially

SF has some blind spots, especially involving draws which act as magnets, but it has gained a lot of ability recently so I need to rethink SF difficulties because it is a moving target.

I think what I really want more than anything else is fun. That is my goal with this project. Fun in twists, turns, and surprises. Fun in problems that seem like easy solves to humans but computers beat their heads against a wall. Fun in sacrifice. Fun in tactical brilliancy.

The problem (as I see it) is that what is fun for me may not be as fun for others, and I want to maximize global fun. I wonder if we can apply the Alpah beta algortithm to maximize our fun, since it surely would reduce the effort.

If other people have more fun with other things, I am also all ears, because I want to make a test set that not just computers ponder but humans as well,

[Ovyron]

Okay, I noticed there are several positions that are boring because they just have a piece giving check. That's one of the first things that come to mind when looking at them, so it's not fun that the first move I think about when looking at them is the best one. The most fun ones have moves I completely didn't see coming, and I'm awed that they work.

If you agree with this criteria I can post such positions to suggest elimination.

[Dann Corbit]

I think your idea is a good one.
I welcome all suggestions.
As I said, fun should be a very important criteria.