Search found 61 matches

by jswaff
Thu Aug 06, 2020 11:59 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: non overlapping error bars
Replies: 11
Views: 328

Re: non overlapping error bars

In this case there is just a single opponent - it's version A vs version B. The "restart" issue you mentioned is interesting. This is my Java engine, and I do _not_restart it between games due to the "warm up overhead" of starting a JVM. My first thought was that there must be some sort of resource ...
by jswaff
Wed Aug 05, 2020 5:48 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: non overlapping error bars
Replies: 11
Views: 328

Re: non overlapping error bars

That's a fair question, and I don't really have an answer other than I thought more positions == more variability == better? The point has already been made to remove the different positions as a variable, and I agree. I had made an assumption that the match score using the first 10k positions in th...
by jswaff
Wed Aug 05, 2020 11:39 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: non overlapping error bars
Replies: 11
Views: 328

Re: non overlapping error bars

+15 ELO from one half of a set of positions to the other half seems like a lot, which is why I didn't consider it, but maybe it is that simple. As I replied to Brian, I'll just have to repeat the experiment on a single processor to see if the results hold.
by jswaff
Wed Aug 05, 2020 1:24 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: non overlapping error bars
Replies: 11
Views: 328

Re: non overlapping error bars

Hi Brian! I've run fixed depth tests with results exactly .500 as expected. The tests I'm posting about are simply game in 5+0.25, so of course there will some variability - that's expected. I have recently run tests with the same version and got a result that was close to, but not exactly 0.500, wh...
by jswaff
Tue Aug 04, 2020 6:10 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: non overlapping error bars
Replies: 11
Views: 328

non overlapping error bars

I have two tests running - version A of a program vs version B. Both tests are running the same builds of each version (the MD5 signatures of the binaries match), and are running with the same time control under identical conditions, with the exception that the set of starting positions are differen...
by jswaff
Tue Jul 21, 2020 5:24 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Cutechessing with Fruit/Gnuchess on a 16-core errors with "connection stalls"
Replies: 8
Views: 575

Re: Cutechessing with Fruit/Gnuchess on a 16-core errors with "connection stalls"

My guess is the engine has crashed. (I've seen that error before and that was the case.) Try opening a window with the list of processes and see if one falls off when you see that message.

Running cutechess with the debug option may give some more info.
by jswaff
Sat Jul 11, 2020 11:47 am
Forum: Computer Chess Club: General Topics
Topic: In memory of Tony Hedlund
Replies: 8
Views: 599

Re: In memory of Tony Hedlund

I'm very sorry to hear that. Prayers for peace and comfort.
by jswaff
Wed Jun 24, 2020 4:19 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Just made an account to say thank you!
Replies: 5
Views: 1193

Re: Just made an account to say thank you!

I agree 100%. I do think unit tests are an important tool but as you pointed out they alone aren't enough. I am on my third rewrite of Prophet. In the first version I didn't know much about programming, let alone the value of testing. By the time I started Prophet3 I did have an appreciation of it, ...
by jswaff
Tue Jun 23, 2020 1:30 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Just made an account to say thank you!
Replies: 5
Views: 1193

Re: Just made an account to say thank you!

Good test coverage is ... good, but as you say doesn't guarantee the absence of bugs. In this case I would expand my coverage to expose the bug, then write the code to satisfy it. Another way to look at it is: unit tests (or any kind of tests) only prove the code works as designed, not as it should!...
by jswaff
Tue Jun 23, 2020 12:56 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Java vs C. It's not like one would think.
Replies: 13
Views: 2155

Re: Java vs C. It's not like one would think.

OliThink is the first engine I know of where we have 1:1 conversion by the author himself using two different languages, which is awesome, thanks. Actually I've done the same with chess4j and Prophet. Not only that but there is a JNI layer for the Java code (chess4j) to call the native code (Prophe...