I can't see anything on the rating table that cutechess-cli produces in its documentation. Does anyone know if the +- corresponds to a 1 sigma (68%) or 2 sigma (95%) interval?
cheers
Martin
Is cutechess-cli's rating interval 1 sigma or 2 sigma?
Moderators: hgm, Rebel, chrisw
-
fierz
- Posts: 72
- Joined: Mon Mar 07, 2016 4:41 pm
- Location: Zürich, Switzerland
-
F. Bluemers
- Posts: 868
- Joined: Thu Mar 09, 2006 11:21 pm
- Location: Nederland
Re: Is cutechess-cli's rating interval 1 sigma or 2 sigma?
cutechess-cli output:
Score of dirty vs dirtyx: 5512 - 4797 - 4638 [0.524] 14947
Elo difference: 16.63 +/- 4.62
in dirty elo tool (WDL):
eb 5512 4638 4797
80% confidence 14 <= 17 <= 20
90% confidence 13 <= 17 <= 21
95% confidence 12 <= 17 <= 21
98% confidence 11 <= 17 <= 22
99% confidence 11 <= 17 <= 23
looks like 95%
Score of dirty vs dirtyx: 5512 - 4797 - 4638 [0.524] 14947
Elo difference: 16.63 +/- 4.62
in dirty elo tool (WDL):
eb 5512 4638 4797
80% confidence 14 <= 17 <= 20
90% confidence 13 <= 17 <= 21
95% confidence 12 <= 17 <= 21
98% confidence 11 <= 17 <= 22
99% confidence 11 <= 17 <= 23
looks like 95%
-
fierz
- Posts: 72
- Joined: Mon Mar 07, 2016 4:41 pm
- Location: Zürich, Switzerland
Re: Is cutechess-cli's rating interval 1 sigma or 2 sigma?
Thanks! I was worried a bit about the size of my confidence intervals but if they are 95% then it's not as bad as I thought (I usually use 1 sigma by default in anything I do...)