Wanted engines with UCI_Elo

[pedrox]

When it comes to adjust the elo of an engine to play against humans is useless to refer the elo of other engines, such as CCRL list. You do not know the relationship between this list and FIDE list.

For example, a dedicated machine as Mephisto Roma 32 bit in aktiv list about 2076 Elo points and CCRL will have something like 1608, at the height of a single engine and Darky.

Aktiv list
http://www.schach-computer.info/wiki/in ... o-Liste_En

The aktiv list is based on the ancient lists SSDF where games played by humans against the machines are included, so this list surely has a much more real like ELO FIDE that CCRL.

[vittyvirus]

Deep Rybka 4.1
minelo 1200
maxelo 2400(!)

[Ferdy]

Thanks, I run a 2 round gauntlet test at elo 1200, and SlowChess was time-forfeited in 3 games.

Code: Select all

   Engine                   Score  Sl
1: SlowChess 2.960e elo1200 2.5/10 ·· 
2: Amyan v1.72 elo1200      2.0/2  11 
2: Arasan v17.1 elo1200     2.0/2  11 
4: Hiarcs v14 elo1200       1.5/2  1= 
5: MadChess v1.4 elo1200    1.0/2  01 
5: Ufim v8.02 elo1200       1.0/2  10 

10 games played / Tournament finished
Name of the tournament: SlowChess Test 1
Level: Tournament 40/3
Hardware: i7-2600K CPU @ 3.40GHz with 12 GB Memory
Operating system: Win 7 Prof SP 1 64 bit

[Ferdy]

Thanks for some hints. I am tempted to also make a separate version to make an engine play like a human focusing on elo range 1000 to 1600.

I have dowloaded DanaSahZ 0.4, looking at the readme,

Code: Select all

# DanaSahZ 0.4 help
#
# [ELO]
# -----
# LimitStrength: true o false
# Elo, you can prove to use values between 0 and 2500 with easylevel value 0
# Elo_Type: engine (elo ccrl), computer (elo activ) or human (elo fide)
# Style: 1 very passive, 2 passive, 3 normal, 4 agressive, 5 very agressive
# EasyLevel: 0 normal, 1 random move, 2 newcomer random elo, 3 beginer random elo, 4 weak player random elo
#            5 average player random elo, 6 strong player random elo, 7 expert random elo, 8 CM random elo
#            8 CM (Candidate Master) random elo, 9 FM (Fide Master) random elo, 
#            10 IM (International Master) random elo
#
limitstrength true
elo 2000
elo_type computer
style 3
diff_engine 0
diff_computer_engine 466
diff_human_computer 70
easylevel 0

[...]

Could you explain what is the meaning of the following?

Code: Select all

diff_engine 0
diff_computer_engine 466
diff_human_computer 70

I have plan to test it at elo 1200 level against other engines with that level too, so my preliminary setting is,

Code: Select all

limitstrength true
elo 1200
elo_type computer
style 3
diff_engine ?
diff_computer_engine ?
diff_human_computer ?
easylevel 0
[...]

This will be installed as winboard engine. I want to disable the use of egbb, what is the best way to disable it?

[Ferdy]

Thanks, I run a 2 round gauntlet test at elo 1200, and SlowChess was time-forfeited in 3 games.

Code: Select all

   Engine                   Score  Sl
1: SlowChess 2.960e elo1200 2.5/10 ·· 
2: Amyan v1.72 elo1200      2.0/2  11 
2: Arasan v17.1 elo1200     2.0/2  11 
4: Hiarcs v14 elo1200       1.5/2  1= 
5: MadChess v1.4 elo1200    1.0/2  01 
5: Ufim v8.02 elo1200       1.0/2  10 

10 games played / Tournament finished
Name of the tournament: SlowChess Test 1
Level: Tournament 40/3
Hardware: i7-2600K CPU @ 3.40GHz with 12 GB Memory
Operating system: Win 7 Prof SP 1 64 bit

This is using arena 3.5, ponder off.
[pgn]
[Event "SlowChess Test 1"]
[Site "Home"]
[Date "2014.07.23"]
[Round "1"]
[White "SlowChess 2.960e elo1200"]
[Black "Arasan v17.1 elo1200"]
[Result "0-1"]
[BlackElo "1200"]
[ECO "D11"]
[Opening "Slav"]
[Time "12:45:13"]
[Variation "4.Qb3"]
[WhiteElo "1200"]
[TimeControl "40/180:40/180:40/180"]
[Termination "time forfeit"]
[PlyCount "68"]
[WhiteType "program"]
[BlackType "program"]

1. Nf3 d5 2. d4 c6 3. c4 Nf6 4. Qb3 a5 {+1.24/1 1} 5. Bf4 {+0.04/2 6} a4
{+0.80/1 1} 6. Qd3 {+0.08/2 6} Na6 {+0.64/1 1} 7. Nc3 {+0.48/2 6} h5
{+0.52/1 1} 8. Nxa4 {+1.20/2 13} Be6 {-0.12/1 1} 9. Ne5 {+1.40/2 12} Nc7
{-0.08/1 1} 10. Nb6 {+1.76/2 12} Ra6 {-0.36/1 1} 11. c5 {+1.92/2 12} Ra5
{-0.24/1 1} 12. b4 {+1.88/2 10} Ra6 {+0.84/1 2} 13. Nxc6 {+2.96/2 11} bxc6
{-2.60/1 2} 14. Bxc7 {+4.12/2 9} Rxa2 {-1.96/1 1} 15. Rxa2 {+3.32/2 8} Bf5
{-5.80/1 2} 16. Bxd8 {+7.88/2 8} Bxd3 {-5.12/1 2} 17. Bxe7 {+7.88/2 7} Bc4
{-6.68/1 2} 18. Nxc4 {+7.88/2 7} Kxe7 {-7.44/1 2} 19. Ne5 {+10.60/2 6} Nh7
{-8.24/1 2} 20. Ra7+ {+11.24/2 5} Kf6 {-8.48/1 2} 21. e3 {+11.32/2 6} Ke6
{-9.36/1 2} 22. g3 {+11.28/2 4} Ng5 {-8.88/1 2} 23. Nxc6 {+11.08/2 3} Kf6
{-8.48/1 2} 24. b5 {+11.60/2 2} Ne6 {-8.28/1 2} 25. b6 {+11.92/2 2} g6
{-7.92/1 2} 26. b7 {+13.84/1 2} Bxc5 {-11.80/1 2} 27. dxc5 {+14.60/2 2}
Nxc5 {-13.16/1 2} 28. b8=Q {+14.76/2 2} Rxb8 {-13.16/1 3} 29. Nxb8
{+14.60/2 1} d4 {-14.96/1 3} 30. exd4 {+16.08/2 1} Nb3 {-15.24/1 3} 31. Nc6
{+16.28/2 1} g5 {-15.56/1 3} 32. Bc4 {+18.04/2 1} Nxd4 {-18.64/1 4} 33.
Rxf7+ {+19.48/1 1} Kg6 {-18.64/1 4} 34. Nxd4 {+19.36/2 1} h4 {-20.84/1 4}
35. ... {White forfeits on time} 0-1

[Event "SlowChess Test 1"]
[Site "Home"]
[Date "2014.07.23"]
[Round "1"]
[White "SlowChess 2.960e elo1200"]
[Black "Hiarcs v14 elo1200"]
[Result "0-1"]
[BlackElo "1200"]
[ECO "B10"]
[Opening "Caro-Kann"]
[Time "13:10:50"]
[Variation "Breyer, 3.Nd2"]
[WhiteElo "1200"]
[TimeControl "40/180:40/180:40/180"]
[Termination "time forfeit"]
[PlyCount "77"]
[WhiteType "program"]
[BlackType "program"]

1. e4 c6 2. d3 d5 3. Nd2 Nf6 4. Ngf3 {-0.20/2 6} e6 5. Be2 {-0.20/2 5} Qb6
{-0.15/1 2} 6. O-O {+0.16/2 5} Bc5 {+0.19/1 2} 7. e5 {+0.16/2 5} Bd7
{-2.35/1 2} 8. exf6 {+3.08/2 5} gxf6 {-2.60/2 5} 9. b3 {+2.76/2 5} e5
{-2.35/2 6} 10. Bb2 {+2.88/2 6} Bd4 {-2.11/1 2} 11. Nxd4 {+4.00/2 5} exd4
{-4.39/1 2} 12. c3 {+4.12/2 6} dxc3 {-3.67/2 2} 13. Bxc3 {+3.96/2 5} c5
{-2.75/2 2} 14. Bf3 {+3.96/2 5} d4 {-2.92/1 2} 15. Re1+ {+4.80/2 12} Be6
{-3.74/3 10} 16. Nc4 {+4.72/3 11} Qa6 {-3.92/3 12} 17. Bb2 {+4.28/2 11} Nd7
{-3.46/2 2} 18. b4 {+4.32/2 10} O-O-O {-3.07/3 13} 19. Na5 {+4.52/2 9} Qb6
{-5.28/3 19} 20. Nxb7 {+5.92/2 9} Qxb4 {-4.40/2 4} 21. Nxd8 {+6.76/2 8}
Rxd8 {-5.52/3 9} 22. Qe2 {+6.60/2 7} Nf8 {-6.09/1 1} 23. Bc6 {+6.84/2 4}
Qb6 {-6.02/1 2} 24. Be4 {+6.68/2 4} f5 {-5.99/1 1} 25. Bf3 {+6.64/2 4} Qb5
{-5.89/1 1} 26. a4 {+7.08/2 3} Qb3 {-6.09/1 2} 27. Rac1 {+7.32/2 3} c4
{-5.60/1 2} 28. a5 {+6.36/2 2} c3 {-5.91/2 9} 29. Rc2 {+6.12/2 2} Kd7
{-4.20/2 10} 30. Ba1 {+6.28/2 1} Rb8 {-5.19/1 1} 31. a6 {+6.12/2 1} Qb5
{-4.65/1 1} 32. Bb7 {+6.20/2 1} Rxb7 {-4.84/1 1} 33. axb7 {+6.64/1 1} Qxb7
{-5.90/1 2} 34. Qe5 {+6.80/1 1} Qd5 {-6.45/1 2} 35. Qf6 {+6.60/1 1} Qd6
{-6.49/2 9} 36. Re5 {+6.40/2 1} Qb6 {-6.19/1 1} 37. Rce2 {+6.64/1 0} Qb1+
{-5.50/1 2} 38. ... {0-1 White forfeits on time} 38. Re1 {+4.80/3 0} Qxd3
{-6.10/3 8} 39. ... {White forfeits on time} 0-1

[Event "SlowChess Test 1"]
[Site "Home"]
[Date "2014.07.23"]
[Round "2"]
[White "Arasan v17.1 elo1200"]
[Black "SlowChess 2.960e elo1200"]
[Result "1-0"]
[BlackElo "1200"]
[ECO "B06"]
[Opening "Modern"]
[Time "13:22:16"]
[Variation "1.e4 g6 2.d4 c6"]
[WhiteElo "1200"]
[TimeControl "40/180:40/180:40/180"]
[Termination "time forfeit"]
[PlyCount "77"]
[WhiteType "program"]
[BlackType "program"]

1. d4 c6 2. e4 g6 3. g4 {+1.60/1 1} d5 {-0.04/3 5} 4. Bg5 {0.00/1 1} f6
{+0.72/2 5} 5. Bh4 {0.00/1 1} g5 {+0.72/2 5} 6. Bg3 {-0.32/1 1} dxe4
{+0.40/2 5} 7. c3 {+0.56/1 1} e5 {+0.92/2 6} 8. b4 {-0.36/1 1} exd4
{+2.24/2 12} 9. a3 {-1.44/1 1} d3 {+2.92/2 12} 10. h3 {-0.20/1 1} b5
{+3.36/2 11} 11. Qd2 {-1.04/1 1} Nd7 {+3.84/2 10} 12. Qe3 {-1.52/1 1} Qe7
{+3.44/2 10} 13. Qd2 {-0.20/1 1} Ne5 {+4.12/2 9} 14. Rh2 {-1.56/1 1} Bb7
{+4.28/2 8} 15. Qa2 {-1.48/1 1} Rd8 {+4.28/2 8} 16. Bg2 {-1.32/1 1} c5
{+4.40/2 7} 17. Kf1 {-2.36/1 1} c4 {+4.96/2 7} 18. Nd2 {-1.20/1 1} Nf7
{+4.52/2 6} 19. Rd1 {-0.64/1 2} Bg7 {+4.44/2 6} 20. Qb2 {-0.16/1 2} Ngh6
{+4.44/2 6} 21. Qc1 {-0.12/1 2} O-O {+4.92/2 5} 22. a4 {-1.68/1 2} bxa4
{+4.76/2 3} 23. Nxc4 {-1.68/1 2} Rd5 {+4.60/2 2} 24. Nb2 {-0.28/1 2} a3
{+5.12/2 3} 25. Nc4 {-0.84/1 2} a5 {+3.84/1 1} 26. Nd2 {-1.20/1 2} axb4
{+4.76/2 2} 27. Ke1 {-2.24/1 2} Rc5 {+7.44/2 2} 28. c4 {-3.24/1 2} b3
{+5.28/1 0} 29. Qa1 {-1.28/1 3} b2 {+5.64/1 0} 30. Qxa3 {-2.48/1 3} f5
{+5.40/2 2} 31. Qa2 {-1.76/1 3} fxg4 {+6.16/2 1} 32. h4 {-2.44/1 3} e3
{+7.04/2 1} 33. Bxb7 {-4.72/1 4} exd2+ {+7.32/1 0} 34. Kf1 {-6.56/1 4} Qxb7
{+9.56/1 1} 35. hxg5 {-6.56/1 5} Nxg5 {+9.32/2 2} 36. Rh5 {-5.60/1 5} Rxc4
{+4.16/1 0} 37. Qxc4+ {-2.96/1 6} Qf7 {+4.48/1 0} 38. Qxf7+ {-4.36/1 8}
Nhxf7 {+4.40/2 0} 39. Rh4 {-1.12/1 11} ... {Black forfeits on time} 1-0
[/pgn]

[Ferdy]

Deep Rybka 4.1
minelo 1200
maxelo 2400(!)

Thanks, but I have already used.

Code: Select all

engine: id name Rybka 2.3.2a mp 
min elo 1200 
max elo 2400 

[Ferdy]

I think BlackMamba and Hamsters, also.

Blackmamba is all right but Hamsters forfeits on time all its games.

Code: Select all

================================= ArenaSwiss Ver. 0.3d =================================

Tournament name:   Swiss1200-1
Tournament start:  Tue, 22 Jul 2014, 22:38:53

Pairing method:    Fide
Tie Break method:  Buchholz
Time control:      Tournament 40 in 3 min repeated
Conditions:        Hash: 128MB, Tablebases: Off, Ponder Off
No. of rounds:     7
Games per pairing: 1
[...]

Code: Select all

Rank Engine                           ELO    1    2    3    4    5    6    7   Score      Tie  White   ELO
----------------------------------------------------------------------------------------------------------
  1: Horizon v4.4 elo1200            1200   3W+  2B-  9W+  5B+  4W+  6W+  7B+    6.0     30.0      4   +25
  2: BlackMamba v1.2c elo1200        1200  10W+  1W+  6B+  4B+  7B+  3B-  5W-    5.0     31.0      3   +15
  3: Amyan v1.72 elo1200             1200   1B- 10B+  5W- 11W+  8B+  2W+  6W+    5.0     28.0      4   +15
  4: Rybka v2.3.2a elo1200           1200  12W+  5B+  7B+  2W-  1B-  9B+ 11W+    5.0     26.0      3   +15
  5: Ufim v8.02 elo1200              1200   8W+  4W-  3B+  1W-  6B- 12B+  2B+    4.0     31.0      3    +5
  6: Tornado v4.4 elo1200            1200  14W+  9W+  2W-  8B+  5W+  1B-  3B-    4.0     27.0      4    +5
  7: Cheng4 v0.36c elo1200           1200  11W+ 13B+  4W-  9B+  2W- 10B+  1W-    4.0     26.0      4    +5
  8: Hiarcs v14 elo1200              1200   5B- 12W+ 11B+  6W-  3W- 14B+ 13W+    4.0     19.0      4    +5
  9: Houdini v4 elo1200              1200  13W+  6B-  1B-  7W- 14B+  4W- 12B+    3.0     23.0      3    -5
 10: MadChess v1.4 elo1200           1200   2B-  3W- 13B+ 12B- 11B+  7W- 14W+    3.0     20.0      3    -5
 11: Rodent v1.3 elo1200             1200   7B- 14B+  8W-  3B- 10W- 13W+  4B-    2.0     23.0      3   -15
 12: Deuterium v14.2.33.276 elo1200  1200   4B-  8B- 14W+ 10W+ 13B-  5W-  9W-    2.0     21.0      4   -15
 13: Arasan v17.1 elo1200            1200   9B-  7W- 10W- 14B+ 12W+ 11B-  8B-    2.0     18.0      3   -15
 14: Hamsters v0.7.1 elo1200         1200   6B- 11W- 12B- 13W-  9W-  8W- 10B-    0.0     20.0      4   -35

[pedrox]

Could you explain what is the meaning of the following?
diff_engine 0
diff_computer_engine 466
diff_human_computer 70

diff is a parameter used to scale the rating.

diff_engine 0 use ELO as CCRL list (reference Amyan 1.72 2588 Elo), if you consider that the ELO for Amyan is smaller for example 2500, you can put diff_engine as -88. So I could do quickly engine regulation taking into account the values ​​of the CCRL or CEGT list, although I have not taken into account that one uses BayesElo and other ELOstat.

diff_computer_engine, is used to compare a list of engines as the CCRL with another list of dedicated machines as Aktiv. The engine ELO always will be higher in the list Aktiv approximately 466 points. Here if I had in mind that CCRL is BayesElo and Aktiv is Elostat

diff_human_computer is used to compare Aktiv list and FIDE list.


You can leave these values ​​as they are.

I have plan to test it at elo 1200 level against other engines with that level too, so my preliminary setting is,

Code: Select all

limitstrength true
elo 1200
elo_type computer
style 3
diff_engine ?
diff_computer_engine ?
diff_human_computer ?
easylevel 0
[...]

Better --> elo_type engine (CCRL list)
In this way I hope the engine has such regulation similar to Rybka.

computer is a dedicated machine as mephisto, saitek, excalibur, etc. Used if a user wants to face the engine versus old computer chess.

But I think a human player will have best experience when placing elo_type as human . Perhaps here the Elo is more like Shredder.

Although I have played hundreds of games, I would have to play a lot more for Know if the regulation works as I want. Regulation possibly is better above 1400.

This will be installed as winboard engine. I want to disable the use of egbb, what is the best way to disable it?

If you do not enter a path for bitbases then not activate.

[Jimbo I]

Blackmamba is all right but Hamsters forfeits on time all its games.

Does Hamsters hang on the second move? I should have warned you that you need to specify "-threads x" as a command line parameter. (Without the quotes, and x is the desired number of threads.) Give that a try.

[Ferdy]

Here is my setting at the moment.

limitstrength true
elo 1200
elo_type computer
style 3
diff_engine 0
diff_computer_engine 0
diff_human_computer 0
easylevel 0
ownbook true
tourbook ./book/none.bin
mainbook ./book/super.bin
hash 128
noise 0
castling KQkq

What is your recommended values such that DanaSahZ will play at a level close to human with fide elo rating 1200?

I have run DanaSahZ with that setting, and the result so far is,
7-round swiss, TC 40moves in 3 minutes repeating, ponder off.

Code: Select all

Rank Engine                          ELO    1    2    3    4    5   Score      Tie  White   ELO
-----------------------------------------------------------------------------------------------
  1: Horizon v4.4 elo1200           1200  16B+  8W+  4W+  2W+  6B+    5.0     12.5      3   +20
  2: BlackMamba v1.2c elo1200       1200  14B+  5W+ 10W+  1B-  9B+    4.0     13.5      2   +15
  3: Deuterium v14.3.34.21 elo1200  1200   5B-  7B+ 11W+  4W+  8W+    4.0     13.5      3   +15
  4: Amyan v1.72 elo1200            1200  13B+ 12W+  1B-  3B- 10W+    3.0     15.0      2    +5
  5: Tornado v4.4 elo1200           1200   3W+  2B-  9B- 12W+ 13W+    3.0     14.5      3    +5
  6: Rybka v2.3.2a elo1200          1200   8B- 14W+ 12B+ 10W+  1W-    3.0     12.5      3    +5
  7: DanaSahZ 0.4 elo1200           1200  10B-  3W- 16W+ 11B+ 14W+    3.0      9.0      3     0
  8: Cheng4 v0.36c elo1200          1200   6W+  1B- 13B+  9W=  3B-    2.5     16.5      2     0
  9: SlowChess 2.960e elo1200       1200  11W- 15B+  5W+  8B=  2W-    2.5     12.5      3     0
 10: Ufim v8.02 elo1200             1200   7W+ 11B+  2B-  6B-  4B-    2.0     15.0      1    -5
 11: Hiarcs v14 elo1200             1200   9B+ 10W-  3B-  7W- 15W+    2.0     12.5      3    -5
 12: MadChess v1.4 elo1200          1200  15W+  4B-  6W-  5B- 16W+    2.0     10.0      3   -10
 13: Houdini v4 elo1200             1200   4W- 16B+  8W- 14B+  5B-    2.0      9.5      2   -10
 14: Rodent v1.3 elo1200            1200   2W-  6B- 15B+ 13W-  7B-    1.0     13.0      2   -15
 15: Arasan v17.1 elo1200           1200  12B-  9W- 14W- 16W+ 11B-    1.0      7.5      3   -20
 16: <Bye>                             1   1W- 13W-  7B- 15B- 12B-    0.0     13.0      2     0