Hiarcs 13.1 Interim results (FRC)

Questions and comments related to CCRL testing study
Post Reply
Ray
Posts: 22606
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Hiarcs 13.1 Interim results (FRC)

Post by Ray »

500 Hiarcs 13.1 games have been played to date. More to come, but here are some interim results. Hiarcs 13.1 is approx 70 ELO stronger than Hiarcs 12.1 under these testing conditions, so far.

The pure list is here:
http://www.computerchess.org.uk/ccrl/40 ... _pure.html

In the pure database of 20,300 games, Hiarcs 13.1 is in number 5 position. This database includes only the strongest version from each engine family, and thus eliminates any potential distortion in the ratings from having multiple versions of the same family. However the statistical margin of error is higher because of the smaller number of games.


The overall list is here:
http://www.computerchess.org.uk/ccrl/404FRC/index.html

This database has 71,300 games and includes all games played. It will include potential distortion in the ratings from having multiple versions of the same family, but on the other hand with the greater number of games the statistical margin of error is less.

There will be a further update once all games have been completed. There will be another 400-500.
Ray
Posts: 22606
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Hiarcs 13.1 Interim results (FRC)

Post by Ray »

200 more Hiarcs 13.1 games added. The ELO improvement over 12.1 is now showing as +61 ELO, still a significant increase
Ray
Posts: 22606
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Hiarcs 13.1 Interim results (FRC)

Post by Ray »

Testing completed, 1,000 games.

+61 ELO for the new version
Post Reply