Adding a new engine to the lists

Questions and comments related to CCRL testing study
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Adding a new engine to the lists

Post by Daniel White »

Hello,

How does one 'submit' their engine to be tested? I have searched google, CCC and this forum but cannot find anything - am I missing something obvious, or does your engine have to be noteworthy in some sense?

Daniel
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

First of all, the engine in question must be publicly released as we don't test private versions.
It would also be useful to provide some details about the engine - estimated strength, development history, etc.
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Re: Adding a new engine to the lists

Post by Daniel White »

The engine is publicly available and released under the GPL - currently hosted on Gitorious (https://gitorious.org/adroitchess), and I would estimate the strength to be in the range 2000-2500, but the accuracy of that is limited at best. As for development history, I'm a typical amateur who has written the engine almost from scratch(*) using things like the CPW, CCC and other engines.

* I am currently using Pradyumna Kannan's magic move generator. This is the only piece of code which is not original.
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Re: Adding a new engine to the lists

Post by Daniel White »

The engine is publicly available and released under the GPL - it is hosted at Gitorious (https://gitorious.org/adroitchess). I would estimate the strength at 2000-2500 ELO, however this is more than likely very inaccurate. As for development history, I am probably your typical chess programing amateur, using resources like the CPW, CCC and other engines for inspiration. Almost all of the code is completely original (except for Pradyumna Kannan's magic move generator, which I believe I am using in accordance with his 'licence').

One final note: The engine is current Linux only (I have no access to a Windows computer) - is this an issue?
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Unfortunately, I don't think that any of our testers are testing through Linux. :(
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Re: Adding a new engine to the lists

Post by Daniel White »

Ah, that is a shame. I suppose I have nothing more to add then :p

Thank you for your time regardless
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Daniel White wrote:Ah, that is a shame. I suppose I have nothing more to add then :p

Thank you for your time regardless
Sorry about that. If you can find somebody that you trust to do a windows compile, please let us know.
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Re: Adding a new engine to the lists

Post by Daniel White »

I am not sure how easy that would be as I currently use various things like POSIX threads which tend to be UNIX-only. MinGW would probably solve many of other the issues, however. I simply don't know enough about Windows and other operating systems to make the code less OS-specific.

I think I will just have to rely on my limited private testing for now.
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

If you ask around the forums, you might find a reliable trustworthy tester who uses Linux.
User avatar
Adam Hair
Posts: 1566
Joined: Sun May 30, 2010 3:28 am
Sign-up code: 10159
Location: Fuquay-Varina, North Carolina, USA

Re: Adding a new engine to the lists

Post by Adam Hair »

Jim Ablett has made a 32-bit compile of AdroitChess for Windows users (he was not successful at building a 64-bit version).
http://dl.dropbox.com/u/5047625/adroitchess-03-ja.zip
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Adam Hair wrote:Jim Ablett has made a 32-bit compile of AdroitChess for Windows users (he was not successful at building a 64-bit version).
http://dl.dropbox.com/u/5047625/adroitchess-03-ja.zip
I'll try out AdroitChess 0.3 in a couple of matches and post the results here. :)
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Image
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Re: Adding a new engine to the lists

Post by Daniel White »

Wow, I'm surprised anyone cares enough about such a weak engine - thanks guys!

Can't wait to hear how it goes, Graham.
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Daniel White wrote:Wow, I'm surprised anyone cares enough about such a weak engine - thanks guys!

Can't wait to hear how it goes, Graham.
You're welcome Daniel. I'm mainly interested in seeing whether AdroitChess is strong enough to be included in my amateur series at this stage.
However, I'm hoping that your engine will be tested for our 40/4 list more extensively.
First up match is against Chesley r323. :P
User avatar
Adam Hair
Posts: 1566
Joined: Sun May 30, 2010 3:28 am
Sign-up code: 10159
Location: Fuquay-Varina, North Carolina, USA

Re: Adding a new engine to the lists

Post by Adam Hair »

My prediction, based off of a epd test suite I am working on, is ~2050 Elo. Unfortunately, my error bars at this time is +/- 250 Elo.
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Adam Hair wrote:My prediction, based off of a epd test suite I am working on, is ~2050 Elo. Unfortunately, my error bars at this time is +/- 250 Elo.
Chesley r323 is leading 6.5-1.5 so far, so your estimate is probably fair.
User avatar
Adam Hair
Posts: 1566
Joined: Sun May 30, 2010 3:28 am
Sign-up code: 10159
Location: Fuquay-Varina, North Carolina, USA

Re: Adding a new engine to the lists

Post by Adam Hair »

Graham Banks wrote:
Adam Hair wrote:My prediction, based off of a epd test suite I am working on, is ~2050 Elo. Unfortunately, my error bars at this time is +/- 250 Elo.
Chesley r323 is leading 6.5-1.5 so far, so your estimate is probably fair.
I am going to include it into my ongoing Also-Ran tournament. I will start a 100 game gauntlet now.
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Adam Hair wrote:
Graham Banks wrote:
Adam Hair wrote:My prediction, based off of a epd test suite I am working on, is ~2050 Elo. Unfortunately, my error bars at this time is +/- 250 Elo.
Chesley r323 is leading 6.5-1.5 so far, so your estimate is probably fair.
I am going to include it into my ongoing Also-Ran tournament. I will start a 100 game gauntlet now.
Excellent - would be great to eventually get it established in the 40/4 list at least. :)
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

(7.0-3.0) Chesley r323 v AdroitChess 0.3
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

AdroitChess 0.3 has started well against MatMoi 7.15.0, winning the first two games. :)
Daniel White
Posts: 8
Joined: Sun Jan 22, 2012 4:32 pm
Sign-up code: 10159

Re: Adding a new engine to the lists

Post by Daniel White »

Graham Banks wrote:(7.0-3.0) Chesley r323 v AdroitChess 0.3
Thanks. The first game is really useful, seems my endgame needs some work...
User avatar
Adam Hair
Posts: 1566
Joined: Sun May 30, 2010 3:28 am
Sign-up code: 10159
Location: Fuquay-Varina, North Carolina, USA

Re: Adding a new engine to the lists

Post by Adam Hair »

Graham Banks wrote:
Adam Hair wrote:
Graham Banks wrote:
Adam Hair wrote:My prediction, based off of a epd test suite I am working on, is ~2050 Elo. Unfortunately, my error bars at this time is +/- 250 Elo.
Chesley r323 is leading 6.5-1.5 so far, so your estimate is probably fair.
I am going to include it into my ongoing Also-Ran tournament. I will start a 100 game gauntlet now.
Excellent - would be great to eventually get it established in the 40/4 list at least. :)
Based on 120 games, AdroitChess 0.3 has a rating of 2057 Elo. No time forfeits either :D . I will start a full scale gauntlet immediately. That way, Daniel can get an approximate Elo rating while studying your games to find areas of Adroit's play that can be improved on.
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

(7.5-2.5) AdroitChess 0.3 v MatMoi 7.15.0
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

Next up is a match against Monarch 1.7 which is about halfway between Chesley r323 and MatMoi 7.15.0 in strength.
User avatar
Graham Banks
Posts: 27006
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: Adding a new engine to the lists

Post by Graham Banks »

(5.5-4.5) Monarch 1.7 v AdroitChess 0.3
Post Reply