CCRL Discussion Board

I'll have to take a look at those other 3, thanks.

Ray, thanks for your input; let me know if you spot any other incorrect settings.

I just wanted to follow up on this. I am interested in helping CCRL testers find "best version" engines that have been missed. I thought the best way to do this would be to run 40/4s on unlisted engines and report back the results, but I may be wrong considering Graham doubts "any of ...

Thanks for the response! I'm still not completely certain I have the books and EGTBs set up properly but will check the Arena documentation to be sure. Out of curiosity, what GUI do you typically use, and what makes it a better choice for you than Arena?

CCRL does a pretty good job of documenting the testing settings they use, and a great job of standardizing everything. I'm trying to exactly match the CCRL testing protocol, and wondered if someone (probably Graham :D) could review my settings, below, to see if I messed up anything. I'm especially c...

It's amazing how much chess engines have proliferated since 2005. I suppose the Kasparov-Deep Blue matches inspired many chess lovers/programmers to see how strong of an artificial opponent they could create. Heck, I'd love to try creating a chess engine too, but though I can program in 3 languages,...

Out of curiosity, why? Do those engines have some history I am unaware of? The whole point to the testing I'm doing is to find engines that might have been missed/overlooked by the main testers. If my results will not generate interest amongst the CCRL testers, then there's no reason for me to conti...

Looks like Belka and Patriot are both worth further looks - after Round 2 they are both outscoring all engines except Stockfish. Stay tuned.

Interesting, I would have considered them to be different (just as I would have considered Ivanhoe to be different from Ippolit).

For what it's worth, I don't think you're wasting anyone's time. The CCRL isn't just about looking for the strongest engine; it's also about finding where all other engines fit, and helping their creators make improvements. I plan to continue testing Eia 0.3 in my 40/4 tournament, at least. I'll let...

Heh, that's fair. I certainly doubt I would have that patience or time. Still, due to the ubiquity of Chess Titans it would be nice to see it on the CCRL at least.

As stated on other threads, I've watched the CCRL for some time and have a lot of interest in it. I also do a little CCRL-style testing, though I limit myself to the most recent versions of free engines that aren't already listed on CCRL. Besides the CCRL website itself, what are some of the best/fa...

First off, I apologize for posting so many topics on my first day. I just had a lot of discussions I have thought about starting for a while. Anyway...I would love to see how non-protocol engines such as Chess Titans would do on the CCRL. But, lacking an interface interpretable by Arena and other GU...

It is obviously an impossibility to know this for certain; I'm just curious as to what others would guess. If one were to look at the entire history of computerized chess, regardless of platform, hardware, geography, etc....how many different publicly released, stable series would you guess have exi...

Aha! I did miss the NG-Play engine due to the dash in the name. Of the others, however, I only saw an older version of Eia (0.2), so I think they truly are new. Interestingly, both Belka and Patriot are doing well right now. As expected, they both lost to Stockfish, but they beat Mustang and Frenzee...

Unfortunately, it's dropping fast. Trending towards 2100 now.

I wasn't able to find any of the shorter list in the 40/4 list...I'll have to look again. (I originally posted a list of 20+ engines, then realized many of those were in the 40/4. Those have since been removed.) EDIT: Are you certain NGPlay is on the 40/40 list? I cannot find it, so if it is, I must...

If anyone's interested, here are the "new" engines I am testing right now. (If any of these HAVE been tested by CCRL, please let me know. I originally said I had 20 but I only thought to check the 40/40 list...40/4 had several of them already.) Reference: HIGH- Stockfish 5 x64 oldCPU --- #...

Ah, that's fair! I didn't realize the CCRL guys actively monitor for such aberrations and make changes as needed.

It sounds like you're comfortable that the Ziggurat ratings accurately reflect that engine's capabilities; so long as that's the case, I'm satisfied. Thanks.

Interesting! Thank you for clarifying. Nevertheless, it may still be a good idea to disqualify the engine. The engine appears unresponsive to time controls, at least in my tests. Each move takes roughly the same time on 40/40 as it does on 40/4. This may cause an artificially low score in both envir...

Just be aware that antivirus scans can register false positives sometimes as well. For example, my fully-up-to-date copy of Norton Internet Security 2014, with the most aggressive settings possible, blocks two of the latest Spark engines due to "poor reputation", not any genuine viral acti...

I apologize if this subject has been discussed before, but I have not found it on the forum. I would recommend disqualifying the Ziggurat engine. My tests have indicated it is not capable of effective time management, meaning that it frequently forfeits due to time. In fact, I'd go so far as to sugg...

I am running a preliminary 40/4 tournament that includes Eia and 19 other engines that have never been tested (in any version) on CCRL. It's still early, but based on preliminary results versus the 3 reference engines (Stockfish 5 x64-old, Frenzee 3.5.19 x64, and Mustang 4.97) I'm guessing it's arou...

Hello, I've watched CCRL for some time, but only recently registered so I could post this topic. I'm interested in engines that aren't currently on the CCRL lists, to see if any of them are "hidden gems". Right now, I am using CCRL's 40/4 protocol to test 22 new engines - including the Eia...