CCRL Discussion Board

I think I misled when I labeled this a "tiebreaker". In reality, I am interested in what determines sort order within statistically tied engines. Agreed that Stockfish 14 and 15 are statistically tied at rank 1, and it should remain that way. Also agreed that all the stats (except number o...

I wasn't able to find this in a cursory search. What is used for a tiebreaker to determine "best engine" of a series for the 40/15 (and other) lists? Currently, Stockfish 14 and 15 are tied (on the complete 40/15 list) at 3538 ELO. But 14 is listed as "best engine" for the series...

I had a stalemate the other day due to No Legal Moves. That one's pretty rare - I didn't expect to actually see it in computer play. Wish I could remember which game it was.

Thanks for the suggestions! I'll give 'em a try.
I had intended to use the last "free" version of Komodo...I didn't realize there was a 5.1 MP separate from the regular 5.1. Whoops.

Hi,
I thought I'd add Pedone to the mega tournament as well. Where can I find a compiled version that doesn't have the time loss issue?

Wow, I just completed K2 0.57 testing in my mega tournament. Going to have to remove those and retest. Ouch!

I just realized, after trying - and failing - to find a chess engine names Gabor, that you were talking about the people, not engines!
(Incidentally, there IS an engine named Adam.)

Ah, okay. I'm using 1.4a; maybe there were problems with earlier versions? Anyway, other than the two crashes and the one illegal move, it's worked fine for me.

Sorry, I don't understand what you mean. Did you mean you were unable to get Bismark to work? Or that you did not experience crashes/illegal moves with it? Or, perhaps something else?

I'm trying to decide whether to remove Bismark from the tournament. It has crashed twice - meaning it only has one strike left - and today tried to commit an illegal move against Sjakk. That's the first attempted illegal move of the tournament, and I hadn't considered how to judge that. Incidentally...

Results so far (68 engines, 4556 games): Place Engine Score S-B 01 Stockfish 5 x64 126.0/134 8040.5 02 Houdini 1.5a x64 123.0/134 7611.2 03 Critter 1.6a x64 122.5/134 7596.5 04 Strelka 6.0 121.5/134 7482.0 05 Gull 3 x64 119.5/134 7295.5 06 Bouquet 1.8 x64 119.5/134 7292.0 07 Fire 3.0 x64 118.5/134 7...

Thanks for the research! I'll remove Kaissa as well then. I'm okay with keeping Chess 3x in even though it was commercial at one point.

As mentioned above, I will remove Belka and Patriot since they are clones. Since editing them out of the PGN can take a while, and it's easier to remove several at the same time, can you tell me if any of the following are also clones? These are the only 3 entered in the tournament that I haven't fo...

Thanks for the suggestions! I'll remove Belka and Patriot - I didn't know Belka was a clone, and I'd forgotten Patriot is - and add Orion, Sjakk, Adam, and Gobor. That still leaves 2 positions if anyone wishes to request them. EDIT: One major omission (in my opinion) is Crafty...I've entered them tw...

Here's another question...are games replayed if an engine loses due to time forfeit, and that engine did NOT crash? I've had 8 out of 4,830 games end in a time forfeit - 6 lost by Mustang and 2 by Bouquet. To me, an inability to manage time correctly should reduce an engine's ELO, so I have allowed ...

I have eliminated several engines from the tournament due to instability, or due to newer versions being released. I am now working my way back up to 75. Here are the 71 engines that have been entered so far. Are there any engines not on this list that any of you would like to see entered? Rules for...

That makes sense. I've been using the "Perfect 2010" book and haven't observed it yet.

My Google-fu must be lacking then...I didn't see any discussions on it. Sorry about that

I know that, ordinarily, ELOs calculated for engines are not comparable to human ELOs. And, there's the added complexity that different chess federations have slightly different ELO calculations/systems. That said, I wondered...is there any data available where a human opponent with an established E...

Ah! Well, I'll do what I can by hand in the meantime. Thanks for letting me know.

Hmm...that makes sense; unfortunately I'm not aware of any way to review the PGN file and determine when that occurred. Is there any way to enforce that rule besides watching every game? I've not seen any opening result in an advantage greater than 0.40 so far, but 0.70 could have happened, theoreti...

Good to know! Makes me wonder if there are any other CCRL testing rules I've missed.

CCRL games must have a minimum of 14 moves. To clarify, is that 14 moves (plys), or 14 turns ? If it's 14 turns, then I need to delete those 2 games and have them replayed...as I've been trying to use official CCRL rules. And out of curiosity, what's the reasoning behind the (presumed) 14-move mini...

Just curious what the shortest match (fewest turns) and longest match (most turns) you've ever seen are.

So far in my "mega" tourney, I've had 2 games that ended on turn 13, and one that was declared a draw after turn 250. (It would have gone to 255 if I'd let it.)

Thanks for the suggestion! I probably will post there when I'm done. In the meantime, here are the engines that have been disqualified due to instability: BlackMamba 2.0 Conqueror 1.1b Eia 0.3 Protej 0.58c I've also dropped 4 engines out as newer versions were released while the tourney was running ...