CCRL Discussion Board

Looking at some of rybka losses I found that in the following game hiarcs used book when rybka was out of book because d6 and Bd7 played in 0 seconds when white used time [Event "CCRL 40/40"] [Site "CCRL"] [Date "2007.06.21"] [Round "1.63"] [White "Rybka ...

I agree with Uri that strong, stable engines, weakened by somehow limiting their resources, would provide a lot better rating scale than engines that are weak because of horrendous bugs. The latter do often not conform to the underlying rating model at all. E.g. Omar is known to resign as soon as h...

The target of the list that I think about is not to compare different engine and to claim engine A is better than B but a different target. My target is 1. To find ranking of free engines. 2. To estimate rating differences for close engines. (3. To find various other things in the process like pond...

I clearly care about rating and not only about ranking. The problem is that I want rating to tell us which programs earns more from time and situation of unrealistic rating can cause wrong impression. I also want rating to be closer to the rating against humans and I think that it can be good if hum...

I also suggested time handicapped matches in the past and I think it is good to play 40/40 against 40/4 but there is a problem with the same idea of 40/4 against faster time controls. The problem with time handicap at blitz time control is that I am afraid that things may be dependent too much on th...

I agree that fixed node rating list is also interesting. The main problems with fixed nodes are the following problems 1)Fritz interface does not support fixed nodes but support fixed depth and I believe that less engines support fixed number of nodes(I did not check it). 2)If you use small number o...

<snipped> I think any fixed depth comparison does not make sense. Because 1. Programs define depth differently. 2. Search extensions are used by most of programs. 3. Even if we knew how to define depth, we have no way to know at what depth a program is thinking, because all we have is program's own ...

In case that you are interested to have fixed depth rating list I can help by providing games and results. conditions that I use 1)no tablebases 2)hash=64 mbytes per engine 3)opening 1.a3 1.a4 1.b3,... (all the possible opening of 1 ply) Results so far that I have Rybka2.3.2a depth 6: Yace0.99.87 de...

I continue names when I am unsure abut them or I am sure that they are non consistent 20)Scorpio 1.9 32-bit 2CPU 2774 +39 ?40 37.1% +85.5 36.4% 217 (?Scorpio 1.9JA 2CPU probably different) 21)Glaurung 1.2.1 Avalanche 32-bit 2773 +32 ?32 52.3% ?17.4 35.0% 331(identical to Glaurung 1.2.1 (Avalanche) 3...

Here is a summery of top non consistent names or cases when I am not 100% sure which program played 1)Rybka 2.1 64-bit 2CPU 3075 +26 ?25 73.4% ?166.8 34.3% 571 ? (is it identical to rybka2.1o in the blitz) 2)Deep Shredder 11 64-bit 4CPU 3021 +18 ?17 55.7% ?39.2 43.5% 1031 (? with (5-men-FSB) from bl...

Here is some other non consistent name Twisted Logic 0.080b26 in the long time control may be the same as Twisted Logic 0.80beta26 in the blitz section. Petir 4.9999 in the 40/40 when Petir 4.999999 in the 40/4 Are they the same or not the same? I try to make comparison between programs at different...

Thanks
Some more questions:
1)Danasah 2.85 from 40/40 is identical or not identical to DanaSah 2.85k from blitz?
2)Toga II 1.3.4 from 40/40 is identical to Toga II 1.3.4 from 40/4 that has only 14 games or maybe it is identical to
Toga II 1.3x4 that was seriously tested in blitz?

I find that some engines have different names between blitz and long time control and in some cases it is even not clear which engines were tested exactly for comparison between the lists. For example Scorpio family blitz has the following: 1 Scorpio 2.0 32-bit (5-men-egbb) 4CPU 2826 +23 −24 28.1% +...

I can suggest to test Movei progress 10 10 10 in future tournaments and not the default personality that has enough games. All the evidence in tournaments of other people that I see support that this personality is better than the default personality. From the CCRL blitz Movei 00.8.438(10 10 10) 272...

The author claims playing strength of 2100 for that commercial program but I know no objective organization that tested this program to give more accurate rating. You can download it for 15 days of trial and after it you can buy it in case that you are interested in it. I am not sure if the key is n...

Update this will probably be available view the .live site tonight # Computed on 2007-05-15 # Based on "CCRL-404.[124178].pgn" # Name => ELO ( + - ) Score AvOp ( AvDf) Draws Games (+W-L=D) Movei 0.08.418(10 10 10) => 2660 ( +27 -27) 48.7% +7.6 ( 67.0) 27.8% 479 (+167-179=133) Movei 0.08.4...

In my last post I meant mainly to CCRL 40/40
I understood that 10 10 10 is running in CCRL 40/4

about FRC I did not test 4 6 10 at FRC to say if it is better than 10 10 10
in these conditions.

Uri

It seems that progress1=4 progress2=6 progress3=10 is better than the 10 10 10 personality(based on Jorge tests and also based on my own tests.

I see that testers still did not start to test 10 10 10 so I decided that I prefer testing 4 6 10 if possible.

Uri

More results http://computerchess.org.uk/ccrl/404.live/cgi/compare_engines.cgi?family=Movei&print=Rating+list&print=Results+table&print=LOS+table&print=Ponder+hit+table&print=Eval+difference+table&print=Score+with+common+opponents&match_length=30 403 10 10 10 running Sha...

Thanks

Note that 403 10 10 10 performed better than 418 10 10 10 in my tests.

I did not play enough games so I do not know if it is because of luck or because of other reasons.

Uri

<snipped> It is also possible to change personality under winboard but in that case you need to generate a special movei_changes403.ini file and write inside it progress 10 10 10 and put that file in the same folder as the exe file. Uri only one correction as winboard engine you need to write progre...

Uri - when I load Movei in the Shredder Classic II GUI and then open engine options, I do not get any "progress" parameters that I can change. I haven't looked in Arena or Chessbase GUIs yet. Do you use movei as winboard engine or as uci engine? If you use movei as winboard engine you hav...

After the last bad results of default 403 I feel that I can lose nothing by trying some significant change in the parameters. Even if I find that pro10 is weaker at long time control then the default I can learn something from it for future versions that I release and I am afraid that testing a sma...

How about we call it Movei 0.08.403 Pro10? You can use that name. pro10 may be 100 elo better or 100 elo weaker at ccrl time control relative to the default and I simply do not know. After the last bad results of default 403 I feel that I can lose nothing by trying some significant change in the pa...

I see that some personalities of Glaurung1.2.1 were tested I prefer seeing progress 10 10 10 personality in future tournaments. progress1 progress2 progress3 are uci parameters that it is possible to change in movei. Uri Hi Uri, I'm prepared to give this personality a go. Where exactly are the chan...