Houdini 2.0 x64 chess960 testing

Questions and comments related to CCRL testing study
Post Reply
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Houdini 2.0 x64 chess960 testing

Post by Ray »

This is well under way.

First result:

Houdini 2.0 x64 vs Critter 1.2 = 63.0 - 37.0

Incredible performance against the existing number 1 engine. I could not believe what I was seeing

Further results to come, and by the looks of it they are just as impressive as the one above
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

Some more results:

Houdini 2.0 x64 vs Stockfish 2.1.1 = 63.0 - 37.0
Houdini 2.0 x64 vs Naum 4.2 x64 = 82.5 - 17.5
Houdini 2.0 x64 vs Hiarcs 13.2 = 88.0 - 12.0

Matches against Spike 1.4, Rybka 4.1 and Shredder 12 will finish in a few hours
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

So far Houdini looks like this. Balance of the games and a proper web site update will be within 12hrs from now

Code: Select all

CCRL 404FRC Rating List - All engines, best versions only
98000 games played by 97 programs, run by 1 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on September 4, 2011 with Bayeselo based on 98'000 games

           Engine            ELO   +    -   Score  AvOp  Games
 1 Houdini 2.0 64-bit         3388  +33  -32  74.1% -194.8   400
 2 Critter 1.2 64-bit         3329  +23  -22  72.1% -174.8   800
 3 Stockfish 2.1.1 64-bit     3288  +20  -19  65.1% -115.2  1000
 4 Rybka 4.1 64-bit           3269  +19  -19  64.0% -107.8  1000
 5 Naum 4.2 64-bit            3132  +13  -13  51.8%  -16.2  2500
 6 Shredder 12                3115  +13  -13  48.6%   +8.7  2200
 7 Spike 1.4 Leiden           3044  +16  -16  47.6%  +12.7  1700
 8 Hiarcs 13.2                3024  +15  -15  45.2%  +38.2  1900

Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

Rybka result in:

Houdini 2.0 x64 vs Rybka 4.1 x64 - 70.0 - 30.0
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

Spike 1.4 result in:

Houdini 2.0 x64 vs Spike 1.4 = 87.0 - 13.0

Just Shredder to come
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

Shredder 12 result in:

Houdini 2.0 x64 vs Shredder 12 = 79.0 - 21.0

The ratings list will now be updated.
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

The website will take a couple of hours to update, but here is what it looks like (pure list). Houdini 56 ELO clear in number 1 spot.
Ray
Posts: 22590
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: Houdini 2.0 x64 chess960 testing

Post by Ray »

Post Reply