The 70% Challenge (completed)

Questions and comments related to CCRL testing study
Post Reply
User avatar
Graham Banks
Posts: 26916
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

The 70% Challenge (completed)

Post by Graham Banks »

THE 70% CHALLENGE

Intel i7-4770k Quad
ChessGUI
256mb hash each where possible
3-4-5 piece tablebases
Ponder off
Active2023.cgb book
40 moves in 16 minutes repeating (adapted for CCRL)
6 cycles 54 rounds
An opening book that is fair, but should produce roughly a 70% draw rate amongst top engines.
Participants

Stockfish 16 64-bit
Dragon by Komodo 3.2 64-bit
Berserk 11.1 64-bit
Chess System Tal 2.00 64-bit
Ethereal 14.00 64-bit
RubiChess 20230410 64-bit
Koivisto 9.0 64-bit
Igel 3.5.0 64-bit
Revenge 3.0 64-bit
Clover 6.0 64-bit

Image

Image

Image

Image

Image

Image

Image

Image

Image

Image
User avatar
Graham Banks
Posts: 26916
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: The 70% Challenge

Post by Graham Banks »

THE 70% CHALLENGE

Intel i7-4770k Quad
ChessGUI
256mb hash each where possible
3-4-5 piece tablebases
Ponder off
Active2023.cgb book
40 moves in 16 minutes repeating (adapted for CCRL)
6 cycles 54 rounds
An opening book that is fair, but should produce roughly a 70% draw rate amongst top engines.
Final Standings

34.0 - Stockfish 16 64-bit
31.5 - Dragon 3.2 by Komodo 64-bit
28.5 - RubiChess 20230410 64-bit
27.0 - Berserk 11.1 64-bit
26.5 - Ethereal 14.00 64-bit
25.5 - CS Tal 2.00 64-bit
24.5 - Igel 3.5.0 64-bit
24.5 - Clover 6.0 64-bit
24.0 - Revenge 3.0 64-bit
24.0 - Koivisto 9.0 64-bit
Attachments
The 70% Challenge (Active2023.cgb).rar
Complete tournament pgn (zipped)
(241.6 KiB) Downloaded 56 times
Ray
Posts: 22606
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: The 70% Challenge (completed)

Post by Ray »

So did you achieve 70% ?
User avatar
Graham Banks
Posts: 26916
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: The 70% Challenge (completed)

Post by Graham Banks »

Ray wrote: Fri Sep 22, 2023 11:45 pm So did you achieve 70% ?
No - about 82% from memory.

Still looking at more lines to add to the book.
I've got all games lost by SF15.1, SF16, Komodo 3.2 and Dragon 3.1 (1CPU and 4CPU).
Just need to check the opening lines to make sure they're fair.
Post Reply