Request for deltas

Questions and comments related to CCRL testing study
Post Reply
dcorbit
Posts: 12
Joined: Mon Jun 09, 2008 10:18 pm

Request for deltas

Post by dcorbit »

It would be nice for my data processing if you could make non-merged delta files available (like CEGT has).
In order to incorporate the data, I have to do diff files with gigabytes and a lot of different tedious steps.

You would not have to keep them forever, just the delta for each new release of data.
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: Request for deltas

Post by Kirill Kryukov »

Well the only way for us to provide such deltas is by running diff on complete databases of two weeks. Simply uploading a separate PGN of only last week's games is not enough, because sometimes engines are removed or renamed, or errors are corrected, which affects older games. We take special care to provide complete and consistent database every time. Unfortunate consequence is that it makes incremental updates more difficult.

While I agree that it might be nice to have such deltas, it would complicate and slow down the processing for each update, and I don't see enough merit in adding this.

If updating each week is too much burden for you, may be you can do it once every month or two?
Post Reply