It would be nice for my data processing if you could make non-merged delta files available (like CEGT has).
In order to incorporate the data, I have to do diff files with gigabytes and a lot of different tedious steps.
You would not have to keep them forever, just the delta for each new release of data.
Request for deltas
- Kirill Kryukov
- Site Admin
- Posts: 7399
- Joined: Sun Dec 18, 2005 9:58 am
- Sign-up code: 0
- Location: Mishima, Japan
- Contact:
Re: Request for deltas
Well the only way for us to provide such deltas is by running diff on complete databases of two weeks. Simply uploading a separate PGN of only last week's games is not enough, because sometimes engines are removed or renamed, or errors are corrected, which affects older games. We take special care to provide complete and consistent database every time. Unfortunate consequence is that it makes incremental updates more difficult.
While I agree that it might be nice to have such deltas, it would complicate and slow down the processing for each update, and I don't see enough merit in adding this.
If updating each week is too much burden for you, may be you can do it once every month or two?
While I agree that it might be nice to have such deltas, it would complicate and slow down the processing for each update, and I don't see enough merit in adding this.
If updating each week is too much burden for you, may be you can do it once every month or two?
KCEC | EGTB Online | 3x3 Chess | 3x4 Chess | 4x4 Chess | Longest Checkmates | EGTB Test Suite | Opening Sampler | EGTB Bounty | NULP