TB test - HD v Flash

Questions and comments related to CCRL testing study
Post Reply
User avatar
Shaun
Posts: 6889
Joined: Sat May 13, 2006 3:24 pm
Sign-up code: 10159
Location: Brighton. UK

TB test - HD v Flash

Post by Shaun »

I thought I would share these results here as they are very interesting...

Hardware.

Q6600 at 3.2Ghz - (9 x 356 @ 44412)
Gigabyte P965 DS3

HD Seagate 7200.10 16mb 320GB
and
Flash EMTEC Intuix S520 8 GB USB 2.0

Each engine was allocated 2GB Hash, or the maximum it could use (Naum 1GB).
5 Men TBs on either HD or Flash Memory
TB Cache 32MB

The machine was restarted between each test and any startup activity was allowed to finish before the test was started, the machine also had minimum background tasks e.g. no AV etc (standalone machine no network connection).

Attached are some Graphs + raw data

The position

8/3k4/p6r/5R2/PP5p/7K/8/8 w - - 0 1

was chosen as it causes a lot of TB access.

It should be noted that this test is a worst case scenario as in an actual game the TBs will be cached in any spare physical ram - and this explains the increase in nodes/sec as the test progresses.

Shaun

P.S. I will Update as I run more tests and I have a seconds Flash drive for comparison arriving next week...
Attachments
Hiarcs
Hiarcs
Hiarcs TB access.JPG (39.98 KiB) Viewed 4336 times
Naum (HD 128MB was 128MB TB Cache instead of 32MB)
Naum (HD 128MB was 128MB TB Cache instead of 32MB)
Naum TB access.JPG (36.83 KiB) Viewed 4335 times
Rybka
Rybka
Rybka TB access.JPG (40.22 KiB) Viewed 4332 times
Zappa
Zappa
Zappa TB access.JPG (46.9 KiB) Viewed 4335 times
TB tests 2.txt
Raw data
(74.09 KiB) Downloaded 274 times
megamau
Posts: 3
Joined: Sun Oct 21, 2007 12:17 pm

Re: TB test - HD v Flash

Post by megamau »

It seems that the improvement is quite substantial.
However it may be that this position is too oriented towards tablebases access.
Do you plan to test with some endgame suite ?
User avatar
Shaun
Posts: 6889
Joined: Sat May 13, 2006 3:24 pm
Sign-up code: 10159
Location: Brighton. UK

Re: TB test - HD v Flash

Post by Shaun »

megamau wrote:It seems that the improvement is quite substantial.
However it may be that this position is too oriented towards tablebases access.
Do you plan to test with some endgame suite ?
Hi,

yes I agree. In fact the position was chosen because it caused a lot of TB access - I wanted to see the difference between hard drive and Flash memory performance. How much TBs effect performance and therefore how much difference fast or slow TB access makes is a different question ;)

Shaun
User avatar
Shaun
Posts: 6889
Joined: Sat May 13, 2006 3:24 pm
Sign-up code: 10159
Location: Brighton. UK

Re: TB test - HD v Flash

Post by Shaun »

A couple of the graphs above have been updated with additional test results.

Two different flash drives have been tested plus splitting the TB's across 2 flash drives to see how much that helps.

Key:
HD - Seagate 7200.10 16mb 320GB Flash - EMTEC Intuix S520 8 GB USB 2.0 Flash (OCZ) - OCZ 8GB ATV Dual Channel Flash Memory Drive Flash x2 - TB's spread across the 2 - I put white on one black on the other
I have also added some additional graphs showing time to ply, I think this is particularly intersting as it shows the effect of TBs on depth reached. Looking at the Hiarcs and Zappa results it would seem to suggest that having the TB's on a single HD may actually hurt performance compared to not having the TBs. Where as flash shows improvement, I assume this is due to processors having improved dramatically more than hard drives. A fast raid array is likely to show a different story...

I doubt the actual effect in engine matches would be more than a few elo but I am probably going to run a test or two just to check.

Shaun
Attachments
TB tests 2.txt
Updated raw data
(97.08 KiB) Downloaded 243 times
Zappa time to ply
Zappa time to ply
Zappa TB access (time to Ply).JPG (43.18 KiB) Viewed 4167 times
Time to ply first 10 minutes
Time to ply first 10 minutes
Hiarcs TB access (time to ply 10minutes).JPG (41.64 KiB) Viewed 4166 times
Time to Ply
Time to Ply
Hiarcs TB access (time to ply).JPG (42.7 KiB) Viewed 4165 times
Updated Zappa Graph
Updated Zappa Graph
Zappa TB access.JPG (42.79 KiB) Viewed 4165 times
Updated Hiarcs Graph
Updated Hiarcs Graph
Hiarcs TB access.JPG (55.88 KiB) Viewed 4170 times
Post Reply