Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 76
Posts: 76   Pages: 8   [ Previous Page | 1 2 3 4 5 6 7 8 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1003380 times and has 75 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: RAMDisk

Hi Jim1348,
glad to have you back! Happy crunching.
Your Harvard CEP team
[Jun 5, 2012 3:39:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
hnapel
Advanced Cruncher
Netherlands
Joined: Nov 17, 2004
Post Count: 82
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: RAMDisk

What about solid state disks? I'm thinking of getting one, hope usb 3.0
is fast enough to see any improvements over sata disks.
[Jun 6, 2012 10:57:42 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: RAMDisk

Here running a USB 3.0 Corsair 64GB with Linux 12.04 and client 7.0.28. Not a single fail. Tried all sciences, except CEP2 [on to do list when I've got loads of planned idle time for the system]. Write to Disk / Checkpointing is set to 900 seconds at most, to reduce write ware [that setting has no effect on CEP2, else would set it to 12 hours on all systems] and I've formatted it to ext2, so the journal function of ext3/4 does not add to the load and ware. Generally getting max efficiency, practically matching what W7-64 achieves for all.

--//--
[Jun 6, 2012 11:32:32 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Jim1348
Veteran Cruncher
USA
Joined: Jul 13, 2009
Post Count: 1066
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: RAMDisk

What about solid state disks? I'm thinking of getting one, hope usb 3.0
is fast enough to see any improvements over sata disks.

Yes, I think you will see an improvement in general operation, and certainly boot up and shut downs will be faster. And it will help to bring up the CPU efficiency on CEP2 with the large number of writes. However, if you run a Sandy Bridge or Ivy Bridge quad-core and allow all four (or eight virtual) cores to run CEP2 at once, then the writes can go through the roof. You could get 1 TB (as in terabytes) of writes per day. That may work for a few months, or even a few years, but I would not bet the life of my SSD on it. So I use a Ramdisk, to keep the writes in main memory. I think if you only allowed the default single CEP2 to be downloaded, then I would not worry much about the writes, though it could still be over 100 GB per day.
[Jun 6, 2012 2:36:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: RAMDisk

Jim

How goes the test of the RAM Disc software you dug out re the SSD writes issue?

I am running a 3960x/16Gb RAM over two SSDs, and would be very interested in your experiences so far, as I also share a long term concern over the massive writes that CEP2 does - in particular - to SSDs.

I have a couple of good Hard Discs that I can put in the beast as additional drives, if this issue is still open, but don't really want to do that, as it would be (as such) a step backwards.
----------------------------------------
[Edit 3 times, last edit by Former Member at Jul 13, 2013 10:22:37 PM]
[Jul 13, 2013 10:16:56 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jim1348
Veteran Cruncher
USA
Joined: Jul 13, 2009
Post Count: 1066
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: RAMDisk

Zydor,

I am using Primo Ramdisk on three Ivy Bridge PCs at the moment; I bought the three license package. On two of the machines I am running six virtual cores each of CEP2, and they have been running fine for months with no problems at all. On the other machine, I run a couple of cores of CEP2, with another core on the Climate Prediction Network (CPDN), which also produces a LOT of writes (comparable to CEP2), and also benefits from a Ramdisk.

Two of those PCs use SSDs, but for the most recent one I just used an old 2.5 inch notebook drive I had lying around; it really doesn't matter in operation, since everything requiring high speed is done from Ramdisk anyway. But the startup and shutdown times are a lot longer with that old mechanical drive; a total of 7 minutes for a reboot with a 12 GB ramdisk. However, it is a dedicated machine, and so I can leave it alone for weeks or months at a time once it is set up (all Win7 64-bit by the way).

I also tried out again the free version of Dataram Ramdisk on my main PC (a Core2 Duo) for some CPDN work. They seem to have improved the speed of transferring the backup files to and from the disk (a Samsung Series 470 SSD in my case), and it worked quite well with even a 4 GB size ramdisk. But I finally uninstalled it due to problems with CPDN on this machine, and seemed to have had some problems getting the Ramdisk totally uninstalled as well, though that may have been more my fault than anything. I think it is still a good option, either the free or paid version.
[Jul 14, 2013 1:47:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 76   Pages: 8   [ Previous Page | 1 2 3 4 5 6 7 8 ]
[ Jump to Last Post ]
Post new Thread