Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 135
Posts: 135   Pages: 14   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 161735 times and has 134 replies Next Thread
Paul Schlaffer
Senior Cruncher
USA
Joined: Jun 12, 2005
Post Count: 244
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

I'm running my 16 core machine with the BOINC data drive on an SSD (Intel X25-E). I've said this in other threads, I just don't think it's worthwhile to use a RAM Disk. An SSD provides excellent performance with CEP without the complexities, problems or cost of a RAM Disk. This has been working well for me for over a couple years now.

That said I don't think its worth it for you to upgrade to an SSD unless your running more than 4 WU per drive and the IO performance is suffering. Just monitor the performance for a while via resource manager.
----------------------------------------

“Where an excess of power prevails, property of no sort is duly respected. No man is safe in his opinions, his person, his faculties, or his possessions.” – James Madison (1792)
----------------------------------------
[Edit 2 times, last edit by Paul Schlaffer at Feb 13, 2016 5:03:31 AM]
[Feb 13, 2016 4:51:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Punchy
Advanced Cruncher
Texas
Joined: Nov 30, 2010
Post Count: 60
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

Paul has much longer experience than I, personally just starting to attack CEP a few weeks ago, but let me add my own experiences.

I have 2 32-thread systems, one with 64GB and one with 32GB, each running the BOINC data directory off an SSD. The 64GB system can run 32 WU simultaneously (though I only run 30 to leave spare CPU for monitoring) and the 32GB system can run 24 WU. This is by my own rule of thumb that each CEP2 WU takes up to 1.2GB of memory between the process' usage and the filesystem cache.

The older 120GB Sandisk SSD is losing 1% of its life (according to SMART data) every 2-3 days; the newer 240GB is losing 1% of its life each week, when used on the 30-WU system. That's the biggest downside I see to SSD usage. I do need to check out the X25 SSDs that Paul mentioned to see if they have better write lifetime capacity.

I tried using a ramdisk on the 64GB system, but that would not allow me to run as many WU; since the Windows ramdisks aren't integrated with the OS, they are stupidly duplicating the same files that are already in the filesystem cache. Since Linux has a built-in ramdisk of sorts, my hope is that there would be less duplication of files in memory, so I could run 30 WU from the ramdisk with occasional backups to SSD/HDD, perhaps improving performance and definitely improving SSD lifetime.

The biggest downsides I see to ramdisk are the data loss on power failures and the extra memory cost (and UPS cost if you want to add some security). However, even with the SSD and a UPS, an extended power failure will still likely cost you more than half of your work in progress since the first checkpoint typically takes much longer than the remaining checkpoints combined.
----------------------------------------

[Feb 13, 2016 4:48:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Gatchaman
Cruncher
Joined: Feb 29, 2012
Post Count: 49
Status: Offline
Reply to this Post  Reply with Quote 
Re: WU Availability

I'm going back in time for this explanation of the way I try to setup my boxes. The design philosophy of the Playstation2 or 3 was "Compute. Don't store". Can't remember which console it was for though. I read that somewhere and never really got it until trying to run CEP on a, ha ha ha, HDD. Never again.
Did some digging and read this http://www.overclock.net/t/1381131/ramdisks-roundup-and-testing#post_19728433

Then I did this with few tweaks of my own to my work machine http://www.xtremesystems.org/forums/showthrea...mp;viewfull=1#post5223632 . And never looked back.
There used to be an online store called Bespoke deals and in it a Beat my Price sub store where if you gave them an Amazon price they'd try to beat it.....and they did.....until Bespoke shut down the service. Got all my DDR3 from there and upgraded the crunching boxes as best I could.
The only trouble I ever got was my work machine, on rebooting, BSODing me after windows updates or I have to reboot because of something like corrupt usb ports but after a while it'll settle down again.
I've learned the very hard way that when things go wrong and the ram disk can't save to ssd in time then yep 7 days of WU can go up in digital smoke :-(.

Trying not to store on the 3770 anymore. As soon as the WU is finished it uploads asap. I think the 3770 has a max 1 day or less buffer. On the other hand 4790K is a 24/7/365 crunching machine and never BSODs and I never update it so that's the only box that has a large ramdisk WU buffer. That thing chomps through WU like a red hot knife through butter! Thinking about converting it to a Win7 or Linux machine.

The ramdisk has been my savior when it comes to CEP.
----------------------------------------

"Sadly this project is turning into nonscience......"
----------------------------------------
[Edit 1 times, last edit by Gatchaman at Feb 14, 2016 9:26:05 AM]
[Feb 14, 2016 12:09:26 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Paul Schlaffer
Senior Cruncher
USA
Joined: Jun 12, 2005
Post Count: 244
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

The older 120GB Sandisk SSD is losing 1% of its life (according to SMART data) every 2-3 days; the newer 240GB is losing 1% of its life each week, when used on the 30-WU system. That's the biggest downside I see to SSD usage. I do need to check out the X25 SSDs that Paul mentioned to see if they have better write lifetime capacity.


The X25-E's are older Intel SLC drives with a larger lithography. You can still find them on E-Bay cheaply. They are rated at 2 Petabytes for write endurance, and I over-provisioned the drive through the raid controller by 50% for additional endurance. The MWI after 2+ years is still 95%.

I do also have some 4 core systems on consumer grade Crucial 120 Gb SSDs with CEP and I'm not seeing any significant degradation. I would check to make sure TRIM is enabled since this will have large impact if its not. ACHI also needs to be enabled in the BIOS for TRIM to function. I could personally live with 1% a week although you would have to replace the drive every couple years. The prices have dropped a lot, and a Crucial 240Gb can be had for $60. However 1% every few days is not good.
----------------------------------------

“Where an excess of power prevails, property of no sort is duly respected. No man is safe in his opinions, his person, his faculties, or his possessions.” – James Madison (1792)
----------------------------------------
[Edit 1 times, last edit by Paul Schlaffer at Feb 19, 2016 10:23:48 PM]
[Feb 19, 2016 10:22:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Jim1348
Veteran Cruncher
USA
Joined: Jul 13, 2009
Post Count: 1066
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

The prices have dropped a lot, and a Crucial 240Gb can be had for $60. However 1% every few days is not good.

The Crucial drives (both BX and MX series) can make use of their Momentum Cache, included with the Storage Executive utility. That allows a cache of up to 4 GB if you have at least 16 GB main memory. That will greatly reduce wear on the SSD.

The Samsung drives can use the 1 GB Rapid Mode cache, included in their utility. That can also offer a lot of write protection.

I normally use a ramdisk myself to hold the BOINC data folder, but if I were using an SSD directly on CEP2, I would certainly want a write-cache, as large as possible. With a little luck, it might take you through the useful life of the drive.
[Feb 20, 2016 3:36:51 AM]   Link   Report threatening or abusive post: please login first  Go to top 
rudiservo
Cruncher
Joined: May 12, 2009
Post Count: 8
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

No work units available for the past 2 or 3 days, is everything ok?
[Mar 7, 2016 8:07:43 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: WU Availability

There appears to be a trickle of work, the waiting I suppose being on the OK of the BETA test. The project progress percent went back to 55 inferring there's work outlook for years to come.
[Mar 7, 2016 8:22:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Seoulpowergrid
Veteran Cruncher
Joined: Apr 12, 2013
Post Count: 817
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

In the last 5 hours or so I've been getting a good work flow of new WUs again across Win, Mac, and Linux machines.
----------------------------------------

[Mar 8, 2016 4:51:21 AM]   Link   Report threatening or abusive post: please login first  Go to top 
gb009761
Master Cruncher
Scotland
Joined: Apr 6, 2005
Post Count: 2982
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

For the last few days, there have been quite a few 'short' WU's (i.e., less than 2 Hrs CPU time on my machines), and this probably helped in depleting the supplies.

I've seen though, that I've now got some back in my queue.
----------------------------------------

[Mar 8, 2016 1:52:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
littlepeaks
Veteran Cruncher
USA
Joined: Apr 28, 2007
Post Count: 748
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: WU Availability

3/26/2016 8:47:36 AM | World Community Grid | No tasks are available for The Clean Energy Project - Phase 2

Been getting this all day, besides HST1 not having any WUs available, as well.
[Mar 26, 2016 7:29:54 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 135   Pages: 14   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread