Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 84
Posts: 84   Pages: 9   [ Previous Page | 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 863429 times and has 83 replies Next Thread
deltavee
Ace Cruncher
Texas Hill Country
Joined: Nov 17, 2004
Post Count: 4884
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Set to 2 and now have 2 in the buffer. I hope to keep one crunching per quad, for now.
----------------------------------------
4849
----------------------------------------
[Edit 1 times, last edit by deltavee at Dec 15, 2010 10:30:53 PM]
[Dec 15, 2010 10:29:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation



@Nano: laughing Hint; begins with H.

cowboy

Horny?
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[Dec 15, 2010 11:08:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Thank you techs/admin for going the extra mile and answering our pleas for help.
----------------------------------------

[Dec 16, 2010 1:31:04 AM]   Link   Report threatening or abusive post: please login first  Go to top 
kateiacy
Veteran Cruncher
USA
Joined: Jan 23, 2010
Post Count: 1027
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Thank you to the techs from here, too! I love CEP2, and this makes it easier to run. :)
----------------------------------------

[Dec 16, 2010 2:05:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Dataman
Ace Cruncher
Joined: Nov 16, 2004
Post Count: 4865
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

First, thanks for the quick fix to allow one to select the number of threads to run. This will help a lot of people run this project. Thanks also for putting up with all my questions.
@cleanenergy:
I have completed a lot of experimenting trying to efficiently run this project. I hope cleanenergy will give me credit (or 7 WCG dog year points biggrin ) for trying to run this project but it just does not work for the configuration of my machines. Some of these problems are due to the fact I am running 10-12 GPU’s at any given time.

1. Due to increases in the amount of CPU the GPU’s are using, I cannot complete the wu’s in 12 hours. Some GPUGrid wu’s now use 31% CPU/GPU; up from 16-18%. I watched one CEP2 job exit this morning with only 9 minutes remaining but none are completing before 12 hours. I’m not sure why a 12 hour cutoff is mandatory for this project but it is a deal breaker for me.
2. Clock time vs. CPU time is very bad. For example 11:11:38 (9:48:12). Very inefficient. This is not a GPU issue as my Dengue’s on the same machines are getting times like 8:34:12 (8:29:14)
3. Bandwidth collisions are still a big problem for me. I think you said you are not throttled on your end but, in round numbers, it takes just ~80% of the time for me to up load a 26 meg file to GPUGrid as it does to upload a file of the same size to Harvard. I tracked 6 pairs of these to validate this.
4. Checkpointing is insane and virtually useless. I am looking at some now; 9 checkpoints in 4 hours, 3 checkpoints in 7 hours and one with 1 checkpoint in 11 hours and that single checkpoint only happened 1 ½ hours ago. I lost a lot of time Wed due to the required Windows Updates restarts. Another deal breaker.

As I posted before, I think the science is good and certainly worth pursuing but I will leave it up to other crunchers to do this project. peace

cowboy
----------------------------------------


[Dec 16, 2010 8:08:41 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Welllll... CEP2 running off the same core as a GPU job sucking part of the CPU will cause the CEP2 jobs to use more ''elapsed'' time, but why your high end monsters would not manage to complete a very large proportion of these jobs in under 12 ''CPU'' hours is a riddle to me.

Anyway, with what information you provide, you might want to investigate using "Process Lasso" which allows to pre-designate ''affinities'' for specific job app names, so you'd be able to configure CEP2 to only have 2 on the client ''in progress'' at any one time and then force them to run off say core 2 and core 3 whilst defining your GPUgrid jobs to run off core 0 and 1 and leave the rest of the BOINC apps to free flow and occupy any core that BOINC sees as available. I've been using this tool for a very long time on XP, Vista and W7 and works a treat, plus there are many tuning refinements you can set with that tool, load balancing and all. It's free, occasionally popping up a count down nag ware screen for a donation, but only when it's loaded after boot.

--//--

PS, Process Lasso can be set to do silly configs too like running on a quad all 4 BOINC jobs off one single core. Assure you, you'd be seeing CEP2 jobs taking 60 hours and then still clock in only 12 hours ;P
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Dec 16, 2010 9:03:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Dataman
Ace Cruncher
Joined: Nov 16, 2004
Post Count: 4865
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Anyway, with what information you provide, you might want to investigate using "Process Lasso"

Thanks, I will take a look at that when I get through my task/social engagement list. As most men know, there are some times when the only acceptable response is, "Yes Dear I would love to do that for you right now" or she gives you "The Look". Most men fear "The Look". laughing biggrin laughing
Thanks again.

cowboy
----------------------------------------


[Dec 16, 2010 9:23:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
bicotz
Advanced Cruncher
Canada
Joined: Apr 25, 2010
Post Count: 67
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

As most men know, there are some times when the only acceptable response is, "Yes Dear I would love to do that for you right now" or she gives you "The Look". Most men fear "The Look". laughing biggrin laughing
Thanks again.

cowboy



Sooooooo TRUE ! shock biggrin
----------------------------------------

[Dec 16, 2010 9:36:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Bearcat
Master Cruncher
USA
Joined: Jan 6, 2007
Post Count: 2803
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Thanks to whoever implemented user selectable for the number of wu's for this project to crunch. I think the best thing is to run 1 at a time. I was getting around 20 minutes difference when run with other projects. When I switched to all cores running cep2, it increased the time to over 40 minutes. This is on a raptor drive. Will check differences when my ssd's arrive.
Sek, thanks for the tip. I think this will make a big difference. As for the upload issues, unless your on a fibre optic, were stuck dealing with network clog. Best solution I came up with is restrict uploads to while your sleeping only.
----------------------------------------
Crunching for humanity since 2007!

----------------------------------------
[Edit 1 times, last edit by Bearcat at Dec 16, 2010 9:42:52 PM]
[Dec 16, 2010 9:40:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: To Project Scientists: Clean Energy Project Phase 2 - Limited Cruncher Participation

Dear dataman,

hope you made it through you social and familiar duties without too much pain and suffering cool . We all have to obey to the higher powers every once in a while.

We have written up some more explanation on the time-limit which you may find interesting:
http://www.worldcommunitygrid.org/forums/wcg/...30547_lastpage,yes#307466

I also wanted to mention that we have some more network skrews to play with but those implementations will probably take until the new year.

Best wishes from your

Harvard CEP Team
[Dec 19, 2010 6:27:47 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 84   Pages: 9   [ Previous Page | 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread