Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 50
Posts: 50   Pages: 5   [ 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 7560 times and has 49 replies Next Thread
armstrdj
Former World Community Grid Tech
Joined: Oct 21, 2004
Post Count: 695
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Workunit runtime for Say No to Schistosoma has been increased by 40%

We have increased the runtime for all Say No to Schistosoma workunits by about 40%.

Thanks,
armstrdj
[Aug 23, 2012 2:38:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

Amazing...
[Aug 24, 2012 3:09:26 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Falconet
Master Cruncher
Portugal
Joined: Mar 9, 2009
Post Count: 3295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

Amazing...



?
----------------------------------------


AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W
AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W
AMD Ryzen 7 7730U 8C/16T 3.0 GHz
[Aug 24, 2012 3:31:08 PM]   Link   Report threatening or abusive post: please login first  Go to top 
rbotterb
Senior Cruncher
United States
Joined: Jul 21, 2005
Post Count: 401
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

I kind of wonder why so many projects seem to be wanting to increase the size of their WUs. I would think it would increase the number of No Reply situations from smaller crunchers out there. But then I know the big crunchers have been getting bigger and bigger and much faster over the past couple years, so it's probably a response to the technological speeds of the newer big guys out there.
[Sep 16, 2012 3:34:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

rbotterb, the reason was server load technical, no single other reason. The scientist do not have interest in how WCG chops the task in parcels for computation on the grid, long as the results are 100% unaffected.
[Sep 17, 2012 8:56:27 AM]   Link   Report threatening or abusive post: please login first  Go to top 
rbotterb
Senior Cruncher
United States
Joined: Jul 21, 2005
Post Count: 401
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

So making all the WUs roughly the same size, but bigger, actually balances out the server load better?
[Sep 17, 2012 1:20:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Falconet
Master Cruncher
Portugal
Joined: Mar 9, 2009
Post Count: 3295
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

Yes because more work is done in a WU thus less WU's are required(the amount of work is still the same).
----------------------------------------


AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W
AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W
AMD Ryzen 7 7730U 8C/16T 3.0 GHz
[Sep 17, 2012 1:52:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
rbotterb
Senior Cruncher
United States
Joined: Jul 21, 2005
Post Count: 401
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

I can understand the point of balancing the sizes of the WUs across projects balancing out the servers, but the point that the size of the WUs is doing this balance doesn't make sense. You could get the same balancing if all the WUs were 1/2 the current size or 1/4 or whatever you wanted. So just making the WUs larger, while it might allow for server balancing would I figure just push up the likelihood of No-Replys amoung smaller crunchers out there. But then I'm not setting the sizes, so apparently the bigger sizes seem to be working for now.
[Sep 18, 2012 3:13:05 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Col323
Senior Cruncher
Joined: Nov 4, 2008
Post Count: 372
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

I may be speaking out of turn here, but I don't think "balance" is the goal with increasing the WU size, i think it's "load". You're right, you could slice things many ways and figure out how to distribute it across servers for balance. But by increasing the WU size, you have fewer sends, fewer receives, fewer units to store, fewer database entries, etc. In other words, less work for all the servers.

/edit: That said, I do think you make a good point about the smaller and part time crunchers.
----------------------------------------
[Edit 1 times, last edit by Col323 at Sep 19, 2012 1:35:08 PM]
[Sep 19, 2012 1:32:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Workunit runtime for Say No to Schistosoma has been increased by 40%

I can understand the point of balancing the sizes of the WUs across projects balancing out the servers, but the point that the size of the WUs is doing this balance doesn't make sense. You could get the same balancing if all the WUs were 1/2 the current size or 1/4 or whatever you wanted. So just making the WUs larger, while it might allow for server balancing would I figure just push up the likelihood of No-Replys amoung smaller crunchers out there. But then I'm not setting the sizes, so apparently the bigger sizes seem to be working for now.

When I said "server load technical", I meant server load, where the up-sizing reduces the number of transactions, so col323 got it rightly interpreted. The inter-research balancing is done by controlling the number of work units per science per unit of time that are allowed to go into the feeders. E.g. if there were only HCC at 1 hour average and HFCC at 6 hour average and you want to balance these, than the hopper is given a ratio of 6:1 of HCC versus HFCC. The average run-times drift, so the techs re-balance these ratios on a periodic basis, no particular schedule.

The smaller tasks preference for the part-time crunchers is something WCG is all too aware of, but the stability of the whole supersedes the needs of the individual. As I commented a week or more back, now that the bugs were found and root cause solutions were applied to what was generating the extraneous server loads, it's a matter of time the techs size results back down where they can. Think at the same time, this will be no earlier than after the HCC-GPU application goes into production. Those 4-6-10 minute tasks could add a whole bunch more tension on the transaction system, but that said, the oodles of RAM also added is sure to help in staving off such a overload condition. We'll see and crunch on patiently.
----------------------------------------
[Edit 1 times, last edit by Former Member at Sep 19, 2012 2:55:13 PM]
[Sep 19, 2012 2:52:36 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 50   Pages: 5   [ 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread