Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
![]() |
World Community Grid Forums
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 50
|
![]() |
Author |
|
armstrdj
Former World Community Grid Tech Joined: Oct 21, 2004 Post Count: 695 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
We have increased the runtime for all Say No to Schistosoma workunits by about 40%.
Thanks, armstrdj |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
Amazing...
|
||
|
Falconet
Master Cruncher Portugal Joined: Mar 9, 2009 Post Count: 3295 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Amazing... ? AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W AMD Ryzen 7 7730U 8C/16T 3.0 GHz |
||
|
rbotterb
Senior Cruncher United States Joined: Jul 21, 2005 Post Count: 401 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I kind of wonder why so many projects seem to be wanting to increase the size of their WUs. I would think it would increase the number of No Reply situations from smaller crunchers out there. But then I know the big crunchers have been getting bigger and bigger and much faster over the past couple years, so it's probably a response to the technological speeds of the newer big guys out there.
|
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
rbotterb, the reason was server load technical, no single other reason. The scientist do not have interest in how WCG chops the task in parcels for computation on the grid, long as the results are 100% unaffected.
|
||
|
rbotterb
Senior Cruncher United States Joined: Jul 21, 2005 Post Count: 401 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
So making all the WUs roughly the same size, but bigger, actually balances out the server load better?
|
||
|
Falconet
Master Cruncher Portugal Joined: Mar 9, 2009 Post Count: 3295 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Yes because more work is done in a WU thus less WU's are required(the amount of work is still the same).
----------------------------------------AMD Ryzen 5 1600AF 6C/12T 3.2 GHz - 85W AMD Ryzen 5 2500U 4C/8T 2.0 GHz - 28W AMD Ryzen 7 7730U 8C/16T 3.0 GHz |
||
|
rbotterb
Senior Cruncher United States Joined: Jul 21, 2005 Post Count: 401 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I can understand the point of balancing the sizes of the WUs across projects balancing out the servers, but the point that the size of the WUs is doing this balance doesn't make sense. You could get the same balancing if all the WUs were 1/2 the current size or 1/4 or whatever you wanted. So just making the WUs larger, while it might allow for server balancing would I figure just push up the likelihood of No-Replys amoung smaller crunchers out there. But then I'm not setting the sizes, so apparently the bigger sizes seem to be working for now.
|
||
|
Col323
Senior Cruncher Joined: Nov 4, 2008 Post Count: 372 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I may be speaking out of turn here, but I don't think "balance" is the goal with increasing the WU size, i think it's "load". You're right, you could slice things many ways and figure out how to distribute it across servers for balance. But by increasing the WU size, you have fewer sends, fewer receives, fewer units to store, fewer database entries, etc. In other words, less work for all the servers.
----------------------------------------/edit: That said, I do think you make a good point about the smaller and part time crunchers. [Edit 1 times, last edit by Col323 at Sep 19, 2012 1:35:08 PM] |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I can understand the point of balancing the sizes of the WUs across projects balancing out the servers, but the point that the size of the WUs is doing this balance doesn't make sense. You could get the same balancing if all the WUs were 1/2 the current size or 1/4 or whatever you wanted. So just making the WUs larger, while it might allow for server balancing would I figure just push up the likelihood of No-Replys amoung smaller crunchers out there. But then I'm not setting the sizes, so apparently the bigger sizes seem to be working for now. When I said "server load technical", I meant server load, where the up-sizing reduces the number of transactions, so col323 got it rightly interpreted. The inter-research balancing is done by controlling the number of work units per science per unit of time that are allowed to go into the feeders. E.g. if there were only HCC at 1 hour average and HFCC at 6 hour average and you want to balance these, than the hopper is given a ratio of 6:1 of HCC versus HFCC. The average run-times drift, so the techs re-balance these ratios on a periodic basis, no particular schedule. The smaller tasks preference for the part-time crunchers is something WCG is all too aware of, but the stability of the whole supersedes the needs of the individual. As I commented a week or more back, now that the bugs were found and root cause solutions were applied to what was generating the extraneous server loads, it's a matter of time the techs size results back down where they can. Think at the same time, this will be no earlier than after the HCC-GPU application goes into production. Those 4-6-10 minute tasks could add a whole bunch more tension on the transaction system, but that said, the oodles of RAM also added is sure to help in staving off such a overload condition. We'll see and crunch on patiently. [Edit 1 times, last edit by Former Member at Sep 19, 2012 2:55:13 PM] |
||
|
|
![]() |