Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
![]() |
World Community Grid Forums
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 148
|
![]() |
Author |
|
Crystal Pellet
Veteran Cruncher Joined: May 21, 2008 Post Count: 1323 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
For the entire BETA, things however are looking good. The average runtimes for the batches are matching what we attempted to set them to. There are the few that are outside of the expected curve, but I think some of that is to be expected. Thanks, -Uplinger In other words: The start of the new UGM1 project is near. Keith, we really don't tell it to others ears. The secret will stay in BETA forum here. I don't see the forest through the trees. |
||
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Crystal Pellet,
There is no date I can share with you unfortunately. As usual with most projects we attempt to keep the launch date private. As for the files with large disk usage, we are working towards correcting that. We will probably have additional beta tasks to test this. No ETA on that at the moment though. Thanks, -Uplinger |
||
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I am currently running 15 of the work units that errored out due to high disk usage on our alpha grid. I am seeing a few results that are 20% complete with 200MB result files uncompressed after 4 hours. Our goal is to not have this happen in the future.
Thanks, -Uplinger |
||
|
anhhai
Veteran Cruncher Joined: Mar 22, 2005 Post Count: 839 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I am currently running 15 of the work units that errored out due to high disk usage on our alpha grid. I am seeing a few results that are 20% complete with 200MB result files uncompressed after 4 hours. Our goal is to not have this happen in the future. Thanks, -Uplinger This sounds like we are going to have one more round of beta before we go into production ![]() |
||
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7697 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Just thought I would throw in my two cents worth from Uplinger's oh so helpful figures. 96.29% of the Beta WU's finishd in 10 hours or less. 90.61% of the total Kbytes generated were from WU's which finished in 10 hours or less with a full 50% of the total generated by those which finished in 4 hours or less. I could not find any pattern in "average kbytes generated per hour." It would be interesting to see a breakdown of time for various cpu's. From this very preliminary data it looks like a majority of the potential WU's will be less than 5 hours.
----------------------------------------Lets see what the next round of beta brings. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
Yarensc
Advanced Cruncher USA Joined: Sep 24, 2011 Post Count: 136 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Thanks for sharing the chart, its very interesting. It would be fun to work up there and see more of that stuff, too bad I chose networking instead of CS for my degree.
One thought, a lot of the people who sign up for beta, I would imagine, are more computer savvy with, on average, faster machines, which might shift those averages down a bit. Although I suppose the result file size is an issue with the WU itself |
||
|
uplinger
Former World Community Grid Tech Joined: May 23, 2005 Post Count: 3952 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Sgt Joe,
The report with sizes and avg sizes is a little bit left over from previous database lookups I have done. Those are more related and hold more value when you compare against batches. The reason for that is we used different datasets for each group of work units. Thus one dataset creates results larger than others. This is not technically a bad thing as it is within reason for the workunits. However we are trying to determine a way to prevent such large swings even within a batch. For example we had some results within that batch that were less than 100KB (compressed) result file, but a handful of others grew above 250MB (uncompressed). I am currently running a work unit that has created 375 MB (uncompressed) and it is only 37% complete. In theory the max a workunit sized this way could be is 31GB (uncompressed), but we should not see data that large. Yarensc, We have people who sign up all sorts of machines. On average it is slightly faster than the grid, but in general it is a wide range. We have members who attempted to run Pentium 3 processors against this latest beta. In which the processes failed due to this project requiring SSE2. Thanks for the feedback and anhhai suggested, we are thinking about running another round of BETA with different workunits. But again, no ETA on that. Thanks, -Uplinger |
||
|
KWSN - A Shrubbery
Master Cruncher Joined: Jan 8, 2006 Post Count: 1585 Status: Offline |
Still have one result processing, 38 hours elapsed with 4ish remaining.
----------------------------------------This batch also pushed me past three years. One can always dream of diamonds. ![]() Distributed computing volunteer since September 27, 2000 |
||
|
rembertw
Senior Cruncher Belgium Joined: Nov 21, 2005 Post Count: 275 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I see 6 WU's on my machines.
5 validated 1 pending validation, waiting on wingman run times varying between 3:12 and 7:44. |
||
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7697 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
One invalid
----------------------------------------BETA_ ugm1_ ugm1_ 00029_ 0211_ 0-- 7000 query sequences compared. 07:54:08 (11517): No heartbeat from client for 30 sec - exiting 07:54:08 (11517): timer handler: client dead, exiting Checkpoint restored: 6335 6500 query sequences compared. 08:00:34 (11728): No heartbeat from client for 30 sec - exiting 08:00:34 (11728): timer handler: client dead, exiting Checkpoint restored: 4223 4500 query sequences compared. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
|
![]() |