Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 148
Posts: 148   Pages: 15   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 17342 times and has 147 replies Next Thread
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1323
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

For the entire BETA, things however are looking good. The average runtimes for the batches are matching what we attempted to set them to. There are the few that are outside of the expected curve, but I think some of that is to be expected.

Thanks,
-Uplinger

In other words:

The start of the new UGM1 project is near.
Keith, we really don't tell it to others ears.
The secret will stay in BETA forum here.
I don't see the forest through the trees.
[Oct 8, 2014 9:21:52 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

Crystal Pellet,

There is no date I can share with you unfortunately. As usual with most projects we attempt to keep the launch date private.

As for the files with large disk usage, we are working towards correcting that. We will probably have additional beta tasks to test this. No ETA on that at the moment though.

Thanks,
-Uplinger
[Oct 8, 2014 10:26:53 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

I am currently running 15 of the work units that errored out due to high disk usage on our alpha grid. I am seeing a few results that are 20% complete with 200MB result files uncompressed after 4 hours. Our goal is to not have this happen in the future.

Thanks,
-Uplinger
[Oct 8, 2014 10:30:41 PM]   Link   Report threatening or abusive post: please login first  Go to top 
anhhai
Veteran Cruncher
Joined: Mar 22, 2005
Post Count: 839
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

I am currently running 15 of the work units that errored out due to high disk usage on our alpha grid. I am seeing a few results that are 20% complete with 200MB result files uncompressed after 4 hours. Our goal is to not have this happen in the future.

Thanks,
-Uplinger




This sounds like we are going to have one more round of beta before we go into production
----------------------------------------

[Oct 8, 2014 10:33:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7697
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

Just thought I would throw in my two cents worth from Uplinger's oh so helpful figures. 96.29% of the Beta WU's finishd in 10 hours or less. 90.61% of the total Kbytes generated were from WU's which finished in 10 hours or less with a full 50% of the total generated by those which finished in 4 hours or less. I could not find any pattern in "average kbytes generated per hour." It would be interesting to see a breakdown of time for various cpu's. From this very preliminary data it looks like a majority of the potential WU's will be less than 5 hours.
Lets see what the next round of beta brings.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Oct 9, 2014 12:42:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Yarensc
Advanced Cruncher
USA
Joined: Sep 24, 2011
Post Count: 136
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

Thanks for sharing the chart, its very interesting. It would be fun to work up there and see more of that stuff, too bad I chose networking instead of CS for my degree.

One thought, a lot of the people who sign up for beta, I would imagine, are more computer savvy with, on average, faster machines, which might shift those averages down a bit. Although I suppose the result file size is an issue with the WU itself
[Oct 9, 2014 1:28:38 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

Sgt Joe,

The report with sizes and avg sizes is a little bit left over from previous database lookups I have done. Those are more related and hold more value when you compare against batches. The reason for that is we used different datasets for each group of work units. Thus one dataset creates results larger than others. This is not technically a bad thing as it is within reason for the workunits. However we are trying to determine a way to prevent such large swings even within a batch. For example we had some results within that batch that were less than 100KB (compressed) result file, but a handful of others grew above 250MB (uncompressed). I am currently running a work unit that has created 375 MB (uncompressed) and it is only 37% complete. In theory the max a workunit sized this way could be is 31GB (uncompressed), but we should not see data that large.

Yarensc,

We have people who sign up all sorts of machines. On average it is slightly faster than the grid, but in general it is a wide range. We have members who attempted to run Pentium 3 processors against this latest beta. In which the processes failed due to this project requiring SSE2.

Thanks for the feedback and anhhai suggested, we are thinking about running another round of BETA with different workunits. But again, no ETA on that.

Thanks,
-Uplinger
[Oct 9, 2014 1:43:31 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KWSN - A Shrubbery
Master Cruncher
Joined: Jan 8, 2006
Post Count: 1585
Status: Offline
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

Still have one result processing, 38 hours elapsed with 4ish remaining.

This batch also pushed me past three years. One can always dream of diamonds.
----------------------------------------

Distributed computing volunteer since September 27, 2000
[Oct 9, 2014 3:22:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
rembertw
Senior Cruncher
Belgium
Joined: Nov 21, 2005
Post Count: 275
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

I see 6 WU's on my machines.

5 validated
1 pending validation, waiting on wingman

run times varying between 3:12 and 7:44.
[Oct 9, 2014 5:14:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7697
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: New BETA test - Oct 6, 2014 [ Issues Thread ]

One invalid

BETA_ ugm1_ ugm1_ 00029_ 0211_ 0--

7000 query sequences compared.
07:54:08 (11517): No heartbeat from client for 30 sec - exiting
07:54:08 (11517): timer handler: client dead, exiting
Checkpoint restored: 6335
6500 query sequences compared.
08:00:34 (11728): No heartbeat from client for 30 sec - exiting
08:00:34 (11728): timer handler: client dead, exiting
Checkpoint restored: 4223
4500 query sequences compared.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Oct 9, 2014 11:24:05 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 148   Pages: 15   [ Previous Page | 1 2 3 4 5 6 7 8 9 10 | Next Page ]
[ Jump to Last Post ]
Post new Thread