Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 38
Posts: 38   Pages: 4   [ Previous Page | 1 2 3 4 ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 34720 times and has 37 replies Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

Right now it will be 2 copies per task. If we are going to zero redundancy, that will be a conversation with the researchers later. Right now since this is a new application it will start as a redundant application.

Thanks,
-Uplinger

Based on the I, my O asessment ended up with: Quorum 2 all the way to the end. How else could you build a truly reliable cancer markers database? Already heuristics were applied to filter the I side as else the task would have become too great [but, as with HCC, would there be a GPU build, that what is currently defined as workset could get an expansion... or not, [read on my ramble]:

And to ask the question more forecefully, that question which was asked before, so we get a feel of progress [that big close to the chest secret that WCG always seems to want to hold], how many of these 7 bolded digits [below] will change from zero. Each batch is 10,000, in quorum two, 20,000 + assumed error rate, give/take 23-24K submissions to start computing to get 20,000 verified]. One of my devices is processing one now from batch 22, for a possible 9,999,999 which in the extreme means 199,999,980,000 originals (copy _0 +_1). After application of the scientists' heuristics to limit that data to smap, still a gargantuan number, in words 199 billion. Taking there's most always been a spare lead zero on the batch/target numbers, 19 billion :=0

World Community Grid 7.24 mcm1 MCM1_0000022_7638_1 00:38:40 (00:37:06) 95.96 12.346 07:04:59 11/20/2013 4:59:29 AM 11/10/2013 4:59:30 AM Running [0] 00:07:00 84.60 MB desktop-02 43.00 MB

edit: Only now saw a reply by uplinger in another thread "We do not have an estimate of the number of batches."... OK, so FTTB had already plugged 2 years into the Dashboard algorythm. We'll see when we get there... if the first ABCD batches in a years time somehow enable a similar rational as what the DSFL scientists came to do.
----------------------------------------
[Edit 1 times, last edit by Former Member at Nov 10, 2013 6:14:30 PM]
[Nov 10, 2013 5:12:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
widdershins
Veteran Cruncher
Scotland
Joined: Apr 30, 2007
Post Count: 674
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

I've got a 3 day unit that was snagged by my little Atom. Trouble is it's a biggun 85hrs with 2 to go. Obviously it's already been marked as No Reply and a replacement sent out. I'm a bit unhappy at losing nearly 90hrs if the replacement returns before me, but also if the replacement has gone out to an Atom processor machine also then whoever has it will waste over a day of crunching if mine returns first. But more likely it wouldn't return in the shorter time allocated to it and so another unit would be sent out.

Is there any way to identify if any 3 day deadline units have gone out to slower machines and extend the return deadlines to prevent the same work being crunched 4 or 5 times?
[Nov 12, 2013 8:35:24 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

Widdershins,

The problem is that since this is a new application, some of the stats used for this type of data was not captured. But the purpose of getting these results back quickly is so the researchers can the results back quickly for analysis.

Also, I believe you can return a work unit up to 24 hours after the deadline and still receive credit if it validates against the canonical result (if that has been found at that point).

I am sorry if you lost time contributing towards this project. Our goal was not to waste CPU time, and as a normal the deadlines are set to 10 days. This batch was set uniquely.

Thanks,
-Uplinger
[Nov 12, 2013 6:31:10 PM]   Link   Report threatening or abusive post: please login first  Go to top 
OldChap
Veteran Cruncher
UK
Joined: Jun 5, 2009
Post Count: 978
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

Thanks for clarifying that uplinger, it seems to resolve concerns of mine noted in the problems thread when receiving priority work that will run longer than deadline.
----------------------------------------

[Nov 12, 2013 7:14:25 PM]   Link   Report threatening or abusive post: please login first  Go to top 
widdershins
Veteran Cruncher
Scotland
Joined: Apr 30, 2007
Post Count: 674
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

As it turns out my unit managed to scrape in. It returned before the resend came back, but only just within the 24hrs grace. It looks though that the poor victim who got the resend was, as I half expected, unable to return it within the deadline. Hopefully the unit will linger long enough for the resend to return and get credited also, but as I overran by nearly a day I suspect that with a reduced period to return within the wingman will lose out.

But thanks for clarifying the 24 hr grace period I wasn't aware of that, it's useful to know.
[Nov 12, 2013 10:58:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1320
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

Original deadline is 3 days. 40% of that is 28.8 hours -> The resends have a deadline of 21.6 hours.

Something wrong with your algorithm. The deadline seems to be 30% of the original confused

I'll double check this tomorrow. But I'm pretty sure it's 40%, I bet that since we have had successful results it could have decreased the estimated fpops used per work unit which may have skewed this towards 30%. Again, I'll need to check this tomorrow to confirm.

Thanks,
-Uplinger

Every day has a tomorrow ;)

Just to remember, because I get now several MCM1 resends with a 3-days deadline, originally send with a 10-days deadline.
[Nov 13, 2013 10:13:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
marvey11
Advanced Cruncher
Germany
Joined: Apr 2, 2011
Post Count: 89
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

This isn't limited to MCM1 either... I got several CEP2 and FAHV resends, and they all seem to have a 3-day deadline. Which would, again, be only 30% of the original 10 days...
----------------------------------------

[Nov 14, 2013 10:00:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: 3 day deadlines ?

ALL resends have a 3 day deadline, the point about the MCM 3 day deadline was that they were NOT resends, just an initial batch biggrin
[Nov 14, 2013 10:04:32 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 38   Pages: 4   [ Previous Page | 1 2 3 4 ]
[ Jump to Last Post ]
Post new Thread