Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 87
Posts: 87   Pages: 9   [ 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 10553 times and has 86 replies Next Thread
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
DDDT Single Redundancy Change

Greetings all,

We are about to start the change to single redundancy for Discovering Dengue Drugs - Together. This means over the next week members may notice no work being available if they have DDDT as the only project selected. The advantage of this switch will allow the grid to run more efficiently as we were sending out 2.1 work units for every result. This should go down to about 1.2 by our estimations. This will allow us to process more work units for the researchers by using the same amount of processing power. An added benefit is that members will also have their results validated quicker.

Thank you for your patience as we switch the system to single redundancy.

-Uplinger
[Jul 23, 2008 8:34:55 PM]   Link   Report threatening or abusive post: please login first  Go to top 
GIBA
Ace Cruncher
Joined: Apr 25, 2005
Post Count: 5374
Status: Offline
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

Hi Uplinger,
by now I have many of my devices dedicated to DDDT, so I would like to know (if possible) more information about how many days will during this scheduled change (i.e.: all next week ? or just from monday to friday ?) .

With this information I will setup 10 days of work hours in my profile / preferences, before the unavailability time of DDT WU's distribution...
Thank you in advance. Regards.
Gib@ coffee
----------------------------------------
Cheers ! GIB@ peace coffee
Join BRASIL - BRAZIL@GRID team and be very happy !
http://www.worldcommunitygrid.org/team/viewTeamInfo.do?teamId=DF99KT5DN1

[Jul 24, 2008 12:17:42 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

Greetings GIB@,

We have stopped indexing new batches into BOINC for DDDT. This means that the remaining work units in the queue at the moment are the last. If you want load up on about 2-3 days of work but we are hoping to finish what is in the queue in the next 7-9 days. This means that the more work units people have queued up will slow down the switch. I am not sure when the new application will go into production as we have to wait for all of the work units to be validated and complete before releasing it.

Also, the best recommended path is to set your profile to contribute to other projects if no work is available. This way your machines will not be idle but will still contribute to DDDT primarily when work is available.

-Uplinger
----------------------------------------
[Edit 1 times, last edit by uplinger at Jul 24, 2008 4:19:43 AM]
[Jul 24, 2008 4:18:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

To be even more specific we are going to do the following:

1) We load the work into BOINC in groups we call 'batches'. We picked the last batch yesterday that will run with redundancy and loaded it into BOINC. There are currently about 11,000 results left to be sent out for DDDT. We have recently been sending around 32,000 results per day for DDDT so we will 'run dry' for DDDT within then next 12 hours or so.

2) Once we run dry, we will let the work continue to run as normal for about 2 days. You will periodically be able to get work for DDDT as extra copies are generated to complete workunits.

3) After two days (likely around 1-2 UTC on Sunday) we will begin to 'over schedule' DDDT. This means that we will force any workunits still in progress to generate an extra result. We will repeat this a day and a half later (likely around 12-13 UTC on Monday).

4) Finally we will wait another day or two for the result to come. Based on past experience, there will only be a small number of workunits still in progress. Most of these will complete with the results still in progress. Thus we will go ahead and release the new application version and single redundancy workunits.

This is a bit of a messy process and we don't like the way it works. However, if we release the new application version prior to the workunits that were originally processed with the previous application version, then as additional results are generated for the workunits as needed, those results will not compare between versions. This results in a lot more troubles with lots of results being marked INCONCLUSIVE and eventually INVALID.
[Jul 24, 2008 1:56:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1677
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

Hi,
The processes for retiring the current DDDT and for launching the new approach sound good and reasonable. As usual, we have probably to have a closer look on the performance of the new DDDT during the launch period in order to discover "abnormal" behavior!
Currently I am very impressed by the reliability of the different projects regarding performance: warm congratulation to the tech team applause
Because all the available projects on WCG are valuable for the humanity, I would anyway recommend to be not too exclusive regarding the project selection. For my-self, the compatibility between project and host hardware is the only criterion for attributing (or not attributing) projects to hosts.
Cheers,
----------------------------------------
[Jul 24, 2008 11:53:38 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

Ok. Now it looks like there are no new DDDT WUs available...
[Jul 25, 2008 3:34:11 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

There will be a small trickle as extra copies are generated to complete workunits.
[Jul 25, 2008 3:38:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

Keith/Kevin,

got a version number for the upcoming release so folk can reconfigure and don't find systems crawling or hanging.

Thx
Rob
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Jul 25, 2008 4:00:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

It will be 6.06
[Jul 25, 2008 5:41:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
jonathandl
Advanced Cruncher
Joined: Nov 12, 2007
Post Count: 106
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: DDDT Single Redundancy Change

Didactylos wrote:
There will be a small trickle as extra copies are generated to complete workunits.

I'm ready to pick up any that trickle in today or tomorrow (Saturday) morning! However, if one generally takes a bit longer than average to crunch, would you advise against being available to grab units on Sunday or Monday?

By the way, I assume that the 6.05 application contained the self-validating feature on which the upcoming version relies, and that the roll-out is occuring because no 6.05 work units passed the internal validation but failed when validated against the result from another computer? If so, thank you applause for taking the time to verify that this works!
----------------------------------------
[Edit 1 times, last edit by jonathandl at Jul 25, 2008 6:09:53 PM]
[Jul 25, 2008 6:05:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 87   Pages: 9   [ 1 2 3 4 5 6 7 8 9 | Next Page ]
[ Jump to Last Post ]
Post new Thread