| Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
 |
World Community Grid Forums
Category: Active Research
Forum: Africa Rainfall Project
Thread: Work Available |
| No member browsing this thread |
|
Thread Status: Active Total posts in this thread: 3204
|
|
| Author |
|
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges: 
|
Doesn't Kevin produce the report about every 2 weeks? Give or take a few days. I've been doing it on an adhoc basis and I'm long past the point where I should have automated it. Let me do that real quick and then a daily version will be available to review and @Mike.Gibson (or anyone) else will be able to provide the updates on a more regular basis. The three reports will now be updated once a day at: https://download.worldcommunitygrid.org/boinc...rp1_stats/generations.txt https://download.worldcommunitygrid.org/boinc/download/arp1_stats/state.txt https://download.worldcommunitygrid.org/boinc/download/arp1_stats/completed.txt |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12359 Status: Offline Project Badges: 
|
Thank you Kevin.
However, I am unsure about the data in the second schedule. You state that there are 20 units in the extreme generations, but a count of the units in the first schedule shows 162 units in those generations. Is there a logical explanation? You also say the leading generation is 120 but there are none in that generation. Is this a timing matter? The one unit in Generation 079 seems to be stuck for the second report running. Has that been referred to Delft? Likewise the 3 units in generation 084? I don't understand what the third scedule is about. Please explain. I see that there are now 9 normal generations and 8 accelerated generations so the definitions are closing up. My previous post differed from your results by about 64,000 completed units. Does that mean that the daily returns include errors and/or invalids? However, it is very good to have a regular report established at it is much appreciated. Cheers Mike |
||
|
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges:
|
You state that there are 20 units in the extreme generations, but a count of the units in the first schedule shows 162 units in those generations. Is there a logical explanation? There are 130 units that are "stuck" right now because they errored out. We are working with Delft to resolve the issue. It is appears to be due to some issues with the geographic features as well as the specific weather conditions that are occurring at that time. There is also a difference right now between the time of the generations report (which is locked to the conditions at 12:00 UTC and the other two reports which are current time (so 12 hours difference). I'll be running the updates at 12:05 UTC so the reports should be basically identical going forward. You also say the leading generation is 120 but there are none in that generation. Is this a timing matter? This is also the timing issue between the two reports. There are now 5 units on generation 120 that have been created in the past few hours. I don't understand what the third schedule is about. Please explain. The "completed' report is the number of workunits that completed over the past 48 hours. The primary purpose of it is to show the difference in how long it takes to complete a "Extreme" vs "Accelerated" vs "Normal" workunits. |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12359 Status: Offline Project Badges:
|
Kevin
Thank you. Assuming the 130 are in the extreme group, that brings them down to 32 and the other 12 could be accounted for by the time differential. I only mentioned the 4 stuck units because the data only showed them up positively. However, there didn't seem to be enough movement in the other 080's generations for them all to be active. Producing the reports within 5 minutes of each other will be a big improvement. Could they be timed ans dated, pleas? Cheers Mike |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12359 Status: Offline Project Badges:
|
Thank you, Kevin.
I will refer to the last 6 ultimate stragglers as ultra laggards. 14 days have passed since the last report. In that time, the last of the ultra laggards has moved on 11 generations to generation 046, whereas their leader has moved on 8 generations to 055. The 4 units in generations 079 and 084 are stuck and have been referred to Delft, as have a further 126 units. The last of the other extreme generations has moved on only 1 generation to 086 so is probably another of those stuck units. The last of the accelerated generations is 103 and their leader is now 110. The current leading generation is 120, up 5 from 115.. The definition for extreme laggard is now -18 generations and accelerated at -10 generations. 142,338 units have been validated in the last 14 days (up to 10,167.0 per day). 6 units are in the ultra category, 156 units (0.45%) are in the extreme category and 15,904 (44.67%) of the units are in the priority generations. There are now 2,553,699 units to be crunched to finish the project assuming that a full generation 182 is the last. As the number of results returned includes redundant extreme triplets and maybe errors and invalids I will use the average validated over the last 14 days, so my target for completion is now calculated as 14 August 2022. That is 2 days earlier than my last summary and assumes everyone works as now until the last day. It is very likely that we will see the project finish before the end of 2022 due to the efforts to close up the laggards. My guess would be October 2022. Mike |
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12359 Status: Offline Project Badges:
|
I should have mentioned that the extreme units are taking 26.2 hours to complete a generation and the accelerated (priority) and normal units 47.5 hours and 99.4 hours respectively, which demonstrates why the stragglers are catching up.
Kevin is now producing the data daily but I will update my report sometime each weekend. Mike |
||
|
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
81% of all my currently running ARP WUs are high priority work (52 out of 64). Seems a little high... Have we lost a few reliable machines?
|
||
|
|
MJH333
Senior Cruncher England Joined: Apr 3, 2021 Post Count: 266 Status: Offline Project Badges: 
|
I’m seeing something similar - 92% high priority (35 out of 38).
|
||
|
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12359 Status: Offline Project Badges:
|
Maybe you are counterbalancing me. One of my machines is very slow crunching 2 which should and does get normal only. The other was getting priority units but not at all since the return time exceede 30 hours.
Mike |
||
|
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges:
|
A couple of the heavy hitting users (i.e. university labs/grid/etc) have stopped contributing in the past couple of days (they come and go on a regular basis likely due to their own need for computing vs giving us their excess capacity) and so both the project pace has slowed down and the results that need a reliable host have been slow to be picked (which results in the remaining reliable hosts getting more).
|
||
|
|
|