Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
![]() |
World Community Grid Forums
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 3315
|
![]() |
Author |
|
Crystal Pellet
Veteran Cruncher Joined: May 21, 2008 Post Count: 1323 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Generation 077 is already treated as straggler. Local deadline 3.5 days (+ server grace period 1 day)
ARP1_ 0023073_ 077_ 1-- In Progress 29-7-21 05:14:07 2-8-21 17:14:07 0,00 0,0 / 0,0 |
||
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12435 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
According to knread, they are treating 5 generations as 'normal'. As we are now into 082, that would be generations 078 - 082. 077 is therefore now 'priority'.
I haven't seen an 081 or 082 yet. Mike |
||
|
Jim1348
Veteran Cruncher USA Joined: Jul 13, 2009 Post Count: 1066 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Started getting these messages now... Anyone else getting these? Wed 28 Jul 2021 11:51:12 AM CDT | World Community Grid | No tasks are available for Africa Rainfall Project I see that every day too. I think that is WCG's strange way of telling you that you don't need any. |
||
|
kwolff88
Cruncher Joined: Dec 31, 2004 Post Count: 19 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I'm crunching an 049 right now. Specifically, ARP1_0010193_049.
|
||
|
Acibant
Advanced Cruncher USA Joined: Apr 15, 2020 Post Count: 126 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() |
Wed 28 Jul 2021 11:51:12 AM CDT | World Community Grid | No tasks are available for Africa Rainfall Project I see that every day too. I think that is WCG's strange way of telling you that you don't need any.In my case this meant I had been getting OPN tasks if my client cache ever was perceived to be too low compared to the settings in the online preferences where I try to split half-MCM and half-ARP (accounting for different completion times). I could lower the overall work cache setting further but then I wouldn't get much of a buffer. (15 max concurrent for ARP/MCM to use 30 threads total, 20 max downloaded tasks for ARP, 32 max downloaded tasks for MCM, and 0.15 day cache). I do this because otherwise the client can end up getting lopsided with mostly MCM if I don't limit maximum concurrent/downloaded for that or it can get buggy and download an inordinate amount of work units (see entity's 990 tasks after switching). ![]() |
||
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 981 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Just noticed that I was sent ARP1_0001951_083_1 at 18:30 UTC on 29th July...
Cheers - Al. |
||
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12435 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Thank you, Al.
An even earlier one and the results being returned are nearly 18,000 per day. At that rate it would take a complete generation 4 days. 083 indicates we are at about 45.4%, but for this month I am assuming 2 generations behind to allow for the stragglers, so 44.3%. The latest interval is just 21 hours and the 10-interval average is down to 3.81579 days. The end date forecast is now August 2022, however, if this rate were to continue, the forecast would be March 2022, but I doubt it. I would expect the next generation to start about 2 August but it could even be today. Mike |
||
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
A few updates. First the latest distribution of the units:
As noted on Monday we had about 2500 results (~1250 units) that were waiting to be assigned. We were able to recruit a little more firepower and by mid-day yesterday the backlog dropped to running between 0 to 200. As a result, for the first time in a long time we were able to have all the work assigned and in progress which is an important part of making the project run as quickly as possible. I've been reworking a few things on the backend and from the time that a unit is validated, it will take about 15 minutes before then next generation is out running so the delays are also minimized on the server side (previous when we had a backlog, this turnaround time didn't matter as much so it was as long as 6 hours, but now getting the next generation out as quick as possible is worthwhile). We are averaging about 8000 units/day right now (we the last two days being above that average). If this pace continues, then we will be completing a generation about every 4.5 days. Thanks to everyone contributing and we really appreciate the help in getting this running quickly. |
||
|
Dayle Diamond
Senior Cruncher Joined: Jan 31, 2013 Post Count: 452 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Thanks Knreed.
With the growing spread of these workunits, I'm reminded of the last batches of FAH2. Each work unit was supposed to run 150 times, but some work ran another 30+ generations while the stragglers caught up. Imagine running 83 more cycles just for those six lagging work units! I'm hoping that was a one-time issue, and after generating a year's worth of weather data, the generations cease or are manually aborted. |
||
|
pwhidden
Cruncher USA Joined: Nov 17, 2004 Post Count: 32 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Kevin,
----------------------------------------Thanks very much for the update. I hope you will be able to re-post the "generation" table every once in a while. It gives us incentive. I too have been watching Mike's posts on the "end date". Of course that isn't really an end date but a date when the last generation gets sent out and we can assume declining project resource need shortly after that. I am curious if you why those 6 are still on generation 1. The sequential aspect to this project on any one piece of land mean there are limits to how fast we can get the last work unit for the project completed. These laggards are only given to "reliable hosts" which I believe is defined as returning results within 2.0 days. We also know that the average high priority WU turnaround time is 1.7 days. Since two valid results need to be submitted before advancing to the next generation, I am assuming the "laggard interval time" will be about 2 days + your 15 minutes to set up the next generation. Assuming there are no "invalid" or no responses from the clients assigned these laggards (I doubt it, but let's assume so) then the earliest the last work unit for the project will be completed is late July 2022. Other than those 6 stuck on one, we moved the end group from generation 32 to generation 35 in 6 days.... or 2 days per generation. Small sample size, I know, but it would match my assumed "laggard interval time" above. Paul ![]() |
||
|
|
![]() |