Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 
World Community Grid Forums
  Category: Active Research
  Forum: Africa Rainfall Project
  Thread: Work Available

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3204
Posts: 3204   Pages: 321   [ Previous Page | 132 133 134 135 136 137 138 139 140 141 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2785258 times and has 3203 replies Next Thread
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12359
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
There are now 3,361,696 units to go.

On the basis of 2 results per unit, the average returned over the last 10 days has increased to 10,077.8 units. For 7 days there were over 20,000 results returned.

This would mean an end date of 7 August 2022, however Kevin has explained that the extra is intermittent and already seems to have stopped. However, this also would require for there not to be a tail off at the end, which is highly unlikely as all projects have a tail off at the end and ARP1 is more likely to tail off because of the stragglers. That is not referring to the current stragglers but to those units from the last few generations at the end.

This also does not allow for invalid results or errors.

I expect the end to be nearer to the end of 2022.

I will try to update this weekly or whenever Kevin might update us with the stragglers.

Mike
[Sep 8, 2021 12:22:23 AM]   Link   Report threatening or abusive post: please login first  Go to top 
leloft
Cruncher
Joined: Jun 8, 2017
Post Count: 23
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Thanks for the update.
They have their system set up to download a single job, run immediately it and then return it (I believe they use the command line options --allow_multiple_clients --fetch_minimal_work --exit_when_idle and have each client running look like a single core machine).

That's interesting. How does that differ from simply running N concurrent ARP workunits and no other type of workunit? I am starting to see a pattern from the various N/0/0 (ARP/OPN/MCM) strategies.
1) As expected, if N is greater than half the number of cores, the processing time for each workunit increases noticeably with each additional workunit.
2) However, if N is less than half the number of cores, the processing time is not decreased as noticeably; although up to a point, there may be a slight decrease (but see below).
3) If the number of workunits running falls below a (as yet undetermined, very probably machine specific) threshold, the Intel (c) TurboBoost doesn't kick in; paradoxically below this threshold, it takes longer to process a fewer number of workunits than a higher number above it (subject to (1) above).
4) It is easily possible to operate a 'download on demand' policy through the use of the various Device Profiles where the value of N can be varied by ticking the ARP box only (also actively exclude the possibility of downloading other projects during a hiatus in workunit availability such as we saw a couple of days ago) and setting N with the dropdown menu limiting the number of concurrent ARP workunits. This makes the use of app_config redundant. The time 'lost' from upload of a completed unit to running of a new one is of the order of 3 minutes, which is not significant with a processing time of 11h, and less so with one of 27h.
5) It has also helped to keep the machines cooler during the hot spell; I haven't detected any thermal throttling, but the i7 cores run at 90 deg on 2N/0/0 and <75 with N/0/0, with no real loss of productivity: 8 units every 30h and 4 units every 16h respectively.
Best
leloft
[Sep 9, 2021 7:19:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
BladeD
Ace Cruncher
USA
Joined: Nov 17, 2004
Post Count: 28976
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
What's going on? I'm not getting any new WUs!

It's happening again.

Edit: And as I post, I get some to fill my queue! wink
----------------------------------------
MyCity


----------------------------------------
[Edit 1 times, last edit by BladeD at Sep 13, 2021 6:50:31 AM]
[Sep 13, 2021 6:43:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12359
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
There is only a finite number of work units ever available. 35,609 x 2 = 71,218 to be precise. Once they have gone out, we have to wait for some to be returned. What slows things down is that whole pairs have to be returned and validated before the next generation can be created.

Anyone who holds more than 1 spare is slowing down this process.

Mike
[Sep 13, 2021 12:16:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Latest stats:

Average generation: 89.9
Pace (average time to complete a generation): 4.78 (7-day average)

first_indexed       generation num_units_currently_on_generation num_units_completed_last_day 
------------------- ---------- --------------------------------- ---------------------------- 
2019-10-01 22:26:53 000                                                                       
2019-10-30 18:58:54 001                                                                       
2019-12-08 11:56:25 002        1                                                              
2020-01-12 02:02:34 003        1                                                              
2020-02-08 03:43:00 004        3                                                              
2020-02-24 06:27:42 005        1                                                              
2020-03-09 17:38:25 006                                                                       
2020-03-17 08:44:19 007                                                                       
2020-03-23 20:52:24 008                                                                       
2020-04-01 14:39:46 009                                                                       
2020-04-12 08:29:32 010                                                                       
2020-04-21 02:41:36 011                                                                       
2020-05-02 03:16:28 012                                                                       
2020-05-10 13:29:40 013                                                                       
2020-05-22 10:46:51 014                                                                       
2020-06-02 21:07:48 015                                                                       
2020-06-20 20:53:08 016                                                                       
2020-07-01 12:31:12 017                                                                       
2020-07-09 18:39:23 018                                                                       
2020-07-18 16:08:31 019                                                                       
2020-07-26 16:32:08 020                                                                       
2020-08-08 15:15:22 021                                                                       
2020-08-19 00:49:10 022                                                                       
2020-08-24 07:02:09 023                                                                       
2020-08-30 05:56:33 024                                                                       
2020-09-04 11:35:58 025                                                                       
2020-09-09 17:27:07 026                                                                       
2020-09-15 06:25:11 027                                                                       
2020-09-20 10:01:14 028                                                                       
2020-09-25 22:07:49 029                                                                       
2020-10-02 07:08:22 030                                                                       
2020-10-07 17:55:57 031                                                                       
2020-10-14 16:25:19 032                                                                       
2020-10-18 20:05:40 033                                                                       
2020-10-25 15:34:22 034                                                                       
2020-10-31 22:55:26 035                                                                       
2020-11-04 06:29:28 036                                                                       
2020-11-12 06:33:47 037                                                                       
2020-11-17 09:21:26 038                                                                       
2020-11-24 13:47:28 039                                                                       
2020-11-30 07:44:02 040                                                                       
2020-12-07 20:20:00 041                                                                       
2020-12-13 18:26:56 042                                                                       
2020-12-20 00:33:11 043                                                                       
2020-12-25 22:27:11 044                                                                       
2021-01-01 07:57:34 045                                                                       
2021-01-07 18:08:33 046                                                                       
2021-01-15 02:41:00 047                                                                       
2021-01-22 20:25:40 048                                                                       
2021-01-28 10:53:04 049                                          1                            
2021-02-03 14:32:54 050        2                                 1                            
2021-02-09 03:20:45 051        1                                                              
2021-02-16 14:14:47 052                                                                       
2021-02-22 01:22:20 053                                                                       
2021-02-28 10:29:30 054        2                                 1                            
2021-03-06 18:23:14 055        1                                 2                            
2021-03-12 10:16:29 056        2                                                              
2021-03-17 08:30:15 057                                          2                            
2021-03-23 06:08:46 058        2                                 2                            
2021-03-29 22:39:10 059        3                                 3                            
2021-04-05 05:01:38 060        7                                 7                            
2021-04-10 21:09:07 061        7                                 2                            
2021-04-16 23:20:59 062        2                                 4                            
2021-04-22 07:50:06 063        8                                 2                            
2021-04-28 23:02:38 064        5                                 3                            
2021-05-04 04:45:55 065        4                                 4                            
2021-05-09 14:11:18 066        8                                 2                            
2021-05-16 14:55:41 067        6                                 4                            
2021-05-23 15:02:08 068        4                                 3                            
2021-05-26 06:43:43 069        5                                 6                            
2021-05-29 18:38:55 070        10                                7                            
2021-06-03 15:46:15 071        11                                2                            
2021-06-11 23:13:21 072        5                                 4                            
2021-06-15 11:54:58 073        7                                 8                            
2021-06-22 00:30:34 074        11                                7                            
2021-06-27 11:56:43 075        8                                 6                            
2021-07-02 15:06:05 076        10                                7                            
2021-07-08 20:49:12 077        13                                6                            
2021-07-14 07:30:06 078        6                                 9                            
2021-07-18 14:21:26 079        15                                9                            
2021-07-20 23:37:16 080        10                                9                            
2021-07-23 21:00:51 081        16                                7                            
2021-07-27 02:27:09 082        10                                8                            
2021-07-29 02:04:50 083        16                                11                           
2021-07-30 14:32:48 084        33                                21                           
2021-08-03 02:15:23 085        107                               141                          
2021-08-05 08:06:31 086        502                               687                          
2021-08-08 05:34:18 087        1992                              1848                         
2021-08-11 02:09:16 088        6708                              1710                         
2021-08-14 02:27:13 089        6099                              1411                         
2021-08-17 22:32:03 090        5580                              1383                         
2021-08-25 18:05:01 091        5801                              1381                         
2021-08-30 12:27:03 092        5042                              1216                         
2021-09-01 12:32:48 093        2733                              221                          
2021-09-03 19:10:00 094        589                               29                           
2021-09-06 08:58:44 095        200

[Sep 13, 2021 6:50:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12359
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Thank you, Kevin. Are you moving to Toronto?

I see that all the generation 001's have started to move.

087 is the latest generation identified as labelled 'priority' but I will assume that 088 has now reached that status. I will base this response on that. If anyone knows of a later batch please advise and I will adjust my figures.

27% of the units are in the priority generations.

There are now 3,316,732 Units to be crunched to finish the project. The average number returned since the last of Kevin occasional high performance machine last stopped was 7891.6 units per day so my target for completion is now calculated as 8 November 2022. This assumes no invalids or errors are included in those returns. I suspect we are unlikely to see the project finish before the end of 2022.

Mike
[Sep 14, 2021 1:54:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Mike,

I doubt this is actually of any use in your analysis, but it can resolve your assumption about generation 088.... I received a full-duration 088 task at about 11:00 [UTC] on 14th September and a priority 088 task first thing on 15th September, so that transition actually happened about 12..24 hours after you posted (which is, I suspect, unlikely to disrupt your analysis!)

Thanks for all the effort you put in here and on the OPN1/G threads...

Cheers - Al.

[Edit for missing words!]
----------------------------------------
[Edit 1 times, last edit by alanb1951 at Sep 15, 2021 2:51:17 PM]
[Sep 15, 2021 2:49:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12359
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Thanks, Al.

I thought it was about time for 088, but I don't seem to get many new priority units, I mostly get resends, which, although they are priority cases, don't classify as priority generations.

I run a PC with 4 of its 8 threads on ARP with a cache of 1 extra unit and the rest onOPN, MCM and occasionally HST, each with 1 spare unit. My laptop overheats periodically so I don't run ARP on it, nor on my phone or 2 tablets. The extra tablet is because I cracked the screen but it still crunches although operating it is problematic.

I reiterate a previous post for general consumption by saying that the occasional lack of units is because there is a maximum of 71,218 units available (35,609 x 2). New units cannot be created until both of the previous pair have been returned and validated. Anyone who hold a substantial cache is cutting down that availability. Please cut your cache to a maximum of one more than the number of threads actually used for ARP. That way we boost the availability and crunchers can get their units validated more quickly.

Mike
[Sep 15, 2021 5:51:05 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1320
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
088 is surely now priority batch. I got 8 tasks with a shorter deadline. 2 of them:
ARP1_0014526_088_0 deadline 19 Sep 19:46:56
ARP1_0027370_088_0 deadline 19 Sep 19:46:56
[Sep 16, 2021 10:40:41 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12359
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available
Just to confirm that at the time of Kevin's post, 088 was not a priority generation, so only 8% of the then current units were from priority generations.

Since then 088 has become a priority generation but some of the 27% will have moved on.

Mike
[Sep 16, 2021 11:44:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 3204   Pages: 321   [ Previous Page | 132 133 134 135 136 137 138 139 140 141 | Next Page ]
[ Jump to Last Post ]
Post new Thread