Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3195
Posts: 3195   Pages: 320   [ Previous Page | 136 137 138 139 140 141 142 143 144 145 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2710700 times and has 3194 replies Next Thread
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 946
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I checked the stats for ARP expecting to see fewer WUs returned... but the stats seem consistent. I know I have had some idle time on my CPU, and I guessed some of you did too, so I was surprised to see our consistent return rate.

09/25/2021 38:199:00:06:56 69,476,067 16,161
09/24/2021 38:167:20:48:23 69,470,117 16,051
09/23/2021 36:218:11:24:33 66,772,225 15,536
[Sep 26, 2021 2:00:27 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12349
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Unixchick

A problem like the current one does not show up immediately on the statistics. They are still sending out work, but only resends, so many people are still working at 100%. I hold 5 units at any one time of which 1 is a spare. I have been getting mostly resends anyway. My spare was utilised and took some time to get replaced, but it did get replaced before another would have been needed. This happened twice today, but I did not lose any crunching time.

Resends will become scarcer and then we will get a significant fall in results returned, probably today.

Mike.
[Sep 26, 2021 2:47:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12349
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

One third fewer results returned yesterday. Expect another significant fall today. Resends are now scarce.

Mike
[Sep 27, 2021 1:32:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Jim1348
Veteran Cruncher
USA
Joined: Jul 13, 2009
Post Count: 1066
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

One third fewer results returned yesterday. Expect another significant fall today. Resends are now scarce.

I am wondering about your previous observation about the validations. Do you think that means there are more crunchers than they can handle?

I am happy to contribute if they need me, but there are a lot of projects that really don't have enough work. The symptoms may be different, but the occasional outages here may be an indication of that. Your insight would help on that.
[Sep 27, 2021 1:46:59 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7655
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Remember, the outages here of late have been due to the researchers, not WCG. MCM can always use more computer power, there is no shortage there.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Sep 27, 2021 2:31:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12349
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Jim1348

Once this problem is sorted, they will need you.

What is needed is for certain crunchers not to hoard units. It slows down the validation and therefore the creation of the next generation.

I would suggest that no-one should hold more than one spare unit and anyone taking more than 2 days per unit should not hold any spares.

As a general rule, the faster machines have more threads available.

A 16 thread machine running ARP on 8 threads (and other projects on the other threads) will probably take about 8-12 hours for each unit, so the spare unit would be spare for only about 60-90 minutes.

An 8 thread machine running ARP on 4 threads will probably take about 24 hours so the spare would be spare for about 6 hours.

Those times for the spare are acceptable, but a machine taking over 2 days to crunch a unit would probably have a spare hanging around for a day or more which would not be desirable. Apart from delaying the process, it would mean that the spare would cause the machine not to be classified as 'reliable' and so not get priority generations or resends.

There are only 35,609 units available so 71,218 including the wingmen, but that number is reduced by the number of results awaiting validation, hence the need to minimise the spares.

Mike
[Sep 27, 2021 3:02:06 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 946
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

09/26/2021 11,093
09/25/2021 16,161

Truthfully I expected it to drop off quicker. Hard to say how many of the 11k is resends vs hoarded WUs.

I'm hoping that there will be a fix on Monday and that WUs will flow easily again. It will be interesting when it does start generating new WUs again as every section will be ready to move to the next day with so many of the resends handled so quickly.
[Sep 27, 2021 6:10:51 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12349
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

It takes quite a while owing to the hoarded units and there is always a proportion of resends due to 'no replies'. That group takes 8 days to become resends.

Without a fix, there would probably be a few stragglers still being crunched next week.

Mike
[Sep 27, 2021 11:38:45 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 946
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I think it has been fixed! I'm getting new WUs!
THANK YOU!!
[Sep 27, 2021 2:05:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Crystal Pellet
Veteran Cruncher
Joined: May 21, 2008
Post Count: 1320
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I thought these tasks would all be stragglers, but the deadlines differs:

ARP1_0019642_073_1 - 01 Oct 04:41:54
ARP1_0014175_074_0 - 01 Oct 04:41:54
ARP1_0028643_076_1 - 04 Oct 11:30:36
ARP1_0017718_077_0 - 01 Oct 04:41:54
ARP1_0012938_082_1 - 04 Oct 11:30:36
ARP1_0004519_084_0 - 01 Oct 04:41:54
ARP1_0029315_086_0 - 03 Oct 00:01:02
[Sep 27, 2021 2:58:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 3195   Pages: 320   [ Previous Page | 136 137 138 139 140 141 142 143 144 145 | Next Page ]
[ Jump to Last Post ]
Post new Thread