Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 3171
Posts: 3171   Pages: 318   [ Previous Page | 295 296 297 298 299 300 301 302 303 304 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 2570288 times and has 3170 replies Next Thread
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12338
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Sunday Report
ARP seems to be running smoothly.

This report has been rebased since the restart earlier last week. Any forecasts will be based on average throughput for the weeks availailable starting this week until 5 weeks are available whence it will be based.on the last 5 weeks.

There are still 3 ultras in generations 21 & 22.

The other classifications have stayed put..

There are now 356 extremes in generations 104 to 131. This includes 3 from 104 to 107 which have not moved. The earliest with more than 2 is now 115. The decrease of 278 being due to some now being classified as Accelerated.

There are now 5,746 accelerated units in generations 132 to 136 and 29,504 normal units in generations 137 to 146.

The highest generation to have had validations is 140.

Based on the 2 weeks, we would complete ARP1 in late 2027.

Mike
[Feb 2, 2025 4:15:20 PM]   Link   Report threatening or abusive post: please login first  Go to top 
catchercradle
Advanced Cruncher
Joined: Jan 16, 2009
Post Count: 125
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

ARP seems to be running smoothly.
This morning, unable to get new tasks either for Linux or Windows.

Edit: I guess maybe if the maximum allowed number of work units are all being snapped up, that does mean it is working smoothly. Now managed to get three tasks in Windows using VM. Still nothing on Linux though despite several tries.
----------------------------------------
[Edit 1 times, last edit by catchercradle at Feb 3, 2025 8:47:13 AM]
[Feb 3, 2025 7:57:17 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Dayle Diamond
Senior Cruncher
Joined: Jan 31, 2013
Post Count: 452
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

November 21st, 2024: 20,985 results.
Much of 2021 and 2022 saw similar returns.

With all the upgrades we're averaging around fifth of what we used to do.

After the first few days of results it was clear the server could handle a fifth. Why are we sticking with this bottleneck?
[Feb 3, 2025 8:13:23 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12338
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Dayle

There are a lot of factors involved.

Firstly, there are only 35609 units possibly available at any one time. With a quorum of 2, that means 71218 copies. However, there are 357 with 3 copies possible so that means an absolute maximum of 71575 available.

Then they can't all be available as some get stuck and have to be resent with shorter timesteps and there has to be a timelag from when a unit is validated to when it goes out as its next generation, So that reduces the units in play.

If you divide that by all the machines and threads that are chasing them (I don't know that figure but it must be a lot) you will see that they must be thin on the ground.

However, all the pauses we have had mean that may crunchers will have gone elsewhere, althouh machines have been getting bigger with more threads.

The real bottleneck is that limit of 35609 units which was built into the project from the beginning.

Mike
[Feb 4, 2025 12:11:47 AM]   Link   Report threatening or abusive post: please login first  Go to top 
catchercradle
Advanced Cruncher
Joined: Jan 16, 2009
Post Count: 125
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

althouh machines have been getting bigger with more threads.
Yes, I went from 8 to 16 real cores last year. It seems like the only way I could hope to get close to running 16 on one machine is to have at least two more instances of BOINC running through ~VM's etc. Currently I have shut down the Windows one but have one running the daily build of Plucky.
[Feb 4, 2025 9:52:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Dayle Diamond
Senior Cruncher
Joined: Jan 31, 2013
Post Count: 452
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Mike,

Thanks for your reply.

If you poke though the stats page for 2022, you'll see what the work units look like (mostly) unrestricted with a single duplicate by default - it's about twenty thousand a day.

All the factors you've brought up would still lead to a dearth of work, but if unimpeded the project would finish in months instead of years.
----------------------------------------
[Edit 1 times, last edit by Dayle Diamond at Feb 4, 2025 8:52:07 PM]
[Feb 4, 2025 8:51:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 931
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

When did we stop being on IBM ?? is 2022 still IBM days ?
I don't think that is a valid thing to compare anymore. We have what we have here, and we are grateful.
This last outage over December seems to have brought us some stability and faster uploads and downloads. I'm guessing they are still testing the limits of what can be done with it.
It must be remembered that WCG also took on the tasks that another group was doing and now doing the ARP WU generation as well. I'm sure we need to give them time to make sure that all is going smoothly in that bit as well.

I don't think the number of possible ARP WUs is a limiting factor at this point as we are only in the 140s right now and haven't sent out the higher generations yet. I think it could be a hardware/bandwidth limitation, or a ramping up/learning limitation.

I'll just say that I'm not running all the ARPs my machine could be running, but I'm very very grateful that I get to continue to process ARPs and see this project to completion, even if it is in 2027.
[Feb 4, 2025 10:08:16 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2150
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

Unixchick, to answer your question(s):
When did we stop being on IBM ?? is 2022 still IBM days ?
The transition from IBM to Krembil took place in 2022:

Statist.date Runtime (y:d:h:m:s) Points Results
09/30/2022 12:010:22:25:58 25,298,828 5,648
09/29/2022 17:262:05:02:44 36,736,402 8,284
02/26/2022 0:003:00:53:40 12,090 3
02/25/2022 0:021:18:18:07 123,420 32
02/24/2022 0:116:06:57:48 523,959 127
02/23/2022 0:256:03:38:56 1,213,789 297
02/22/2022 2:341:02:36:09 5,604,696 1,344
02/21/2022 9:129:04:03:23 18,306,126 4,446
02/20/2022 17:043:13:43:21 35,345,224 8,302
02/19/2022 18:082:11:15:47 36,533,964 8,429
02/18/2022 22:090:14:41:53 43,995,343 10,198

Adri
[Feb 4, 2025 10:28:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2150
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

It's not that the project started right away with 20,000 results per day.
On 30 October 2019, in post 616077, former tech member armstrdj warned:
due to storage requirements for this project the total daily number of tasks is much less than typical projects
In January 2020, an average of 2,000 results per day were returned. In February 2020, the number went up to 4,000. In March 2020, the average increased to 8,000. Till August 2020, this average didn't change much. Halfway August 2020, the number went up to ~ 12,000 results. June 2021 marked another high number: 14,000; July 2021: 16,000; August 2021: 18,000.
Then in late August 2021, one week of more than 20,000 results per day were turned in. This dropped to 16,000 results per day on average afterwards. In the last three months of 2021, there were about three weeks where more than 20,000 results per day were returned. After that the average was dropping to about 17,000 per day till mid February. After that, the transition was about to begin and the number dropped drastically as can be seen in my former post (#701404).

Adri
[Feb 4, 2025 11:23:42 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12338
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Work Available

I really don't think we should be comparing Krembil with IBM. The available resources have changed. Fortunately, we now seem to be doing much better since the latest restart. I actually had 2 downloads running at the same time with speeds of 1 MB/s but 300 KB/s is usual.

Mike
[Feb 5, 2025 2:51:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 3171   Pages: 318   [ Previous Page | 295 296 297 298 299 300 301 302 303 304 | Next Page ]
[ Jump to Last Post ]
Post new Thread