Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go ยป
No member browsing this thread
Thread Status: Active
Total posts in this thread: 118
Posts: 118   Pages: 12   [ Previous Page | 2 3 4 5 6 7 8 9 10 11 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 13930 times and has 117 replies Next Thread
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7666
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Perhaps because we are now processing a million plus work units each day we have exceeded the capacity of the system to purge the older items. I was down to about 26,500 valid three days ago but am now back up to 27, 500 valid.I usually complete 450 to 500 work units per day. So maybe some are being purged, but at the current rate it will be slow going.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 9, 2024 3:25:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
adriverhoef
Master Cruncher
The Netherlands
Joined: Apr 3, 2009
Post Count: 2160
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Unixchick et al.,

Finally, after some 30 faithful and dedicated years with my first internet provider, I will be changing internet providers, which means that the shown links in Unixchick's first post of this thread (that pointed to hourly updated files) will stop working sometime in the near future.

(They are called "Adri's WU scripts" and "SCC to be processed queue" in that first post.)

Adri
[Jan 10, 2024 3:56:35 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 959
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Thank you for the info Adri. I hope you have a smooth transition to a new provider. I'll remove the links.
I really appreciate your time and effort to give us a peek into the inner workings of WCG.
[Jan 10, 2024 4:27:33 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 959
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

I'm loving the constant supply of WUs from MCM !

I hope everyone had a good holiday with friends and family.

It's a new year, and I'd really like an update.
What is the funding status?
What is the status of the other projects?
What is the status of the no purge results list problem?
What are the issues preventing ARP returning?
[Jan 11, 2024 4:18:04 PM]   Link   Report threatening or abusive post: please login first  Go to top 
TigerLily
Senior Cruncher
Joined: May 26, 2023
Post Count: 280
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Hi Unixchick,

We hope to share a newsletter with updates from each team in the next month or two. As for your other questions:
- As Dr. Jurisica mentioned in his post, we are waiting to hear about funding towards the end of the month. At that point, we will be in a better place to share specifics about the status of our funding.
- The current status of our other projects remains unchanged.
- The tech team is implementing a fix that will enable assimilation of MCM results to resume today.
- We anticipate that ARP will restart soon and will be sharing an update from their team soon, which will have more information on the status of the project.
[Jan 11, 2024 9:56:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Unixchick
Veteran Cruncher
Joined: Apr 16, 2020
Post Count: 959
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Thank you TigerLily !!! I appreciate the quick answer. I'll keep an eye out for more info in the future!
[Jan 12, 2024 12:52:34 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Mike.Gibson
Ace Cruncher
England
Joined: Aug 23, 2007
Post Count: 12372
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

Not seen any movement yet.

Mike
[Jan 12, 2024 5:13:25 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 955
Status: Recently Active
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

There has been assimilator activity (see below)... However, remember that there wouldn't be any obvious movement visible via the web site (or the new API) until at least 24 hours after the assimilator(s) started successful processing :-)

Given TigerLily's comment. I looked for assimilator activity using the old API (as per previous posts by Adri and myself)... I checked result modification times and file delete state flags in data acquired at 02:00 (UTC) this morning and found that a massive 5 (yes, five) tasks had advanced to the state where they could be fully purged. All five made the transition between 20:36 and 20:43 (UTC) on the 11th. (And they disappeared some time after 20:45 on 12th, as expected.)

Hoping that the above merely indicated an assimilator test or a crash that was eventually detected, I did another check using data collected at 20:00 (UTC) on 12th; that showed a further 404 tasks advanced to a "ready to purge" state. These changed between 02:38 and 19:11 (UTC) and will disappear on 13th. Better :-), but...

Hopefully, that break at 19:11 isn't the start of another long interval with no assimilations :-) -- my next check isn't until 02:00 on the 13th.

For what it's worth, I have about 12,000 tasks marked as valid, and process about 170 tasks a day (so this assimilation effort will remove about 3%, and will be counterbalanced within 2.5 days!) -- unless assimilation speeds up it's going to take a long time to catch up.

Cheers - Al.

P.S. I think the intervals between processed items are down to the assimilator(s) not running rather than my having no suitable candidate tasks. An assimilator should work in ascending WU order, and there wasn't a huge gap between the highest from the first 5 (413322093) and the lowest in the larger group (413348759), given that the highest in the larger group is 419606797... (Of course, this is just based on my tasks, so others may see different behaviour.)
[Jan 12, 2024 11:13:24 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7666
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

(Of course, this is just based on my tasks, so others may see different behaviour.)


I was down to just under 27000 tasks a couple of days ago, but have now climbed to 28000+ tasks in the valid status. I did see the old tasks from Oct. 24 were gone with the oldest ones now being Oct. 31. I agree it will be a long slog.

Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Jan 13, 2024 12:05:16 AM]   Link   Report threatening or abusive post: please login first  Go to top 
gj82854
Advanced Cruncher
Joined: Sep 26, 2022
Post Count: 104
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Project Status (First Post Updated)

I have 37600 valid tasks and have only been contributing to WCG since 12-21-2023. I process about 3000 per day or 90000 per month with more threads coming online shortly.
[Jan 13, 2024 1:27:57 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 118   Pages: 12   [ Previous Page | 2 3 4 5 6 7 8 9 10 11 | Next Page ]
[ Jump to Last Post ]
Post new Thread