Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
![]() |
World Community Grid Forums
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 118
|
![]() |
Author |
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7666 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Perhaps because we are now processing a million plus work units each day we have exceeded the capacity of the system to purge the older items. I was down to about 26,500 valid three days ago but am now back up to 27, 500 valid.I usually complete 450 to 500 work units per day. So maybe some are being purged, but at the current rate it will be slow going.
----------------------------------------Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
adriverhoef
Master Cruncher The Netherlands Joined: Apr 3, 2009 Post Count: 2160 Status: Recently Active Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Unixchick et al.,
Finally, after some 30 faithful and dedicated years with my first internet provider, I will be changing internet providers, which means that the shown links in Unixchick's first post of this thread (that pointed to hourly updated files) will stop working sometime in the near future. (They are called "Adri's WU scripts" and "SCC to be processed queue" in that first post.) Adri |
||
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 959 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() |
Thank you for the info Adri. I hope you have a smooth transition to a new provider. I'll remove the links.
I really appreciate your time and effort to give us a peek into the inner workings of WCG. |
||
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 959 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() |
I'm loving the constant supply of WUs from MCM !
I hope everyone had a good holiday with friends and family. It's a new year, and I'd really like an update. What is the funding status? What is the status of the other projects? What is the status of the no purge results list problem? What are the issues preventing ARP returning? |
||
|
TigerLily
Senior Cruncher Joined: May 26, 2023 Post Count: 280 Status: Offline Project Badges: ![]() |
Hi Unixchick,
We hope to share a newsletter with updates from each team in the next month or two. As for your other questions: - As Dr. Jurisica mentioned in his post, we are waiting to hear about funding towards the end of the month. At that point, we will be in a better place to share specifics about the status of our funding. - The current status of our other projects remains unchanged. - The tech team is implementing a fix that will enable assimilation of MCM results to resume today. - We anticipate that ARP will restart soon and will be sharing an update from their team soon, which will have more information on the status of the project. |
||
|
Unixchick
Veteran Cruncher Joined: Apr 16, 2020 Post Count: 959 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() |
Thank you TigerLily !!! I appreciate the quick answer. I'll keep an eye out for more info in the future!
|
||
|
Mike.Gibson
Ace Cruncher England Joined: Aug 23, 2007 Post Count: 12372 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Not seen any movement yet.
Mike |
||
|
alanb1951
Veteran Cruncher Joined: Jan 20, 2006 Post Count: 955 Status: Recently Active Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
There has been assimilator activity (see below)... However, remember that there wouldn't be any obvious movement visible via the web site (or the new API) until at least 24 hours after the assimilator(s) started successful processing :-)
Given TigerLily's comment. I looked for assimilator activity using the old API (as per previous posts by Adri and myself)... I checked result modification times and file delete state flags in data acquired at 02:00 (UTC) this morning and found that a massive 5 (yes, five) tasks had advanced to the state where they could be fully purged. All five made the transition between 20:36 and 20:43 (UTC) on the 11th. (And they disappeared some time after 20:45 on 12th, as expected.) Hoping that the above merely indicated an assimilator test or a crash that was eventually detected, I did another check using data collected at 20:00 (UTC) on 12th; that showed a further 404 tasks advanced to a "ready to purge" state. These changed between 02:38 and 19:11 (UTC) and will disappear on 13th. Better :-), but... Hopefully, that break at 19:11 isn't the start of another long interval with no assimilations :-) -- my next check isn't until 02:00 on the 13th. For what it's worth, I have about 12,000 tasks marked as valid, and process about 170 tasks a day (so this assimilation effort will remove about 3%, and will be counterbalanced within 2.5 days!) -- unless assimilation speeds up it's going to take a long time to catch up. Cheers - Al. P.S. I think the intervals between processed items are down to the assimilator(s) not running rather than my having no suitable candidate tasks. An assimilator should work in ascending WU order, and there wasn't a huge gap between the highest from the first 5 (413322093) and the lowest in the larger group (413348759), given that the highest in the larger group is 419606797... (Of course, this is just based on my tasks, so others may see different behaviour.) |
||
|
Sgt.Joe
Ace Cruncher USA Joined: Jul 4, 2006 Post Count: 7666 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
(Of course, this is just based on my tasks, so others may see different behaviour.) I was down to just under 27000 tasks a couple of days ago, but have now climbed to 28000+ tasks in the valid status. I did see the old tasks from Oct. 24 were gone with the oldest ones now being Oct. 31. I agree it will be a long slog. Cheers
Sgt. Joe
*Minnesota Crunchers* |
||
|
gj82854
Advanced Cruncher Joined: Sep 26, 2022 Post Count: 104 Status: Offline Project Badges: ![]() ![]() |
I have 37600 valid tasks and have only been contributing to WCG since 12-21-2023. I process about 3000 per day or 90000 per month with more threads coming online shortly.
|
||
|
|
![]() |