I will agree evolution (or attrition) will lead to that attitude amongst the (remaining) members here.

Now 28/1

Where are we in results cleanup? I took most of Feb off from crunching, so I don't have the data.

I haven't gotten a WU since yesterday (UTC time). So not sure how the flow is today either.

As we hit 20 days since the assimilators started running again, here's another summary of how fast my results have been removed. This is my state of play as at 02:00 (UTC) on 2024-03-20.

    Total results purged over 20 days: 14604  (944 in last day)
    Results awaiting file deletion:        0
    Results awaiting d/b purge:         2937
    Results awaiting assimilation:      2958

    Oldest results still awaiting removal are from 2024-01-27;
    oldest results waiting for assimilation are from 2024-02-19

Over the first 10 days, the average daily rate of d/b purging was quite low; at that point, things started to speed up (probably because of extra system capacity when WU generation wasn't happening!)

In the last 5 days the purge rate seems to be slowing down a bit, whilst the numbers of results passing through assimilation over the last 10 days seems fairly consistent.

    Interval       Assim.   Purged    Purge rate remarks
    -------------  ------   ------    ------------------
    First 10 days   5452      4282    no day with 600+ purged
    Next 5 days:    6195      5684    most 900+, only one day below 600
    Next 5 days:    5744      4638    no day above 1000

How much of the variation is down to changes made and how much is down to chance is, of course, unknown :-)

Note that I return around 160 to 180 results a day, and see a similar number of results validate on a typical day (even if some of them have to wait 6 days for retries to happen!), so I will call things "back to normal" once I have less than 200 results awaiting assimilation -- if it keeps up the current rate of progress, that should happen some time during the coming weekend [but stuff happens...]

Cheers - Al.

Advanced to 23 February

Mike