Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 44
Posts: 44   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 16214 times and has 43 replies Next Thread
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

Being taken seriously is following the steps and suggestions of a CA, so when confirmed we can scratch our heads why to the microsecond assignment time sorted tasks do not process in the order shown in the client (provided it is showing the historical order and not the hand sorted). As a person who claims to understand basic problem diagnostics you would be aware of the principle of reproducibility. Got here 5 sciences in the queue on a quad and the C4CW are getting their natural turn, just how BOINC is coded.

Sweet Dreams
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 24, 2010 11:39:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
David Autumns
Ace Cruncher
UK
Joined: Nov 16, 2004
Post Count: 11062
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

not even if you force BOINC by suspending the HFCC's one by one does a single C4CW get processed until all the HFCC's with the same deadline have been suspended

HFCC's always get processed before the C4CW's if they have the same deadline
----------------------------------------

[Aug 25, 2010 12:32:29 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

The ball remains in your court. You know what I've asked you to provide.

Sweet Dreams still.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 25, 2010 1:06:03 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3715
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

Dave,
There is a slight difference between C4CW WUs and all other ones, they have no input files. See knreed's post in Size of the WU and mine two posts below his in the same thread.
Maybe that explains why they are not sorted the same way by the BOINC client, or only some of them as they use to show various behaviors regarding scheduling.

Anyway, if this possible sequencing anomaly is only between WUs downloaded by the same fetch command, then all this is really nitpicking, in my opinion.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Aug 25, 2010 2:00:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

David,

I'm not 100% sure what you are seeing is improper. But if you could turn on cpu_sched_debug in cc_config.xml and let us know what you see in your message logs.

I have multiple ideas in my head what may be causing what you are seeing. But like i said, I do not believe this to be improper for the agent.

Thanks,
-Uplinger
[Aug 25, 2010 2:58:37 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

I don't think it is improper, from the clients point of view, but....

But i do see a time to completion of the c4cw unints of 25:14:05 at the moment. This will change (decrease), of course with 30 mins or so, every time when one of these tasks is completed (in around 4:30:00). But in the mean time they get far too much priority, pushing DDDT2 and HFCC units down the list.

I did put all the water on hold, because i am afraid i'll be missing the deadline of these units. (28-08-2010)

The water has a deadline of 02-09-2010: maybe a problem if they are to be completed in over a day instead of a mere 5 hours.

Arnold.
----------------------------------------
[Edit 1 times, last edit by Former Member at Aug 25, 2010 3:50:30 AM]
[Aug 25, 2010 3:49:09 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

Hi Arnold,

How many days of work are cached based on the values currently showing in the Time To Completion (TTC) column?

It's as I laid out, the processing is as per the "Sent Time" sort order on the Result Status (RS) page, so even though the C4CW may have a 10 day deadline, they could have been received beforethe DDDT/HFCC. The 28th reads like a 4 day deadline which you can confirm at the RS pages.

Requested some years ago, a way to return the deadline column to historical order... sort on first click on column header, ascending, second click, descending, 3rd click, historic receipt time which must be stored somewhere as else the client would not know how to apply the FIFO rule.Getting historic back is I think deleting the keys in the registry that hold such things a windows position.

Yesterday received 4 C4CW and could see only 3. Appeared that one was a repair job that had jumped to near the top of the sort order as had a CEP2 repair task. They were still sitting there this morning, at the top and expect them to sit there until the client has worked almost completely through the 2 day buffer... LILO. To me all the proof needed to support the knowledge that "by Grid" processing is FIFO unless there is a panic state, down to the microsecond. Your client clearly does not compute that condition.

On those very long times, you may have had one or more tasks that took much longer and consequently the client inflates the TTC for all the results taking the FPOPS in the job header and multiplying that in the first instance with the Duration Correction Factor. It only slowly gets reduced with each task that completes faster than the current projected TTCs for the tasks in the Ready to Start state.

Happy crunching, (best leaving the client to do what it's best at, processing the tasks... it hates being watched)


----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 25, 2010 9:07:54 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

So funny, the top running CEP2 job finished, 4 more tasks fetched, 2x2 for HCMD2 and C4CW backfilled but those repair jobs have still not been started... it's stilled called FIFO state and not EDF... yes sir, completely auto-magically, scouts honor hands off.

Time for a good coffee, Romcaffé today.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 25, 2010 10:20:35 AM]   Link   Report threatening or abusive post: please login first  Go to top 
JmBoullier
Former Community Advisor
Normandy - France
Joined: Jan 26, 2007
Post Count: 3715
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

Regarding the High Priority mode there is a parameter which has an influence on the threshold and for which WCG-only users might not care at all, that is the "Switch between applications every: xxxx minutes" setting.

Of course if a device is attached to several grids one has to set this parameter to achieve the desired time share between them.

But if crunching only for WCG you can set it for example
- to 4500 minutes to have jobs with a deadline of 3 days or less to start immediately after downloading
- or to 6000 minutes to have repair jobs with the normal 4-day deadline to start immediately.

It may not seem logical that this parameter has some effect even in a client attached to a single project, but really it does matter.
----------------------------------------
Team--> Decrypthon -->Statistics/Join -->Thread
[Aug 25, 2010 10:56:09 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Strange BOINC Priority

Jean (don't know who started the Jim thing),

Think you have eluded to this trick about 3-4 times, so right now going to apply this at a funky 5761 minutes (4 days+ 1 minute). That should kick those 2 repair jobs off right away. It is though inadvisable to use a switch time that is greater than the shortest regular deadline v.v. projects outside WCG. The penalty is that even when they would have low weight/resource share, those jobs will just run to the end, more work is being fetched that will than start immediately and on and on until the debt rule reaches max. A Proviso with this: There's been so many changes to client scheduling over time (but not the base FIFO principle) that it has to be tested on any client used if working as wanted.

And indeed, instantaneous HP state on those 2 jobs. That probably forces them to be reported quickly too... testing testing... beta drool territory.

Hat Tip. :D

PS, normally I have switch times set shorter than shortest run time of any project as any longer also has a bad effect... Now I wonder... would a client fetch normal work when it knows it wont get slotted in until after deadline... something to hands on-test on my current 6.10.58 Berkeley recommended clients (used at own risk)... on all devices, so aging factors are lesser preventing me to remember.
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Aug 25, 2010 11:25:18 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 44   Pages: 5   [ Previous Page | 1 2 3 4 5 | Next Page ]
[ Jump to Last Post ]
Post new Thread