Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 2
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 336 times and has 1 reply Next Thread
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
CEP2: Downloaded File Naming convention [RESOLVED]

As we will all agree, when the names of downloaded files logged in the messages and the names of the tasks in BOINC Manager is same, it's quite easy to reconcile for volunteers. Some of the projects have files names logged that have to the crunchers no relation at all, but for CEP2 it is different. The below log shows messages of 2 CEP2 tasks received in 2 sequential work calls, the first's name is clear [bold], but the second has no bearing [red]. It's not that more is logged based on time stamps. The next result then received is a Clean Water, and these log most of the times nothing at all as download, them getting only a seed signal during assignment.

9951 WCG 27-05-2011 08:20 Started download of E202242_903_C.24.C22H15NS.00135573.1.set1d06_C.24.C22H15NS.00135573.1.zip
9952 WCG 27-05-2011 08:20 Finished download of E202242_903_C.24.C22H15NS.00135573.1.set1d06_C.24.C22H15NS.00135573.1.zip
9953 WCG 27-05-2011 08:20 [sched_op] Starting scheduler request
9954 WCG 27-05-2011 08:20 Sending scheduler request: To fetch work.
9955 WCG 27-05-2011 08:20 Requesting new tasks for CPU
9956 WCG 27-05-2011 08:20 [sched_op] CPU work request: 10605.25 seconds; 0.00 CPUs
9957 WCG 27-05-2011 08:20 Scheduler request completed: got 1 new tasks
9958 WCG 27-05-2011 08:20 [sched_op] Server version 601
9959 WCG 27-05-2011 08:20 Project requested delay of 11 seconds
9960 WCG 27-05-2011 08:20 [sched_op] estimated total CPU task duration: 28767 seconds
9961 WCG 27-05-2011 08:20 [sched_op] Deferring communication for 11 sec
9962 WCG 27-05-2011 08:20 [sched_op] Reason: requested by project
9963 WCG 27-05-2011 08:20 Started download of 2f99347df0362f7dba74670b3280aa7e .zip
9964 WCG 27-05-2011 08:20 Finished download of 2f99347df0362f7dba74670b3280aa7e.zip
9965 WCG 27-05-2011 08:20 [sched_op] Starting scheduler request
9966 WCG 27-05-2011 08:20 Sending scheduler request: To fetch work.
9967 WCG 27-05-2011 08:20 Requesting new tasks for CPU
9968 WCG 27-05-2011 08:20 [sched_op] CPU work request: 428.26 seconds; 0.00 CPUs
9969 WCG 27-05-2011 08:20 Scheduler request completed: got 1 new tasks
9970 WCG 27-05-2011 08:20 [sched_op] Server version 601
9971 WCG 27-05-2011 08:20 Project requested delay of 11 seconds
9972 WCG 27-05-2011 08:20 [sched_op] estimated total CPU task duration: 17586 seconds
9973 WCG 27-05-2011 08:20 [sched_op] Deferring communication for 11 sec
9974 WCG 27-05-2011 08:20 [sched_op] Reason: requested by project
9975 27-05-2011 08:23 Suspending network activity - time of day


Per the BM the below 2 were added for crunching, noting that the projected computing time matches, both having shown up with 7:59 hours to compute (purple).

E202242_ 903_ C.24.C22H15NS.00135573.1.set1d06_ 0-- 1112084 In Progress CEP2 27-5-2011 8:24:00 6-6-2011 6:19:59 Windows 7 - 64 Q6600 2400 27-5-2011 6:19:59
E202243_ 277_ C.24.C17H7N3S2Se2.00671775.4.set1d06_ 1 -- 1112084 In Progress CEP2 27-5-2011 8:24:00 6-6-2011 6:20:17 Windows 7 - 64 Q6600 2400 27-5-2011 6:20:17
c4cw_ target03_ 137336677_ 0-- 1112084 Valid C4CW 27-5-2011 8:24:00 27-5-2011 6:05:31 21,23 82,6 78,0 4,47 17,45 Windows 7 - 64 Q6600 2400 26-5-2011 8:51:59

Local times are 2 hours ahead of UTC.

Question is: Why these different names for downloaded tasks... what smart design scheme is behind this?

TIA

--//--

edit: [RESOLVED]
----------------------------------------
[Edit 1 times, last edit by Former Member at Jun 1, 2011 6:55:15 AM]
[May 27, 2011 6:58:24 AM]   Link   Report threatening or abusive post: please login first  Go to top 
knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: CEP2: Downloaded File Naming convention

There are three major types of files in workunits:

1) Files that are 'sticky' and used across many batches and workunits
2) Files that are used by all workunits in a single batch
3) Files that are used only on a workunit

All files have their own name which is not necessary unique. In order to make sure that it is unique in the BOINC download hierarchy we do the following:

Type 1 files have the application short name prepended to them. Ex: faah.protease.dat

Type 2 files have the batch name prepended to them. Ex: oe990_00000_oe990.fasta.gz (from hpf2).

Type 3 files have the workunit name itself prepended to them. Ex: faah11681_ZINC08020114_xMut_md18750_01_ZINC08020114_xMut_md1875_01.gpf

If the length of the name becomes too long, then we rename the file with the md5sum of the name of the file. Your '2f99347df0362f7dba74670b3280aa7e.zip' is an example of this.
----------------------------------------
[Edit 1 times, last edit by knreed at May 31, 2011 8:12:58 PM]
[May 31, 2011 8:12:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread