Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
World Community Grid Forums
Category: Completed Research Forum: The Clean Energy Project - Phase 2 Forum Thread: CEP2: Downloaded File Naming convention [RESOLVED] |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 2
|
Author |
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
As we will all agree, when the names of downloaded files logged in the messages and the names of the tasks in BOINC Manager is same, it's quite easy to reconcile for volunteers. Some of the projects have files names logged that have to the crunchers no relation at all, but for CEP2 it is different. The below log shows messages of 2 CEP2 tasks received in 2 sequential work calls, the first's name is clear [bold], but the second has no bearing [red]. It's not that more is logged based on time stamps. The next result then received is a Clean Water, and these log most of the times nothing at all as download, them getting only a seed signal during assignment.
----------------------------------------9951 WCG 27-05-2011 08:20 Started download of E202242_903_C.24.C22H15NS.00135573.1.set1d06_C.24.C22H15NS.00135573.1.zip 9952 WCG 27-05-2011 08:20 Finished download of E202242_903_C.24.C22H15NS.00135573.1.set1d06_C.24.C22H15NS.00135573.1.zip 9953 WCG 27-05-2011 08:20 [sched_op] Starting scheduler request 9954 WCG 27-05-2011 08:20 Sending scheduler request: To fetch work. 9955 WCG 27-05-2011 08:20 Requesting new tasks for CPU 9956 WCG 27-05-2011 08:20 [sched_op] CPU work request: 10605.25 seconds; 0.00 CPUs 9957 WCG 27-05-2011 08:20 Scheduler request completed: got 1 new tasks 9958 WCG 27-05-2011 08:20 [sched_op] Server version 601 9959 WCG 27-05-2011 08:20 Project requested delay of 11 seconds 9960 WCG 27-05-2011 08:20 [sched_op] estimated total CPU task duration: 28767 seconds 9961 WCG 27-05-2011 08:20 [sched_op] Deferring communication for 11 sec 9962 WCG 27-05-2011 08:20 [sched_op] Reason: requested by project 9963 WCG 27-05-2011 08:20 Started download of 2f99347df0362f7dba74670b3280aa7e .zip 9964 WCG 27-05-2011 08:20 Finished download of 2f99347df0362f7dba74670b3280aa7e.zip 9965 WCG 27-05-2011 08:20 [sched_op] Starting scheduler request 9966 WCG 27-05-2011 08:20 Sending scheduler request: To fetch work. 9967 WCG 27-05-2011 08:20 Requesting new tasks for CPU 9968 WCG 27-05-2011 08:20 [sched_op] CPU work request: 428.26 seconds; 0.00 CPUs 9969 WCG 27-05-2011 08:20 Scheduler request completed: got 1 new tasks 9970 WCG 27-05-2011 08:20 [sched_op] Server version 601 9971 WCG 27-05-2011 08:20 Project requested delay of 11 seconds 9972 WCG 27-05-2011 08:20 [sched_op] estimated total CPU task duration: 17586 seconds 9973 WCG 27-05-2011 08:20 [sched_op] Deferring communication for 11 sec 9974 WCG 27-05-2011 08:20 [sched_op] Reason: requested by project 9975 27-05-2011 08:23 Suspending network activity - time of day Per the BM the below 2 were added for crunching, noting that the projected computing time matches, both having shown up with 7:59 hours to compute (purple). E202242_ 903_ C.24.C22H15NS.00135573.1.set1d06_ 0-- 1112084 In Progress CEP2 27-5-2011 8:24:00 6-6-2011 6:19:59 Windows 7 - 64 Q6600 2400 27-5-2011 6:19:59 E202243_ 277_ C.24.C17H7N3S2Se2.00671775.4.set1d06_ 1 -- 1112084 In Progress CEP2 27-5-2011 8:24:00 6-6-2011 6:20:17 Windows 7 - 64 Q6600 2400 27-5-2011 6:20:17 c4cw_ target03_ 137336677_ 0-- 1112084 Valid C4CW 27-5-2011 8:24:00 27-5-2011 6:05:31 21,23 82,6 78,0 4,47 17,45 Windows 7 - 64 Q6600 2400 26-5-2011 8:51:59 Local times are 2 hours ahead of UTC. Question is: Why these different names for downloaded tasks... what smart design scheme is behind this? TIA --//-- edit: [RESOLVED] [Edit 1 times, last edit by Former Member at Jun 1, 2011 6:55:15 AM] |
||
|
knreed
Former World Community Grid Tech Joined: Nov 8, 2004 Post Count: 4504 Status: Offline Project Badges: |
There are three major types of files in workunits:
----------------------------------------1) Files that are 'sticky' and used across many batches and workunits 2) Files that are used by all workunits in a single batch 3) Files that are used only on a workunit All files have their own name which is not necessary unique. In order to make sure that it is unique in the BOINC download hierarchy we do the following: Type 1 files have the application short name prepended to them. Ex: faah.protease.dat Type 2 files have the batch name prepended to them. Ex: oe990_00000_oe990.fasta.gz (from hpf2). Type 3 files have the workunit name itself prepended to them. Ex: faah11681_ZINC08020114_xMut_md18750_01_ZINC08020114_xMut_md1875_01.gpf If the length of the name becomes too long, then we rename the file with the md5sum of the name of the file. Your '2f99347df0362f7dba74670b3280aa7e.zip' is an example of this. [Edit 1 times, last edit by knreed at May 31, 2011 8:12:58 PM] |
||
|
|