World Community Grid - View Thread - Just lost my entire cache of workunits on 2 machines!

World Community Grid Forums

Category: Support

Forum: BOINC Agent Support

Thread: Just lost my entire cache of workunits on 2 machines!

Quick Go »

No member browsing this thread

Thread Status: Active
Total posts in this thread: 52

[ ]

Author

This topic has been viewed 51938 times and has 51 replies

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Just lost my entire cache of workunits on 2 machines!

6 days of cache and 1600 WU's gone! crying

This is the message log:

28/02/2011 11:02:46 PM World Community Grid [error] Signature verification error for wcg_dddt2_charmm_6.17_windows_intelx86
28/02/2011 11:02:47 PM World Community Grid Computation for task ts01_a471_sqa007_0 finished
28/02/2011 11:02:47 PM World Community Grid Output file ts01_a471_sqa007_0_0 for task ts01_a471_sqa007_0 absent
28/02/2011 11:02:47 PM World Community Grid Output file ts01_a471_sqa007_0_1 for task ts01_a471_sqa007_0 absent
28/02/2011 11:02:47 PM World Community Grid Starting ts01_a474_sqa009_0
28/02/2011 11:02:48 PM World Community Grid Starting ts01_a474_sqb004_0
28/02/2011 11:02:49 PM World Community Grid Started upload of ts01_a471_sqa002_1_0
28/02/2011 11:02:49 PM World Community Grid Started upload of ts01_a471_sqa002_1_1
28/02/2011 11:02:49 PM World Community Grid Started upload of ts01_a471_sqa002_1_2
28/02/2011 11:02:49 PM World Community Grid Computation for task ts01_a474_sqa009_0 finished
28/02/2011 11:02:49 PM World Community Grid Output file ts01_a474_sqa009_0_0 for task ts01_a474_sqa009_0 absent
28/02/2011 11:02:49 PM World Community Grid Output file ts01_a474_sqa009_0_1 for task ts01_a474_sqa009_0 absent
28/02/2011 11:02:49 PM World Community Grid Computation for task ts01_a474_sqb004_0 finished
28/02/2011 11:02:49 PM World Community Grid Output file ts01_a474_sqb004_0_0 for task ts01_a474_sqb004_0 absent
28/02/2011 11:02:49 PM World Community Grid Output file ts01_a474_sqb004_0_1 for task ts01_a474_sqb004_0 absent
28/02/2011 11:02:49 PM World Community Grid Starting ts01_a478_sqa009_1
28/02/2011 11:02:51 PM World Community Grid Computation for task ts01_a478_sqa009_1 finished
28/02/2011 11:02:51 PM World Community Grid Output file ts01_a478_sqa009_1_0 for task ts01_a478_sqa009_1 absent
28/02/2011 11:02:51 PM World Community Grid Output file ts01_a478_sqa009_1_1 for task ts01_a478_sqa009_1 absent
28/02/2011 11:02:51 PM World Community Grid Starting ts01_b352_pcb002_0
28/02/2011 11:02:51 PM World Community Grid Starting task ts01_b352_pcb002_0 using dddt2 version 640
28/02/2011 11:02:51 PM World Community Grid Starting ts01_b352_pca014_0
28/02/2011 11:02:51 PM World Community Grid Starting task ts01_b352_pca014_0 using dddt2 version 640
28/02/2011 11:02:51 PM World Community Grid Starting ts01_b355_pcb005_0
28/02/2011 11:02:51 PM World Community Grid Starting task ts01_b355_pcb005_0 using dddt2 version 640
28/02/2011 11:02:51 PM World Community Grid Starting ts01_b355_pcb004_1
28/02/2011 11:02:51 PM World Community Grid Starting task ts01_b355_pcb004_1 using dddt2 version 640
28/02/2011 11:02:51 PM World Community Grid Starting ts01_b359_pca012_0
28/02/2011 11:02:51 PM World Community Grid Starting task ts01_b359_pca012_0 using dddt2 version 640
28/02/2011 11:02:51 PM World Community Grid Starting ts01_b359_pca009_1
28/02/2011 11:02:52 PM World Community Grid Starting task ts01_b359_pca009_1 using dddt2 version 640
28/02/2011 11:02:52 PM World Community Grid Starting ts01_b359_pcb002_1
28/02/2011 11:02:52 PM World Community Grid Starting task ts01_b359_pcb002_1 using dddt2 version 640
28/02/2011 11:02:52 PM World Community Grid Starting ts01_b359_pcb001_0
28/02/2011 11:02:52 PM World Community Grid Starting task ts01_b359_pcb001_0 using dddt2 version 640
28/02/2011 11:02:52 PM World Community Grid Starting ts01_b354_pdb000_0
28/02/2011 11:02:52 PM World Community Grid Starting task ts01_b354_pdb000_0 using dddt2 version 640
28/02/2011 11:02:52 PM World Community Grid Starting ts01_b354_pda004_1
28/02/2011 11:02:52 PM World Community Grid Starting task ts01_b354_pda004_1 using dddt2 version 640
28/02/2011 11:02:52 PM World Community Grid Starting ts01_b356_pdb002_0
28/02/2011 11:02:53 PM World Community Grid Starting task ts01_b356_pdb002_0 using dddt2 version 640
28/02/2011 11:02:53 PM World Community Grid Starting ts01_b356_pda004_1
28/02/2011 11:02:53 PM World Community Grid Starting task ts01_b356_pda004_1 using dddt2 version 640
28/02/2011 11:02:58 PM World Community Grid Finished download of dddt2a_image11_6.40.tga
28/02/2011 11:02:58 PM World Community Grid Finished download of dddt2a_image03_6.40.tga
28/02/2011 11:02:58 PM World Community Grid Started download of dddt2a_image02_6.40.tga
28/02/2011 11:02:58 PM World Community Grid Started download of dddt2a_image07_6.40.tga
28/02/2011 11:02:58 PM World Community Grid Finished upload of ts01_a471_sqa002_1_2
28/02/2011 11:03:00 PM World Community Grid update requested by user
28/02/2011 11:03:02 PM World Community Grid Finished download of dddt2a_image02_6.40.tga
28/02/2011 11:03:02 PM World Community Grid Finished download of dddt2a_image07_6.40.tga
28/02/2011 11:03:02 PM World Community Grid Started download of dddt2a_image17_6.40.tga
28/02/2011 11:03:02 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_gsbp_18_0.psf.gzb
28/02/2011 11:03:02 PM World Community Grid Finished upload of ts01_a471_sqa002_1_1
28/02/2011 11:03:02 PM World Community Grid Fetching scheduler list
28/02/2011 11:03:05 PM World Community Grid Finished download of dddt2a_image17_6.40.tga
28/02/2011 11:03:05 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_gsbp_18_0.crd.gzb
28/02/2011 11:03:06 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_gsbp_18_0.psf.gzb
28/02/2011 11:03:06 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_d016.prm.gzb
28/02/2011 11:03:06 PM World Community Grid Master file download succeeded
28/02/2011 11:03:08 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_gsbp_18_0.crd.gzb
28/02/2011 11:03:08 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_d016.prm.gzb
28/02/2011 11:03:08 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_d016.rtf.gzb
28/02/2011 11:03:08 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_const_dihe.str.gzb
28/02/2011 11:03:10 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_d016.rtf.gzb
28/02/2011 11:03:10 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_const_dihe.str.gzb
28/02/2011 11:03:10 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_dg01_mij_18.dat.gzb
28/02/2011 11:03:10 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_dg01_phi_18.dat.gzb
28/02/2011 11:03:12 PM World Community Grid Sending scheduler request: Requested by user.
28/02/2011 11:03:12 PM World Community Grid Reporting 792 completed tasks, requesting new tasks
28/02/2011 11:03:14 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_dg01_mij_18.dat.gzb
28/02/2011 11:03:14 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_gsbp_param_18.str.gzb
28/02/2011 11:03:16 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_dg01_d016_gsbp_param_18.str.gzb
28/02/2011 11:03:16 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_par_all22_prot_cmap.inp.gzb
28/02/2011 11:03:19 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_par_all22_prot_cmap.inp.gzb
28/02/2011 11:03:19 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_top_all22_prot_cmap.inp.gzb
28/02/2011 11:03:19 PM World Community Grid Finished upload of ts01_a471_sqa002_1_0
28/02/2011 11:03:21 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_top_all22_prot_cmap.inp.gzb
28/02/2011 11:03:21 PM World Community Grid Started download of dg01_d_g02_d011_to_d020_typeA_site_stup_gcmc.inp.gzb
28/02/2011 11:03:23 PM World Community Grid Finished download of dg01_d_g02_d011_to_d020_typeA_site_stup_gcmc.inp.gzb
28/02/2011 11:03:43 PM World Community Grid Scheduler request completed: got 0 new tasks
28/02/2011 11:03:43 PM World Community Grid Message from server: No work sent
28/02/2011 11:03:43 PM World Community Grid Message from server: No work is available for Discovering Dengue Drugs - Together - Phase 2
28/02/2011 11:03:43 PM World Community Grid Message from server: No work is available for Discovering Dengue Drugs - Together - Phase 2 (Type A)
28/02/2011 11:03:43 PM World Community Grid Message from server: (reached daily quota of 12 results)
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a475_pr34a0_1; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a475_pr23b1_1; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a475_pr89a1_0; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a475_pr89a0_1; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a475_pr91b0_0; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a475_pr91a1_0; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a478_pr02a1_0; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a479_pr56b0_0; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a479_pr89a0_0; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a471_sqa006_1; state 0
28/02/2011 11:03:43 PM World Community Grid [error] garbage_collect(); still have active task for acked result ts01_a471_sqa005_1; state 0
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a475_pr34a0_1 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a475_pr34a0_1_1 for task ts01_a475_pr34a0_1 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a475_pr23b1_1 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a475_pr23b1_1_1 for task ts01_a475_pr23b1_1 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a475_pr89a1_0 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a475_pr89a1_0_1 for task ts01_a475_pr89a1_0 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a475_pr89a0_1 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a475_pr89a0_1_1 for task ts01_a475_pr89a0_1 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a475_pr91b0_0 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a475_pr91b0_0_1 for task ts01_a475_pr91b0_0 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a475_pr91a1_0 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a475_pr91a1_0_1 for task ts01_a475_pr91a1_0 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a478_pr02a1_0 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a478_pr02a1_0_1 for task ts01_a478_pr02a1_0 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a479_pr56b0_0 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a479_pr56b0_0_1 for task ts01_a479_pr56b0_0 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a479_pr89a0_0 finished
28/02/2011 11:03:44 PM World Community Grid Output file ts01_a479_pr89a0_0_1 for task ts01_a479_pr89a0_0 absent
28/02/2011 11:03:44 PM World Community Grid Computation for task ts01_a471_sqa006_1 finished
28/02/2011 11:03:45 PM World Community Grid Output file ts01_a471_sqa006_1_1 for task ts01_a471_sqa006_1 absent
28/02/2011 11:03:45 PM World Community Grid Computation for task ts01_a471_sqa005_1 finished
28/02/2011 11:03:45 PM World Community Grid Output file ts01_a471_sqa005_1_1 for task ts01_a471_sqa005_1 absent
28/02/2011 11:03:47 PM World Community Grid Started upload of ts01_a475_pr34a0_1_0
28/02/2011 11:03:47 PM World Community Grid Started upload of ts01_a475_pr34a0_1_2
28/02/2011 11:03:47 PM World Community Grid Started upload of ts01_a475_pr23b1_1_0
28/02/2011 11:03:48 PM World Community Grid Finished upload of ts01_a475_pr34a0_1_2
28/02/2011 11:03:48 PM World Community Grid Started upload of ts01_a475_pr23b1_1_2
28/02/2011 11:03:49 PM World Community Grid Finished upload of ts01_a475_pr23b1_1_2
28/02/2011 11:03:49 PM World Community Grid Started upload of ts01_a475_pr89a0_1_0
28/02/2011 11:03:55 PM World Community Grid Finished download of wcg_dddt2a_charmm_6.40_windows_intelx86
28/02/2011 11:04:00 PM World Community Grid update requested by user
28/02/2011 11:04:00 PM World Community Grid Sending scheduler request: Requested by user.
28/02/2011 11:04:00 PM World Community Grid Requesting new tasks
28/02/2011 11:04:01 PM World Community Grid Scheduler request completed: got 0 new tasks
28/02/2011 11:04:01 PM World Community Grid Message from server: No work sent
28/02/2011 11:04:01 PM World Community Grid Message from server: No work is available for Discovering Dengue Drugs - Together - Phase 2
28/02/2011 11:04:01 PM World Community Grid Message from server: No work is available for Discovering Dengue Drugs - Together - Phase 2 (Type A)
28/02/2011 11:04:01 PM World Community Grid Message from server: (reached daily quota of 12 results)
=======================================================

Here is the result log:

Result Log

Result Name: ts01_ b295_ sr67b1_ 1--

<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
app_version download error: couldn't get input files:
<file_xfer_error>
<file_name>wcg_dddt2_charmm_6.17_windows_intelx86</file_name>
<error_code>-120</error_code>
<error_message>signature verification error</error_message>
</file_xfer_error>

</message>
]]>
==============================================

Looks like BOINC tried to download a new DDDT2 science app and somehow it got corrupted. Am I correct? I just find it strange that 2 machines errored in the exact same way at roughtly the same time.

Machine specs:

Intel 980x at 4GHz
4 GB RAM
Standard HDD with plenty of free space.
Windows server 2003

[Edited by knreed to make the title generic for all cases - not just dddt2 prior to moving to the BOINC support forum]

----------------------------------------
[Edit 1 times, last edit by knreed at Mar 2, 2011 8:25:29 AM]

[Mar 1, 2011 7:16:07 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

1600 WU's gone!
Wow thats a big hit...

Guess it's because of this...
http://www.worldcommunitygrid.org/forums/wcg/viewthread_thread,30943

[Mar 1, 2011 7:25:10 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

I just lost my entire cache too, and can't refill it because my quota is now down to one result per core and it's full. Thanks to whatever this problem is with DDDT, I now can't download work for any WCG project.
I would imagine this host won't be marked reliable again for a long time, either. grrrrr

----------------------------------------
[Edit 2 times, last edit by Former Member at Mar 1, 2011 7:47:57 AM]

[Mar 1, 2011 7:31:37 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

I had exactly the same thing happen with HCMD2. It downloaded wcg_hcmd2_maxdo_6.40_i686-pc-linux-gnu and then reported:
"Signature verification failed for wcg_hcmd2_maxdo_6.15_i686-pc-linux-gnu".
Then, all queued jobs failed as above.

[Mar 1, 2011 8:42:08 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

Got a nasty suspicion that the old key is no longer seen as valid [well, the message implies strongly]... the techs would have to chime in on this and reset the quota where needed.

For sure have disabled work fetch to at least run through to the last result before allowing new work to come. Since, completed results did report without hassle.

--//--

edit: Put a note in the back-room, and yes all the new keyed science versions are 6.40 by the looks of it.

----------------------------------------
[Edit 1 times, last edit by Former Member at Mar 1, 2011 9:15:12 AM]

[Mar 1, 2011 8:54:28 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

A third machine of mine running CEP2 has just blown out it's cache in the same manner. 5 more running DDDT2 and HFCC seem to be still running fine. confused

[Mar 1, 2011 9:52:02 AM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

Same issue here with 1 machine (also a 980X).
Thanks for the info guys.

[Mar 1, 2011 10:48:23 AM]

knreed
Former World Community Grid Tech
Joined: Nov 8, 2004
Post Count: 4504
Status: Offline
Project Badges:

180 day badge for Human Proteome Folding

90 day badge for Human Proteome Folding - Phase 2

45 day badge for Help Cure Muscular Dystrophy - Phase 2

90 day badge for Computing for Clean Water

14 day badge for Uncovering Genome Mysteries

45 day badge for Outsmart Ebola Together

180 day badge for FightAIDS@Home - Phase 2

1 year badge for Microbiome Immunity Project

1 year badge for Africa Rainfall Project

180 day badge for OpenPandemics - COVID-19


Re: Just lost my entire cache of DDDT2 on 2 machines!

What version of BOINC are you using and did you have anything unusual set up on your machines other than a large cache?

Are your machines re-filling with work as you return valid results?

thanks,
Kevin

[Mar 1, 2011 11:58:46 AM]

pirogue
Veteran Cruncher
USA
Joined: Dec 8, 2008
Post Count: 685
Status: Offline
Project Badges:

10 year badge for Human Proteome Folding - Phase 2

1 year badge for Discovering Dengue Drugs - Together

2 year badge for Nutritious Rice for the World

2 year badge for The Clean Energy Project

10 year badge for Help Fight Childhood Cancer

2 year badge for Influenza Antiviral Drug Search

10 year badge for Help Cure Muscular Dystrophy - Phase 2

10 year badge for Discovering Dengue Drugs - Together - Phase 2

10 year badge for The Clean Energy Project - Phase 2

10 year badge for Computing for Clean Water

10 year badge for Drug Search for Leishmaniasis

10 year badge for GO Fight Against Malaria

2 year badge for Computing for Sustainable Water

20 year badge for Mapping Cancer Markers

20 year badge for Uncovering Genome Mysteries

10 year badge for Outsmart Ebola Together

10 year badge for FightAIDS@Home - Phase 2

10 year badge for Smash Childhood Cancer

10 year badge for Microbiome Immunity Project

10 year badge for OpenPandemics - COVID-19


Re: Just lost my entire cache of DDDT2 on 2 machines!

I also has a mass error dump happen early this morning, on 2 machines. I was too tired to post at the time. It was a total of around 500 WUs.

Some of the errors were this:

Result Log 	
Result Name: ts01_ b012_ sqb006_ 1--
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
Input file wcg_dddt2_charmm_6.17_windows_intelx86 missing or invalid: -163
</message>
]]>

and some were this:

Result Log 	
Result Name: ts01_ b148_ pcb008_ 1--
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
app_version download error: couldn't get input files:
<file_xfer_error>
<file_name>wcg_dddt2_charmm_6.17_windows_intelx86</file_name>
<error_code>-120</error_code>
<error_message>signature verification error</error_message>
</file_xfer_error>
</message>
]]>

Both machines are running 6.10.58. One is 64-bit Win7 and one is 32-bit Server 2003.

edit:No new work is being sent to either machine because of the quota.

----------------------------------------

----------------------------------------
[Edit 1 times, last edit by pirogue at Mar 1, 2011 1:10:18 PM]

[Mar 1, 2011 1:08:54 PM]

Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline


Re: Just lost my entire cache of DDDT2 on 2 machines!

I had no problems , but just for comparison...

I am running an older version of x64 Linux (Mint 7 / Ubuntu 9.04)
Boinc version 6.2.18
0.00 buffer (cache)
12 GB / 12 GB / 4 GB / 4 GB (Memory)
i7 980x & i7 920 & i7 m620 & Core 2 Quad Q9550

Tomas T

----------------------------------------
[Edit 4 times, last edit by Former Member at Mar 4, 2011 12:35:21 PM]

[Mar 1, 2011 1:09:42 PM]

[ ]