Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 56
Posts: 56   Pages: 6   [ Previous Page | 1 2 3 4 5 6 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 362257 times and has 55 replies Next Thread
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

We have set the memory requirement for this project high for a number of reasons. One major reason is that machines with lower memory (even on linux) do not have a VM (Swap) space that can handle the allocation that is required by this application. I have many machines in my lab that have less than 512 MB of memory and they struggle with this application. And don't get me started on the P2 machine in my lab :)

Please remember that the purpose of running WCG is to have it run in the background as much as possible and not affect the member's normal computer usage.

Sek, for your memory message. Here is an example from my older machines.

Thu 18 Feb 2010 12:17:10 AM CST|World Community Grid|Message from server: Discovering Dengue Drugs - Together - Phase 2 needs 750.00 MB RAM but only 497.48 MB is available for use.


-Uplinger

(note: for those not sure what P2 is, that's Pentium 2, still running)
[Feb 19, 2010 5:37:06 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

Going by the Minimum requirements page, 1024 mb ram needed





yes I remember the p2, p3@600 Mhz is my personel box atm ;)
I have an AMD-K5 300 in the back if you want it
[Feb 19, 2010 6:33:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
ALAIN_13013
Advanced Cruncher
France
Joined: Nov 28, 2006
Post Count: 83
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
smile Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

Thank you Uplinger, here is for the French speakers

Sur le Forum Grid-France
Merci Uplinger, voici pour les Francophones

Type A ("ps"): Ces unités de travail sont les très longues.
Temps de calcul: 30-100 Heures
Quantité: Environ 36,000 WUs
Download: ~20 MBytes
Upload: ~2 MBytes
Identification (les premières lettres du leur nom): ps
Résultats: Chaque WU type A Créés 2 WUs type B: (Une "se" et l'autre "pe")
Checkpoints: 50 fois durant le calcul de l'Unité de travail. Environ tous les 2% d'exécution.

Type B ("se" ou"pe"): Ces unités de travail sont plus rapides avec des points de contrôle très fréquents.
Temps de calcul: 5-10 Heures
Quantité: Environ 72,000 WUs
Download: ~2MBytes (se) or ~20MBytes (pe)
Upload: ~2MBytes (se and pe)
Identification: se, pe
Résultats: Chaque Unité de type B créé environ 250 à 350 Unité de type C
Checkpoints: A une fréquence d'environ 10 secondes, et en fonction des préférences de projet du profil

Type C: Ce type d'unité de travail représente la plus grande partie du travail à faire.
Temps de calcul: 1 à 5 Heures
Quantité: Environ 22,000,000 Unités de travail.
Download: ~2MBytes (sq, sd, sr) or ~20MBytes (pq, pd, pr, pc, pl)
Upload: < 1MBytes
Identification: pq, pd, pr, pc, pl, sq, sd, sr
Résultats: Ceux-ci sont l'étape final. Les résultats sont envoyés aux chercheurs
Checkpoints: A une fréquence d'environ 1 minute, et en fonction des préférences de projet du profil

----------------------------------------

[Feb 20, 2010 10:27:14 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

Am a bit very slow off the bat [memory dead], but it seems the first alpha after erlc_ indicates the target... seen a to e so far. With 1,000 type A then anticipate a000-a499 or a001-a500 [in quorum 2]. Thus, the monster batches going from erlc_annn_ to erlc_rnnn_. Would be a nice additive to the OP as a one stop shop.

edit: typo
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
----------------------------------------
[Edit 1 times, last edit by Sekerob at Feb 21, 2010 10:08:50 PM]
[Feb 20, 2010 11:42:39 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

We have set the memory requirement for this project high for a number of reasons. One major reason is that machines with lower memory (even on linux) do not have a VM (Swap) space that can handle the allocation that is required by this application.

Ah, so it's guesswork. A machine with 256MB RAM could easily have 1GB or more of swap space.
e.g. Here's a snippet of top output for a worse example than DDDT2:
Cpu(s):100.0%us,  0.0%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem: 255948k total, 38168k used, 217780k free, 3628k buffers
Swap: 979924k total, 0k used, 979924k free, 18448k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
2299 root 25 0 1025m 244 192 R 99.9 0.1 4:51.51 worsethandddt2
2320 root 15 0 2228 1096 856 R 0.3 0.4 0:00.07 top
...
Even as things stand, DDDT2 will run on a 512MB machine with 256MB swap. However, if you are worried that some machines will not have enough swap configured in order to be able to start the process, why not remove the declarations of unused variables (amounting to about 348MB) from the executable? Then you could even reduce the requirements to 256MB.
[Feb 21, 2010 2:49:50 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

Hello WCG.

Attention: Kremmen
Reference: Your [Feb 21, 2010 2:49:50 AM ] post

Sir:

I have no issue with complying with the 1024-MB recommended minimum memory requirements for DDDT2. Even 2048-MB would still be ok. Memory is inexpensive these days, although arguably, the current economic downturn does not put as much money (as otherwise) in people's hands. Still, if things work fine even if I have, say 256MB, well and good; if not, despite (say, having 4GB memory), well, no big deal there as long as I can still contribute from other WCG project's WUs that have lesser memory requirements and are known to work with those requirements. Contributing -- to the extent that works -- is what matters the most.

Good day
;
[Feb 21, 2010 10:02:44 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

So now that some type A's have been validated, does that mean some type B's have been generated (anyone have any?) Or is there some delay (Do all the type A's have to be complete?) before the type B's become available to download?

Just curious how the timing works.
----------------------------------------
[Edit 1 times, last edit by Former Member at Feb 22, 2010 3:08:03 AM]
[Feb 22, 2010 3:03:58 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

So now that some type A's have been validated, does that mean some type B's have been generated (anyone have any?) Or is there some delay (Do all the type A's have to be complete?) before the type B's become available to download?
And the same question about the B types. Do we have to wait until all 2000 are validated before any C types are released?
[Feb 22, 2010 1:17:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sekerob
Ace Cruncher
Joined: Jul 24, 2005
Post Count: 20043
Status: Offline
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

Somewhere -Uplinger mentioned the A types were sub-divvied in groups of 25 [else we'd be waiting till St. Jude.]
----------------------------------------
WCG Global & Research > Make Proposal Help: Start Here!
Please help to make the Forums an enjoyable experience for All!
[Feb 22, 2010 1:21:49 PM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Discovering Dengue Drugs - Together Phase 2 Work Unit Types

Sekerob is correct. Type A's are seperated into groups of 25. This makes life a lot easier for managing the work units. This means that the type B's will be in groups of 50. Then type C's will be approximately 250 * 25. But we need to wait until all the work units from a given batch are returned before we can process them and create the next level of work units.

-Uplinger
[Feb 22, 2010 3:09:19 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 56   Pages: 6   [ Previous Page | 1 2 3 4 5 6 | Next Page ]
[ Jump to Last Post ]
Post new Thread