Index | Recent Threads | Unanswered Threads | Who's Active | Guidelines | Search |
![]() |
World Community Grid Forums
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
No member browsing this thread |
Thread Status: Active Total posts in this thread: 15
|
![]() |
Author |
|
Dayle Diamond
Senior Cruncher Joined: Jan 31, 2013 Post Count: 452 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
https://www.anandtech.com/show/15318/amds-64core-threadripper-3990x-3990-sd
----------------------------------------This is expensive up front but notably cheaper than their 64 core server processor. This can contribute a year's worth of processing every three days. Hopefully some of you reading this are in the financial position to pick one up. [Edit 1 times, last edit by Dayle Diamond at Jan 7, 2020 12:26:15 AM] |
||
|
wolfman1360
Senior Cruncher Canada Joined: Jan 17, 2016 Post Count: 176 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
https://www.anandtech.com/show/15318/amds-64core-threadripper-3990x-3990-sd This is expensive up front but notably cheaper than their 64 core server processor. This can contribute a year's worth of processing every three days. Hopefully some of you reading this are in the financial position to pick one up. Now that would be a beauty to own. I love that AMD are putting the stones to Intel.
Crunching for the betterment of human kind and the canines who will always be our best friends.
AWOU! |
||
|
mdxi
Advanced Cruncher Joined: Dec 6, 2017 Post Count: 109 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I'm not the target market for the 3990X, but it's just insane to think that 2.5 years ago, we were paying a premium for anything over 4c/8t.
----------------------------------------It's been a crazy ride in general since Ryzen hit the shelves. This part in particular is -- I dunno what it is. I'm out of adjectives :) My whole farm of 6 machines has 64 cores and 128 threads. That'll go up later this year when the Zen 3 chips ship (hopefully!), but until then you can have the equivalent of all my machines in one box with one of these. ![]() |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
But one would probably need a minimum of 256GB of memory to keep it responsive and busy but if you were to run 128 FAHB (one per thread) on that machine you might spill over to the swap file occasionally. I know, It happened to me..
|
||
|
Jozef J
Cruncher Joined: Sep 24, 2012 Post Count: 42 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
hi, 3990 .. without valuable to the current state of applications in Boinc.
----------------------------------------Just look to : TOP computers, on every boinc project... everywhere is most valuable : some older intel xeon V2-V4 with server board, Look to my 2990WX on Rakesearch : https://rake.boincfast.ru/rakesearch/top_hosts.php where is my day rac about 48 000 in average after months,,(dont look on todays numbers) .. Soo there is old xeon V2 about 30K rac VS 2990WX 1800usd 48K rac But year before was on rakesearch optimised app, and after show amd own power- on same cpu and all i have day rac 500-600K ! SOO there is not problem in hardware.. hw is powerfull in todays. Problem is again and again on project managers,aka scientist .. WE wasting resources becouse there on boinc projects are not able do make an adequately programmed application FOR todays powerfull cpus ! or even go from CPU app to GPU ..but this need more people to project+time+money.. for example on milkyway@home there is still most valuable graphics card already 12 years old amd 7970...)) rac/money ratio,, card is cheap and this can repay own more hunger for electricity, I think and how I've been watching/crunching boinc projects for years,WHOLE BOINC got into the phase when it is better to have old hardware than new.. and it is not scientifically, innovative, or otherwise... its dangerous, becouse whole boinc is becoming "dinosaur" )) show me project today and in an application where new amd processors are more than 50% better than some old intel xeons or other.. is not , maybe only that FAHB , but its becouse just more cores on amd, Soo we have powerfull cpus but NOW is "step" on projects side",, waiting..)) ![]() |
||
|
wolfman1360
Senior Cruncher Canada Joined: Jan 17, 2016 Post Count: 176 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
hi, 3990 .. without valuable to the current state of applications in Boinc. Just look to : TOP computers, on every boinc project... everywhere is most valuable : some older intel xeon V2-V4 with server board, Look to my 2990WX on Rakesearch : https://rake.boincfast.ru/rakesearch/top_hosts.php where is my day rac about 48 000 in average after months,,(dont look on todays numbers) .. Soo there is old xeon V2 about 30K rac VS 2990WX 1800usd 48K rac But year before was on rakesearch optimised app, and after show amd own power- on same cpu and all i have day rac 500-600K ! SOO there is not problem in hardware.. hw is powerfull in todays. Problem is again and again on project managers,aka scientist .. WE wasting resources becouse there on boinc projects are not able do make an adequately programmed application FOR todays powerfull cpus ! or even go from CPU app to GPU ..but this need more people to project+time+money.. for example on milkyway@home there is still most valuable graphics card already 12 years old amd 7970...)) rac/money ratio,, card is cheap and this can repay own more hunger for electricity, I think and how I've been watching/crunching boinc projects for years,WHOLE BOINC got into the phase when it is better to have old hardware than new.. and it is not scientifically, innovative, or otherwise... its dangerous, becouse whole boinc is becoming "dinosaur" )) show me project today and in an application where new amd processors are more than 50% better than some old intel xeons or other.. is not , maybe only that FAHB , but its becouse just more cores on amd, Soo we have powerfull cpus but NOW is "step" on projects side",, waiting..)) Primegrid is the only thing with avx512 support so far as I know. I think a lot of it comes down to project funding and trying to keep everything open to all types of processors. I'm sure a dual socket Sandy bridge Xeon with 32 threads will out perform my Ryzen 1700x and 1800x in points per day on this project simply because there are 32 WUs being crunched simultaneously. A project like CPDN would see drastically different results per Workunit as it seems to require different parts of the processor and that only real cores be used for speediest results. The Ryzen might be twice as quick per WU at this point, though I can't be sure, whereas on WCG with MCM I might only see a 20-40% difference, if even that, which would then be negated by twice as many WUs on the Xeon. Still, this 128 thread Ryzen would run circles around anything at this point. WCG isn't memory or hard disk hungry like some other projects can be (CPDN, Rosetta) unless we're talking about arp or even fight aids at home...I think they average around 400 MB per WU? A lot of gpu projects have CPU to go along with them because there are things gpus just can't crunch. I only have an rx570 so I'm glad there are CPU only projects, since that's what I own most of, and a lot of GPUs have done away with higher double precision computing, if I remember correctly. AMD still remains in the lead there - my rx570 handily out performs a gtx 1080 on that project. Maybe it's FP 64 I'm thinking of - I honestly can't remember specifics.
Crunching for the betterment of human kind and the canines who will always be our best friends.
AWOU! |
||
|
Dayle Diamond
Senior Cruncher Joined: Jan 31, 2013 Post Count: 452 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Doneske, can you provide more info on your memory swap issues?
----------------------------------------My understanding is that 1 gigabyte per thread is way more then enough: the two most popular work units cost at most 400 MB (MCM) and 650 MB (MIP) respectively. FAH2 supposedly uses even less, just a quarter of a gigabyte per work unit. Personally, I game on my 32 core Threadripper, while running BOINC, with 16 gigs of ram. My MCM work units (which are the majority of my work right now as I opt into everything and only run 8 MIP per queue to keep them from competing), are using about 35 MB apiece. That's nearly nothing. [Edit 1 times, last edit by Dayle Diamond at Jan 7, 2020 9:06:00 PM] |
||
|
Former Member
Cruncher Joined: May 22, 2018 Post Count: 0 Status: Offline |
I'm running a 128 thread EPYC server with 256GB of memory and I occasionally have data on the swap file. Most of the time it is zero but there are occasions when it isn't. That server is 100% dedicated to WCG and has no desktop code installed on it and running 19.10 of Ubuntu Linux. I've noticed an interesting anomaly on systems with large memory configurations (above 32GB) related to Rosetta and Gromacs mostly. If I run Rosetta (MIP) on systems with 32GB or smaller the memory allocation is mostly as you describe. Once you get above 32GB these programs seem to allocate more memory per process. It is really noticeable on the virtual allocation but also on the real side but to a lesser degree. Rosetta allocates 12.2GB virtual per process and about 1.3 or so real on the 256GB system. On the systems closer to 32GB they allocate about 3 GB virtual and then under 1GB real. On 64GB systems, it falls in between the two like 6GB or 7GB per process and about 1GB real. I captured memory debug information and sent it to WCG at their support email address. Their response was, they don't test on systems that large and so they wouldn't see it. They are forwarding the info to the developers. Anyway, since the real allocation is still reasonable it doesn't create a big impact and I can run 128 FAHB simultaneously. But when you start running 32, 64, 128 or 256 threads, the amount of storage allocated to buffers, cache, and other things is almost as much as the programs themselves. Right now on the 128 thread system with mostly MCM1 (120) and 8 CPDN (8) units. Memory utilization is 21GB for processes but over 31GB is allocated to buffers and cache. The anomaly doesn't happen on MCM1 mostly Rosetta. I tried running 128 Rosetta with 128GB and it didn't work. To balance out the memory across the memory channels, I went ahead and ordered another 128GB and it's been fine. I have to be careful what projects I run as CPDN and other projects together are too large even for 256GB.
----------------------------------------[Edit 2 times, last edit by Doneske at Jan 7, 2020 10:54:14 PM] |
||
|
hchc
Veteran Cruncher USA Joined: Aug 15, 2006 Post Count: 798 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Interesting data points on memory usage, Doneske. Rosetta seems a bit outdated and inefficient. It's been a couple years since that post where a project lead or developer commented on the L3 cache issues. It seems there's further inefficiencies with main memory usage.
----------------------------------------Re: the topic title, I'm kind of curious to see a benchmarks comparison between the 64/128 EPYC with 8-channel RAM and the 64/128 Threadripper with 4-channel RAM across different kinds of benchmarks.
|
||
|
VietOZ
Senior Cruncher United States Joined: Apr 8, 2007 Post Count: 205 Status: Offline Project Badges: ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
I'm more curious what kind of cooling can keep this beast under control crunching 24/7. That's my only concern right now. I have all the gears ready for it, just waiting for the cpu itself and the cpu cooler. If I can't find a good cooler then I may have to go with its lil brother, the 3970X. The Kraken X72, deepcool castle 360ex are the top AIO coolers and they can barely hold the 3970X on light weight projects. Run MCM full load, temps will be in the high 70s/low 80s. AVX? good luck with that :D
---------------------------------------- |
||
|
|
![]() |