Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 17
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 4175 times and has 16 replies Next Thread
ShyanJMC
Cruncher
Joined: Jan 29, 2020
Post Count: 2
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Please, compile all work units with support for Linux ARM.

At the time of creation this post, only OpenPandemics have the support for Linux ARM. The rest only support Android in ARM.

I think and believe this is a huge error. Apple have now their chips M1 based in ARM, Amazon Web Services is using their ARM CPUs, Microsoft will use their ARM chips in the future Surfaces' notebooks, Ampere have their 80 core top CPUS, etc.

I have 3 raspberry pi 4 running OpenPandemics because is the only thing that are available to run in Linux, maybe more than one will say "So, install Android in the SDCARD and run wherever you want". No, I'm sorry but that limitation is not acceptable.

ARM is the middle present and the future of this. A Raspberry Pi 4 is more efficient than x86 with the same cores count and can run 4 or more threads at the same time. Also, the possibilities to optimize an Gentoo or Arch Linux is very more big than in Android which is not GNU/Linux, just Linux and not a standard.

There are a lot of examples that we can provide here; the most powerful of super computers in the world is an ARM based, the lower consumption, etc. But the most important is; the balance between consumption-performance is bigger than in x86 so at middle time is more effective running all in ARM than in x86.

I know, I know, isn't easy as just recompile the support for ARM with Linux's libs for 1M of work units. But, just please take in consideration for future steps of the projects, I would be very happy if in that raspberrys I will can run 12 work units at the same time in a optimized Arch Linux.
[Dec 23, 2020 5:28:22 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1673
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

I think that ARP1, HSTB, and MIP1 would surely not run on ARM because of the required memory.
At the other side, MCM and SCC1 (when available) would probably run fine.
Cheers,
Yves
----------------------------------------
[Dec 23, 2020 8:41:40 AM]   Link   Report threatening or abusive post: please login first  Go to top 
ShyanJMC
Cruncher
Joined: Jan 29, 2020
Post Count: 2
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

The most heavy project at system requeriments is ARP. Taking in consideration this, with a RP4 in 8gb version the most consume would be 5gb or 6gb, so I don't think that the required memory should be a problem.
[Dec 23, 2020 3:05:01 PM]   Link   Report threatening or abusive post: please login first  Go to top 
alanb1951
Veteran Cruncher
Joined: Jan 20, 2006
Post Count: 977
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

Yves (KerSamson) has it right, I think. On Intel/AMD systems, only MCM1 and SCC1 make minimal references to L3 cache (and I mean references, not misses)). I've done lots of throughput monitoring of WCG tasks on Linux systems so this is based on data, not guesswork. All others hit on L3 cache quite a lot; whether that means more misses or not isn't actually that relevant to this matter...

A basic ARM-based system such as a Pi4 doesn't have any L3 cache, so any L2 misses go straight to RAM! (Obviously, write activities will tend to go straight to RAM regardless, but a lot of the L2 misses are probably read activities looking at "database" information.) So any application that seems to reach out to L3 cache a lot will probably have a much higher memory access overhead than an L3-friendly program!

If I run my normal workload of three tasks at once on my Pi4 (at 2GHz!) they tend to take between 6.5 and 7 hours (depending on job complexity); when I had some MCM1 beta tasks on the Pi (with VMethod=LOO, which makes a difference to run-time) they were taking about 4.5 hours. Now, that's significant, because on my other systems OPN1 tasks tend to take about as long as MCM1 tasks with VMethod=LOO!

(And if I only run one task at a time on the Pi4, they take well under 6 hours each, and that is down to there being less memory contention! I didn't get a chance to time a single MCM1 beta task; they'd all run before I even realized I'd had any!)

So it would appear that a Pi4 will make a better fist of running MCM1 (and by implication, SCC1) than any of the other task types. We already know that the likelihood of a rebuild of HST1 is remote (discussed elsewhere in the context of Linux C library issues with vsyscall), FAH2 is effectively finished, ARP1 would probably be a non-starter because of the required memory (even if cache wasn't a problem), and given how quickly MIP1 can make a system with an L3 cache appear memory-bound, I suspect it would effectively induce torpor in a Pi4, so probably not a good idea either.

We've already had MCM1 betas for Linux on ARM, so can hope that if/when that version is let loose we'll get to see the ARM build; let's hope that if/when they Beta test for the next type of SCC1 data they can do a Linux ARM build for that too!

Cheers - Al.

P.S. native-mode ARM applications for Apple M1 are a different matter - that will have to be addressed at some point, and the memory and cache issues shouldn't be so critical there.

[Edited to fix a word-choice...]
----------------------------------------
[Edit 1 times, last edit by alanb1951 at Dec 24, 2020 12:14:39 AM]
[Dec 24, 2020 12:10:44 AM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1673
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

Hi alanb1951,
you did perfectly reflect and explain my short message.
When I mentioned memory requirements, it was not only focused on the WU size but on the use of cache as well.
MIP1 is probably the worst in terms of memory management.
ARP1 and HSTB are demanding at first because of the WU size.
Cheers,
Yves
----------------------------------------
[Dec 24, 2020 8:34:46 AM]   Link   Report threatening or abusive post: please login first  Go to top 
agequodagis
Cruncher
France
Joined: Oct 29, 2020
Post Count: 3
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

Hi all,
I totally agree with the initial post of this thread. Raspi 4 are so power efficient and money saving platforms. I have two of them running 24/7 at home. It's so sad to see only 1 project running...
I really hope they should crunch on more projects in the future.
Regards
[Jan 7, 2021 9:17:21 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Martin Schnellinger
Advanced Cruncher
Joined: Apr 29, 2007
Post Count: 123
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

Hello,
I tried to get a Raspberry PI running sometime ago, but failed

If someone could make a real good Video that shows,

1. exactly which electonic parts are necessary to make a Raspberry complete to run BOINC
2. where to get the necessary BIOS
3. which type of operating system, which edition of Linux is best for BOINC
4. how to install exactly this Linux on Raspberry

in other words: A complete instruction on the topic "BOINC on Rasberry" I and maybe many others might give one more try, as Rasberry ideed is inexpensive

Best greetings
MS
[Jan 8, 2021 7:54:40 PM]   Link   Report threatening or abusive post: please login first  Go to top 
KerSamson
Master Cruncher
Switzerland
Joined: Jan 29, 2007
Post Count: 1673
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

Hi Martin,
it is as easy to install boinc on an RPi as on other Linux-based systems.
I recommend to install the original Raspios version on the SD card:

Currently Raspios is still 32 bit but it does not impact WCG projects negatively even on RPi4.
As soon as Raspios is installed, you shall do following:
  • Full Raspios update
    sudo apt-get update
    sudo apt-get upgrade
    sudo apt-get update
    sudo apt-get full-upgrade
    sudo reboot
  • Firmware update
    sudo rpi-update
    sudo reboot
    Repeat #1 followed by #3
  • Install boinc as usual:
    sudo apt-get install boinc
  • Followed by the traditional boinc configuration and project attachment and concluded with:
    sudo reboot

On my side, I use an ssh session (CLI) for administering the RPi and I use BoincTasks for managing boinc.
If you plan to use directly ssh (headless system), you shall put an empty file named ssh (without extension) in the boot partition prior the first boot:
cd /Volumes/boot
touch ssh
Otherwise it is possible to enable ssh using the configuration tool from the system console:
sudo raspi-config

Recommendation
  • Per default the swapfile (swap space) is 100 MB large. On a RPI3, it is too small if you plan to crunch more than 2 WUs simultaneously. I would recommend you to increase the swapfile size from 100 MB to, at least, 256 MB.
  • You can as well install RPi-Monitor on the RPi for remotely monitoring the RPi's health (see below). It is a web-based application allowing you to see CPU temperature, CPU load, memory usage, ...

RPi-Monitor installation
  • Install RPi-Monitor‘s public key to trust RPi-Monitor repository:
    sudo apt-get install dirmngr
    sudo apt-key adv --recv-keys --keyserver keyserver.ubuntu.com 2C0D3C0F

  • Execute the following command to add RPi-Monitor into your list of repository:
    sudo wget http://goo.gl/vewCLL -O /etc/apt/sources.list.d/rpimonitor.list

  • To install RPi-Monitor, execute the following command:

    sudo apt-get update
    sudo apt-get install rpimonitor

You can reach RPi-Monitor over port 8888:
http://hostname:8888

  • After the installation of RPi-Monitor, you shall execute:
    sudo /etc/init.d/rpimonitor update to update this data.
  • And you can add or remove automatic update of this data, execute
    sudo /etc/init.d/rpimonitor install_auto_package_status_update
    or
    sudo /etc/init.d/rpimonitor remove_auto_package_status_update

Hopefully my explanation is sufficiently clear thinking if not, feel free to ask again (Fragen kostet nichts wink ).
Good luck,
Yves
----------------------------------------
----------------------------------------
[Edit 2 times, last edit by KerSamson at Jan 9, 2021 7:13:28 PM]
[Jan 9, 2021 7:05:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Martin Schnellinger
Advanced Cruncher
Joined: Apr 29, 2007
Post Count: 123
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: Please, compile all work units with support for Linux ARM.

Dear Yves,
unfortunately, I will not have the possibility to invest time in Rasperry right now.
But I really appreciate your answer. It might help others.
Thank you once again, have a fairly good time, even in these weird pandemic condtions.
Cordiallly Herzliche Grüße
Martin
[Jan 10, 2021 9:31:37 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread