Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Cluster Spanning OS Building
View unanswered posts
View posts from last 24 hours

Reply to topic    Gentoo Forums Forum Index Installing Gentoo
View previous topic :: View next topic  
Author Message

Joined: 06 Nov 2018
Posts: 1

PostPosted: Tue Nov 06, 2018 10:07 am    Post subject: Cluster Spanning OS Building Reply with quote

I know I'm grasping at straws but in all my years working with Linux from the early Slackware days on I came to love and trust Gentoo for innovation and speed due to compiling on the machines in question.

Here's what I'm looking for, I have a 10 node cluster raspberry 3 b+, what I am hoping for is a custom gentoo build that can be initiated on a master node that then would reach out to the sub nodes on the cluster, it would re-image the whole cluster with a shared spanned kernel architecture which in turn would finally allow identical raspberry pi nodes to share resources and processing power between all other nodes on the build as if they were one only limitation is the internal cluster network for speed.

I know something like this is possible and maybe even could allow modular plug and play of more or less nodes. I know it would have to be done in a compile for the devices setup so Gentoo is the most logical place to seek this kind of thing.

Any thoughts or ideas? I know people love saying you cannot make more than one computer into One computer, but I know that is just a limit on perspective, which is down to the OS fully, if the OS is built to allow for node spanning kernel operations then there is no reason why a linux OS could not be built to expand over nodes in this way making a more and more powerful computer based on its nodes and network setup.

If nothing like this has been attempted by Gentoo I would love as a system admin/senior engineer (not a coder) to see what you all could do with this idea...... :)


Back to top
View user's profile Send private message

Joined: 05 Jul 2003
Posts: 45794
Location: 56N 3W

PostPosted: Tue Nov 06, 2018 10:56 am    Post subject: Reply with quote


Welcome to Gentoo.

There are lots of clusters out there and the techniques can be applied to any arch, including the Raspberry Pi.
I'm aware of a 64 node Pi 1 cluster that was used for teaching supercomputing, not long after the Pi 1 was released.

The down side is that not all problems lend themselves to parallel processing, so they can't be split across several CPU cores, never mind nodes in a cluster.

What you want can be done in Gentoo. Other distros already do it. Nobody can change the class of problems that don't suit parallel processing, so it won't work quite the way you would like.


Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Installing Gentoo All times are GMT
Page 1 of 1

Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum