Search:  
Gentoo Wiki

HOWTO_Configure_Gentoo_Linux_for_Clustering

This article is still a Stub. You can help Gentoo-Wiki by expanding it.

Note: This is a work in progress, feel free to add your comments/suggestions!

The official Gentoo guide for building a Gentoo based clustering computer can be found here:

http://www.gentoo.org/doc/en/hpc-howto.xml

However it is incomplete, has been for some time, and is probably not the best organized tutorial you expect to see.

--Hanni ali 09:58, 11 April 2006 (GMT)

Contents

Hardware Selection and Configuration

Node Hardware

The ideal is to have identical machines for each node. However, it is possible to build a cluster with a heterogeneous mixture of machines. Ideally, the architectures should be similar though; for example, a mixture of x86 and x86_64 machines. Administration can be more difficult with a mixture of architectures, but jobs run on the cluster can be directed to a subset of machines with the appropriate architecture.

Network Hardware

A comprehensive discussion of hardware selection could go here with comparison of different networking technologies. GIgabit, Myriad, Infiniband etc. and peoples experiences with said hardware and recommended configurations or applications.


Configuring a Gentoo Install for HPC

Here we put the complete howto for configuration. Always say WHY you recommend something and if there is an alternative and you understand it put why that may be a good idea to use.

Most of this section can come from: The official Gentoo guide for building a Gentoo based clustering computer can be found here:

http://www.gentoo.org/doc/en/hpc-howto.xml

but I suggest we incorporate:

http://www.gentoo.org/doc/en/diskless-howto.xml

directly into the howto as well in a simillar way the Gentoo Installation handbook does i.e. (This is for diskless skip if using disk...).

Utilities for High Performance Computing

Discussion and instruction for installing and configuring things like MPI PVM LAM

Utilities for High Availability Computing

Discussion and instruction for installing and configuring things like redundancy heartbeat, drbd and drbdlinks.


This is the person who started this page, but their wish was more aimed at parallel programming I think we start with installing and configuring the cluster then work on other features.


In the meantime, this link points to a wiki which I use as a "sandbox" for writing up such a document. One of the more interesting aspect is the use of a Gentoo SSI for the nodes. --Kyron 14:05, 10 February 2006 (GMT)

Tentative suggestions (discussed in the discussions link at the top of this page -Kyron):

1. Explain the existing API's for high performance computing, such as OpenMP (for shared memory machines) and MPI (mainly for passing messages over network to machines with their own memory), their pros and cons.

2. Some introduction of hardware selection.

3. Essential software packages for building such a cluster.

4. How to compile and run parallelized programs.


Retrieved from "http://www.gentoo-wiki.info/HOWTO_Configure_Gentoo_Linux_for_Clustering"

Last modified: Fri, 05 Sep 2008 21:10:00 +0000 Hits: 18,885