Open Source Linux Clustering Software

Tools for the Linux Kernel's network block device, allowing you to use remote block devices over a TCP/IP network. Note that we have moved to github: https://github.com/NetworkBlockDevice/nbd

DRBL provides diskless or systemless environment. It uses distributed hardware resources and makes it possible for clients to fully access local hardware. It also includes Clonezilla, a partition and disk cloning utility similar to Ghost.

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.

openQRM is a web-based open source datacenter management and hybrid cloud computing platform that integrates flexibly with existing components in enterprise data centers. Releases available at https://github.com/openQRM/openqrm-community. Please visit http://www.openqrm-enterprise.com for latest 5.3 free Community Release. Includes important security updates, bugfixes and enhancements especially for KVM and Cloud plugin. openQRM abstracts Virtualization and supports the following virtualization technologies: KVM, XEN, Citrix XenServer, VMWare ESX & LXC. The Hybrid Cloud Connector in openQRM supports a range of private or public cloud providers to extend your infrastructure on demand via Amazon AWS, Eucalyptus or OpenStack. openQRM automates provisioning, virtualization, storage and configuration management, and it takes care of high-availability.

A distributed, peer-to-peer, server-less communication & messaging solution for JAVA (JMS), C++ and .NET applications, integrates with JBoss, WebLogic & WebSphere. Offers guaranteed delivery, security and transactions. Supports TCP, SSL & HTTP protocols.

openMosix is a Linux kernel extension for single-system image clustering. Taking n PC boxes, openMosix gives users and applications the illusion of one single computer with n CPUs. openMosix is perfectly scalable and adaptive.

Based on the source code of Sun Grid Engine, we are continuing the open source development effort here on sourceforge.

An extensible framework for distributed computing on P2P grids. We support peaceful free and open research and build an internet supercomputer. We render movies, solve Eternity puzzles, predict climate and improve a ~30 GHz cluster of clients.

Distributed session caching tools and APIs, primarily for SSL/TLS servers though perhaps useful for other (non-SSL/TLS) circumstances. Also includes a self-contained network abstraction library (libnal), and the sslswamp SSL/TLS benchmark/test utility.

XDAQ is a software platform designed specifically for the development of distributed data acquisition systems. The development is carried out at CERN, the European Organization for Nuclear Research. Please visit http://xdaq.web.cern.ch

A Console-based BitTorrent Client with built-in scheduler for handling multiple sessions. It is designed to manage sessions in queue easily without heavy-weight GUI. External module can search for new torrents in trackers and submit it automatically.

The OpenSSI project is a comprehensive clustering solution offering a full, highly available SSI environment for Linux. Goals for OpenSSI Clusters include availability, scalability and manageability, built from standard servers.

MLN (Manage Large Networks) is a perl program used to manage a set of User-Mode-Linux instances or Xen instances. From a configuration file, it is possible to specify a large complex network of e.g. Xen instances, which are each configured as specified.

The Herdtools are a set of user-level cluster management and control utilities with a consistent command line interface. These include things like parallel file copy, remote execution, sudo execution, job kill, etc. We utilize Rob Brown's "procstatd" d

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

Son of Grid Engine is a community continuation of the old Sun Grid Engine project. It aims to be a big superset of available free gridengine code and patches. The main site is currently https://arc.liv.ac.uk/trac/SGE/ and https://arc.liv.ac.uk/SGE/ but release files are inaccessible there and being hosted here.

Python framework for concurrent, asynchronous, distributed communicating tasks for broad range of use cases, including public / private / hybrid cloud computing, fog / edge computing.

RT-BOINC stands for a Real-Time BOINC. It was designed for managing highly-interactive, short-term, and massively-parallel real-time applications. We implemented RT-BOINC on top of the recent BOINC server source codes.

rshd is a multithreaded daemon service that listens for connections on port 514 (tcp port for the shell/cmd protocol), runs commands passed by clients and sends back the results.

ClusterIt is a collection of clustering tools to allow simple administration of groups of UNIX machines. It can also be used to facilitate parallel shell scripting, and compiling.

PlumpOS is an openMosix-node-on-a-cdrom. It was originally based off ClumpOS and continues to try to be an easy/small/powerful way of implementing openMosix nodes.

BSPonMPI is an implementation of the BSPlib standard on top of MPI. Both MPI and BSPlib are API's of communication routines meant for parallel computing, but BSPlib is easier to learn and its performance easier to predict.

Postgres-XL is a PostgreSQL-based scale-out cluster that handles both OLTP write intensive workloads as well as OLAP/BI type of workloads thanks to MPP parallelism. Postgres-XL is fully ACID and supports cluster-wide Multi-version Concurrency Control (MVCC) for global consistency and performance. There are commercial companies such as 2ndQuadrant, who provide support and consulting around Postgres-XL. Please visit http://2ndquadrant.com/en/resources/postgres-xl/ for more details.

Reliable group communication based on IP multicast and configurable protocol stack