Open Source Python Distributed Computing Software for Linux

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

Infinispan is an open source, Java based data grid platform. ***IMPORTANT*** Starting with Infinispan 5.0.0.FINAL, Infinispan releases are no longer hosted in Sourceforge. They can now be located in www.jboss.org/infinispan/downloads

LinuxTuples is an open-source implementation of David Gelernter's idea of a tuple space, designed to run on a networked cluster of Linux machines.

RPyC, or Remote Python Call, is a transparent and symmetrical python library for remote procedure calls, clustering and distributed-computing.

ActiveGrid is an Enterprise Web 2.0 solution that allows the composition of code-free applications that comply with corporate IT standards. Technologies include Python, Java, XForm, Xpath, WSDL, CSS, XML Schema (XSD), XACML, and BPEL.

This is a system for scheduling the tasks in a heterogenous environment such as grid system .It will be a effective and extensible system.

Banshell is a tool to scriptably execute commands on a remote machine. It was designed with the goal of increasing security by only allowing a specified set of commands to be executed.

A Console-based BitTorrent Client with built-in scheduler for handling multiple sessions. It is designed to manage sessions in queue easily without heavy-weight GUI. External module can search for new torrents in trackers and submit it automatically.

Bluesfield: An experimental distributed computing platform for the support of grassroots movements.

Allows creation and manipulation of diskless Linux (and Unix) clients, using templated system configuration files to increase the flexability and compatability of this application.

java-based complete Agent (Artificial Intelligence) Framework with all the features you might expect in an Agent Framework: Mobility, Autonomy, Distributed communication, Agents can be written in Java, Jython, or Beanshell.

Freenomalism is a free, community based fork of the Enomalism web-based virtual infrastructure/cloud computing platform. The dashboard can help with issues including deployment planning, load balancing, migration, configuration management, and capacity.

GXP is a parallel/distributed shell, plus a parallel task execution engine that runs your Makefile in parallel on distributed machines. Very easy to install (no need to compile. install it on YOUR machine and use it on ALL machines).

Job Monarch is an addon to the Ganglia Monitoring System that provides batch job monitoring and archiving plus a graphical overview of clusters and assorted batch systems. Fully supported batch system: Torque, PBS and SLURM. Experimental: LSF, SGE

KestrelHPC is a software developed to make life easier to the people that want to have a Diskless Cluster. This Cluster is Multi-User and it has got many tools to configure your cluster. This software can be installed in a Debian or Ubuntu.

MPY is an MPI implementation for Python using MPICH (or any other MPI implementation). MPY also provides helper functions for ease of programming, and a simple plug-in interface.

Maui Scheduler is an advanced reservation HPC parallel batch scheduler for use with Linux and BSD clusters. Maui provides a complete scientific scheduling solution, supporting running custom parallel and MPI jobs over Myrinet and ethernet.

Momoko is a framework for developing distributed, multi-user, network-aware applications. It includes facilities for storing objects in a tree structure, a shell for manipulating the object database, orthogonal persistence, scripting support, and a trans

NetWorkSpaces, developed by Scientific Computing Associates Inc., provides a framework to coordinate programs written in Python, making it easier to write distributed applications.

PBS Cluster Viz is a project to display information useful to admins and users about a computing cluster managed by a PBS-compatible resource manager. Information includes load and job distribution. Interactive as well as static output is available.

Pluster is a cluster management software developed with python. It is easy to install and maintain. Pluster Provides cluster performance monitoring and remote OS installing. It's future will be an agent-based management system.

PuSSH is Pythonic, Ubiquitous SSH, a Python wrapper/script that runs commands in parallel on clusters/ranges of linux/unix machines via SSH, ideally where SSH is configured to use Kerberos, RSA/DSA keys, or ssh-agent as to avoid password authentication.

This package provides Python bindings to the OpenPBS C API. All functions of the OpenPBS C library can be accessed in Python through the use of this package. We provide extensive documentation on the usage and lots of examples.

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any moment if capacity drops or the bid price rises. It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. Originally it was developed as a different version for the Wall Lab at Harvard CBMI.