Open Source Distributed Computing Software

SocketTest - powerful and small software tool for socket testing. It can create both TCP and UDP client or server. It can be used to test any server or client that uses TCP or UDP protocol to communicate.

Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations failed. The Zipkin UI also presents a Dependency diagram showing how many traced requests went through each application. This can be helpful for identifying aggregate behavior including error paths or calls to deprecated services. Applications need to be “instrumented” to report trace data to Zipkin.

Joone is a neural net framework written in Java(tm). It's composed by a core engine, a GUI editor and a distributed training environment and can be extended by writing new modules to implement new algorithms or architectures starting from base component

Datahike is a durable Datalog database powered by an efficient Datalog query engine. This project started as a port of DataScript to the hitchhiker-tree. All DataScript tests are passing, but we are still working on the internals. Having said this we consider Datahike usable for medium sized projects, since DataScript is very mature and deployed in many applications and the hitchhiker-tree implementation is heavily tested through generative testing. We are building on the two projects and the storage backends for the hitchhiker-tree through konserve. We would like to hear experience reports and are happy if you join us. We provide a small stable API for the JVM at the moment, but the on-disk schema is not fixed yet. We will provide a migration guide until we have reached a stable on-disk schema. Take a look at the ChangeLog before upgrading.

An extensible framework for distributed computing on P2P grids. We support peaceful free and open research and build an internet supercomputer. We render movies, solve Eternity puzzles, predict climate and improve a ~30 GHz cluster of clients.

A Java middleware API supporting broker-less, type+topic-based publish/subscribe and request/reply messaging for both intra- and inter-application, object-level communication. Broker-less: messages are transmitted directly between eBus applications. There is no message broker (i.e. server) in between. Type+topic addressing: eBus clients subscribe to a message class (type) and message topic, providing stronger typing than just topic-based subscriptions. Object-level communication: eBus delivers messages directly to client objects, not to a client process.

CloudI is an open-source private cloud computing framework for efficient, secure, and internal data processing. CloudI provides scaling for previously unscalable source code with efficient fault-tolerant execution of ATS, C/C++, Erlang/Elixir, Go, Haskell, Java, JavaScript/node.js, OCaml, Perl, PHP, Python, Ruby, or Rust services. The bare essentials for efficient fault-tolerant processing on a cloud!

JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.

MX4J is an Open Source implementation of the Java Management Extensions technology, for both JSR 3 (JMX) and JSR 160 (JMX Remote API).

A general purpose implementation of the xmlrpc specification in C.

Project continued at github, see https://github.com/wolfc01/procexp/blob/master/README.md Graphical process explorer for Linux. Shows process information: process tree, TCP IP connections and graphical performance figures for processes. Aims to mimic Windows procexp from sysinternals, and aims to be more usable than top and ps, especially for advanced users. Audience for this tool: * Advanced system administrators trying to analyze on process level what is going on in a production server; * Software developers analyzing the troughput of their process: e.g. TCP throughput, memory usage, memory leaks; The most advanced feature is the monitoring of TCP/IP traffic figures, for each SINGLE process (actual connections and throughput). As far as known no other tool has this capability. In the process tree, use the right mouse button to monitor process details.

Distributed, object-oriented and event-driven LabVIEW based Control System Framework with some SCADA functionality. Documentation about the CS framework is provided via a dedicated web page, http://wiki.gsi.de/cgi-bin/view/CSframework/WebHome . Please note: This project is deprecated an no longer actively maintained. Please follow the link above for more information.

MARIE is a robotic development and integration environment focused on software reusability and exploitation of already available APIs and middlewares used in robotics. Its main purpose is to create a rapid-prototyping approach to robotics developments.

The TclSOAP package provides a mechanism to bind Tcl command procedures to remote procedure calls using the Simple Object Access Protocol (SOAP) and XML-RPC over HTTP. Both client and server code is provided.

MARF is a general cross-platform framework with a collection of algorithms for audio (voice, speech, and sound) and natural language text analysis and recognition along with sample applications (identification, NLP, etc.) of its use, implemented in Java.

The purpose of the project is to develop a portable programming framework that facilitates distributed and multi-threaded programming for C++, Java, and Python. MADARA was originally developed as an agent-based middleware specifically for real-time, distributed artificial intelligence, but is now more general purpose for distributed timing, control, knowledge and reasoning, and quality-of-service. MADARA is composed of several tools and middleware, and the main entry point into the system is the Knowledge and Reasoning Language (KaRL) Engine, which provides a real-time scripting language for nanosecond execution times hooked into a flexible transport layer for distributed reasoning. The KaRL engine also supports object-oriented C++, Java, and Python programming through Containers, classes that provide abstractions and references for variable location within the KaRL Knowledge Base. This project is currently in process of being ported from http://madara.googlecode.com.

The Systems Biology Workbench(SBW) is a framework for application intercommunications. It uses a broker-based, distributed, message-passing architecture, supports many languages including Java, C++, Perl & Python, and runs under Linux,OSX & Win32. It comes with a large number of modules, encompassing the whole modeling cycle: creating computational models, simulating and analyzing them, visualizing the information, in order to improve the models. All using community standards, such as SED-ML, SBML and MIRIAM.

DMUCS works with distcc to allow multiple users to share a gcc compilation farm, while guaranteeing that each compilation will be assigned to the highest-performing, available cpu in the compilation farm.

IIOP.NET allows a seamless interoperation between .NET, CORBA and J2EE distributed objects. This is done by incorporating CORBA/IIOP support into .NET, leveraging the remoting framework.

QuickServer is an open source Java library/framework for quick creation of robust and multi-threaded, multi-client TCP server applications. With QuickServer one can just concentrate on just the application logic/protocol on hand.

The first 3D game engine built in C# for .NET, predecessor to the Visual3D Game Engine (https://www.poweraccess.net/visual3d-game-engine), an All-in-One Game Development Tool for Next-Gen 3D Games, MMOs, Simulations and Virtual Worlds powered by Microsoft XNA.

abiquo platform allows to create intelligent distributed networks interconnecting all kind of devices. We ease the interaction between gadgets, users and organizations through empowering technologies which add intelligence to actual networks.

FRODO is a Java platform to solve Distributed Constraint Satisfaction Problems (DisCSPs) and Optimization Problems (DCOPs). It provides implementations for a variety of algorithms, including DPOP (and its variants), ADOPT, SynchBB, DSA...

XmlRpc++ is an implementation of the XmlRpc protocol written in C++, based upon Shilad Sen's excellent py-xmlrpc library. It is designed to make it easy to incorporate XmlRpc client+server support into C++ applications and requires no other libraries.

CArtAgO is a framework for programming and executing virtual environments in multi-agent programs.