Open Source Distributed Computing Software

Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations failed. The Zipkin UI also presents a Dependency diagram showing how many traced requests went through each application. This can be helpful for identifying aggregate behavior including error paths or calls to deprecated services. Applications need to be “instrumented” to report trace data to Zipkin.

SocketTest - powerful and small software tool for socket testing. It can create both TCP and UDP client or server. It can be used to test any server or client that uses TCP or UDP protocol to communicate.

Datahike is a durable Datalog database powered by an efficient Datalog query engine. This project started as a port of DataScript to the hitchhiker-tree. All DataScript tests are passing, but we are still working on the internals. Having said this we consider Datahike usable for medium sized projects, since DataScript is very mature and deployed in many applications and the hitchhiker-tree implementation is heavily tested through generative testing. We are building on the two projects and the storage backends for the hitchhiker-tree through konserve. We would like to hear experience reports and are happy if you join us. We provide a small stable API for the JVM at the moment, but the on-disk schema is not fixed yet. We will provide a migration guide until we have reached a stable on-disk schema. Take a look at the ChangeLog before upgrading.

JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.

Joone is a neural net framework written in Java(tm). It's composed by a core engine, a GUI editor and a distributed training environment and can be extended by writing new modules to implement new algorithms or architectures starting from base component

A Java middleware API supporting broker-less, type+topic-based publish/subscribe and request/reply messaging for both intra- and inter-application, object-level communication. Broker-less: messages are transmitted directly between eBus applications. There is no message broker (i.e. server) in between. Type+topic addressing: eBus clients subscribe to a message class (type) and message topic, providing stronger typing than just topic-based subscriptions. Object-level communication: eBus delivers messages directly to client objects, not to a client process.

MX4J is an Open Source implementation of the Java Management Extensions technology, for both JSR 3 (JMX) and JSR 160 (JMX Remote API).

OSE is a C++ library, with some Python wrappers, containing generic classes, as well as support for event driven systems, interprocess communications and a request/reply, publish/subscribe service agent framework with RPC over HTTP interface.

MARF is a general cross-platform framework with a collection of algorithms for audio (voice, speech, and sound) and natural language text analysis and recognition along with sample applications (identification, NLP, etc.) of its use, implemented in Java.

RedDwarf is a horizontally scalable application server for low latency apps such as online games, virtual worlds, and social networking applications. It is the official community fork for Project Darkstar, previously sponsored by Sun Microsystems.

The TclSOAP package provides a mechanism to bind Tcl command procedures to remote procedure calls using the Simple Object Access Protocol (SOAP) and XML-RPC over HTTP. Both client and server code is provided.

Fully integrated framework for building and deploying service-based networks (SOA / Microservices). Communication includes XML-RPC, REST and Web Services. Other features include service protection, admin scripts, metadata, query processes, autonomous, agent-based, or self-organising. Special to the system are its AI and text-processing features. In particular, there is an Autonomic Manager framework with a BPEL-style execution script. Sub-packages include text or query processing and a problem solver provides a range of algorithms. These can also be used separately, but advanced programming and configuration is required. A free All-in-One GUI allows you to manage services and function, and add your own modules. Example Apps are included and the images illustrate the functionality. The open source p2p server requires only the HTTP address and optional passwords. Small jar file sizes and mobile compatible.

A modern secure, robust, multithreaded, exception aware, internationalisable, portable GUI toolkit library designed for mission-critical work in C++ and Python forked from the FOX library. Replicates the Qt API in many places.

VJDBC (Virtual JDBC) is a JDBC type 3 driver which provides efficient tunneling of JDBC commands/results over different communication protocols (RMI, HTTP, HTTPS ...).

IIOP.NET allows a seamless interoperation between .NET, CORBA and J2EE distributed objects. This is done by incorporating CORBA/IIOP support into .NET, leveraging the remoting framework.

ASK:Webapps front-end Application Server, offers a Java Server Component Model, Clustering & Applications Fault-Tolerance Execution. SHORB:Simple Object Request Broker over HTTP. DBPCS: ddbb Connections Pool, supports Business DB Objects Pooling

FRODO is a Java platform to solve Distributed Constraint Satisfaction Problems (DisCSPs) and Optimization Problems (DCOPs). It provides implementations for a variety of algorithms, including DPOP (and its variants), ADOPT, SynchBB, DSA...

Atomatrix is a multithreaded execution system of atomic matrices with a dynamic compiler and a network eviron. It is the next generation object-orientated environment. XML, MUD-OO CLI, GnucDNA support, windows and many subprojects are built-in.

FpgaC compiles a subset of the C language to net lists which can be imported into an FPGA vendors tool chains. C provides an excellent alternative to VHDL/Verilog for algorithmic expression of FPGA reconfigurable computing tasks. More info in wiki.

The purpose of the project is to develop a portable programming framework that facilitates distributed and multi-threaded programming for C++, Java, and Python. MADARA was originally developed as an agent-based middleware specifically for real-time, distributed artificial intelligence, but is now more general purpose for distributed timing, control, knowledge and reasoning, and quality-of-service. MADARA is composed of several tools and middleware, and the main entry point into the system is the Knowledge and Reasoning Language (KaRL) Engine, which provides a real-time scripting language for nanosecond execution times hooked into a flexible transport layer for distributed reasoning. The KaRL engine also supports object-oriented C++, Java, and Python programming through Containers, classes that provide abstractions and references for variable location within the KaRL Knowledge Base. This project is currently in process of being ported from http://madara.googlecode.com.

The Systems Biology Workbench(SBW) is a framework for application intercommunications. It uses a broker-based, distributed, message-passing architecture, supports many languages including Java, C++, Perl & Python, and runs under Linux,OSX & Win32. It comes with a large number of modules, encompassing the whole modeling cycle: creating computational models, simulating and analyzing them, visualizing the information, in order to improve the models. All using community standards, such as SED-ML, SBML and MIRIAM.

OpenHMS brands a collection of projects and many subprojects developed by Health Market Science. This is a robust collection of development libraries, APIs, and tools oriented around data manipulation and professional software development.

Tpl makes it easy to serialize your C data using just a handful of API functions. The data is stored in its native binary form for maximum efficiency. C, Perl and XML supported. Data is portable across CPU types and OS's from Unix to Mac to Windows.

J2eeBuilder automates JSP<->POJO<->EJB service calls via Comonent Definitions(XML). It includes utilities for merging (ejb-jar.xml) & packaging component/ear. It is certified as J2EE-Compatible by Sun Microsystems and is the kernel of Ohioedge CRM Se

The Simple, Scalable, Script-based Science Processor for Measurements (S4PM) is a system for highly automated processing of science data, scalable up to large processing systems and scalable down to small, special-purpose processing strings.