Open Source Linux Distributed Computing Software

Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations failed. The Zipkin UI also presents a Dependency diagram showing how many traced requests went through each application. This can be helpful for identifying aggregate behavior including error paths or calls to deprecated services. Applications need to be “instrumented” to report trace data to Zipkin.

SECTOR: A Distributed Data Storage and Processing Platform

Karma tool is a standalone tool that can be added to existing cyberinfrastructure for purposes of collection and representation of provenance data. Karma utilizes a modular architecture that permits support for multiple instrumentation plugins that make it usable in different architectural settings.

Tsync is a user-level daemon that provides transparent synchronization amongst a set of computers. Tsync uses a peer-to-peer architecture for scalability, efficiency, and robustness.

Secure Storage service is a set of tools to store in a secure way and in an encrypted format confidential data on the grid storage elements. The service has been designed for the grid Middleware of the EGEE infrastructure, gLite.

OceanStore is an architecture for a global-scale file system which uses erasure coding, cryptography, and Byzantine agreement to provide available, highly durable storage in a peer-to-peer environment.

WSNFuse provides an abstraction layer for wireless sensor networks, allowing to expose one or many WSNs by means of different access technologies(e.g.: filesystem, JMS, RMI, Smart-Spaces, etc.).Its plugin-based architecture allow users to develop and adopt thei own plugins and configure WSN fuse to better suit their needs. This project has been partially supported by the CHIRON EU research project co-financed by the artemis joint undertaking (http://www.chiron-project.eu/) .

Binary XML is java library. Major feature of library is document encoder/decoder which helps to store DOM model in binary format and retrive DOM model back. Encoded file size extremely small (in about 10 times relatively to original) .

DSL is a distributed storage leasing service based on JXTA project (http://www.jxta.org). It allows user to replicate/backup and later on retrieve files securely to other peers (on a lease basic). Basic versioning supported.

HADOS is a server software for storing files in a cluster of server. The goal is to handle high availability by storing copy of the same file on several nodes. HADOS provides RESTFUL APIs to easily store, check or retrieve files. Using the powerful cluster APIs you can retrieve the files whatever the node that hosts it. To avoid any single point of failure, it is possible to apply a request to any node of the cluster, there is no master node.

A MIDlet that, when run in PalmOS devices, can HotSync with the PC or a remote database

InfiniTUX - Two floppies rescue and multipurpose embedded LINUX distro - A big collection of console UNIX software to perform system rescue, repairs and backups - NIC and network services supports and an FTP special system to expand its functionalities

A community repository to develop Commodity Grid (CoG) Software for the access of Grids, through high level interfaces. The main repository is maintained at http://www.cogkit.org

Latis is a distributable storage engine for the semantic web. We plan to build a cross-platform, high-performance server that enables users to build private clouds which are protocol-compatible with popular web service offerings from Google & Amazon.

Multiple secure copy program (mscp/dscp) is a command-line tool for distributing files to multiple hosts at once.

An open source (Apache 2 license) file server software with a RESTFul web service for file management in a cluster of nodes. Including 4 set of API - Store API: Upload, download files and directories - Process API: Managing the long term process runs - Glacier API: Uploading from the server to Glacier - Cluster API: Manage the nodes in the cluster

A decentralized personal file system for disconnected mobile users.

p2p-fs is a Peer to Peer file system in user space, using FUSE. Allows you to share files over an LAN and/or WAN. Can be mounted as a normal file system under Linux.

RingFS is a network distributed file system which is fault tolerant and has no centralized meta-data store. It spreads data over network storage servers and provides single namespace. The design of RingFS aims to build a huge data storage with redundancy, linear performance increase with rock-solid stability.

SparrowStorage is a storage framework based on MySQL as Storage Node. The framework is stored the data over infinite disturbed Storage Node and suit for infinity storage room. By MySQL replication , it is able to provide fault tolerance storage service.

The Dataisland Framework is a ReST compliant content management and semantic web service framework.

Universal information crawler is a fast precise and reliable Internet crawler. Uicrawler is a program/automated script which browses the World Wide Web in a methodical, automated manner and creates the index of documents that it accesses.

VA ACS is an implementation of the OGF Application Contents Service Specification. Application Contents Service (ACS) is an OGSA service, which maintains Application Contents as an Application Archive (AA).

XSpace is a globally accessible repository for hierarchically-keyed information. It provides persistence for trees with an elegant tree-navigation API. XSpace also publishes real-time events whenever a persisted tree is updated.

jSCSI is a cross-platform Java implementation of an iSCSI initiator. jSCSI thus enables Java to directly access and serve block devices over the Internet by natively speaking the iSCSI protocol. The initiator supports software RAID. THIS PROJECT HAS MOVED TO GITHUB!!!