Open Source Linux Neural Network Libraries

Implementation of Imagen, Google's Text-to-Image Neural Network that beats DALL-E2, in Pytorch. It is the new SOTA for text-to-image synthesis. Architecturally, it is actually much simpler than DALL-E2. It consists of a cascading DDPM conditioned on text embeddings from a large pre-trained T5 model (attention network). It also contains dynamic clipping for improved classifier-free guidance, noise level conditioning, and a memory-efficient unit design. It appears neither CLIP nor prior network is needed after all. And so research continues. For simpler training, you can directly supply text strings instead of precomputing text encodings. (Although for scaling purposes, you will definitely want to precompute the textual embeddings + mask)

PyG (PyTorch Geometric) is a library built upon PyTorch to easily write and train Graph Neural Networks (GNNs) for a wide range of applications related to structured data. It consists of various methods for deep learning on graphs and other irregular structures, also known as geometric deep learning, from a variety of published papers. In addition, it consists of easy-to-use mini-batch loaders for operating on many small and single giant graphs, multi GPU-support, DataPipe support, distributed graph learning via Quiver, a large number of common benchmark datasets (based on simple interfaces to create your own), the GraphGym experiment manager, and helpful transforms, both for learning on arbitrary graphs as well as on 3D meshes or point clouds. All it takes is 10-20 lines of code to get started with training a GNN model (see the next section for a quick tour).

Cluster Networks are a new style of neural simulation / neural network modeling, that models networks of neural populations ("clusters") that transform and transmit information using precisely-timed, graded bursts ("pulses" or "volleys") of firing.

NeMo is a high-performance spiking neural network simulator which simulates networks of Izhikevich neurons on CUDA-enabled GPUs. NeMo is a C++ class library, with additional interfaces for pure C, Python, and Matlab.

RooCARDS is a set of C++ classes written for the ROOT analysis framework which interface ROOT to the Stuttgart Neural Network Simulator (SNNS). This interface is based on a concept originally developed by Professor Yibin Pan at the UW-Madison.

Neural Network calculation & learning library

Zeus is a small, lightweight, very fast object oriented framework for developing neural networks with an integrated shell interface.

GPU accelerated Neural networks in JavaScript for Browsers and Node.js. brain.js is a GPU accelerated library for Neural Networks written in JavaScript. Brain.js depends on a native module headless-go for GPU support. In most cases installing brain.js from npm should just work. However, if you run into problems, this means prebuilt binaries are not able to download from GitHub repositories and you might need to build it yourself. Brain.js is super simple to use. You do not need to know Neural Networks in detail to work with this. Brain.js performs computations using GPU and gracefully fallback to pure JavaScript when GPU is not available. Brain.js provides multiple neural network implementations as different neural nets can be trained to do different things well. Easily export and import trained models using JSON format or as a function. Host pre-trained models on your website easily.

A parallel-programming framework for concurrently running large numbers of small autonomous jobs, or microthreads, across multiple cores in a CPU or CPUs in a cluster. NeuraNEP emulates a distributed processing environment capable of handling millions of microthreads in parallel, for example running neural networks with millions of spiking cells. Microthreads are general processing elements that can also represent non-neural elements, such as cell populations, extracellular space, emulating sensory activity, etc. NeuraNEP handles microthread scheduling, synchronization, distribution and communication. This project is a fork of SpikeOS (sourceforge.net/projects/spikeos) and represents a major update to that code base, including a scripting interface and low-level rewrite of several components. SpikeOS was oriented towards computational modeling. NeuraNEP is oriented toward neural network research.