LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Fast and memory-efficient exact attention

A Next-Generation Training Engine Built for Ultra-Large MoE Models

DeepEP: an efficient expert-parallel communication library

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Dataset format for AI. Build, manage, & visualize datasets for deep learning. Stream data real-time to PyTorch/TensorFlow & version-control it. https://activeloop.ai

Computation using data flow graphs for scalable machine learning

⚛️ React.js components for Jupyter.

Use a text editor. Make a PDF.

Python clone of Spark, a MapReduce alike framework in Python

Tensorflow in Docker on Mesos #tfmesos

Topic Modelling for Humans

A pure python implementation of Mesos scheduler and executor

A third-party client for the Clickhouse DBMS server.

Poincaré Embedding

MessagePack serializer implementation for Python msgpack.org[Python]

Mirror of Apache Mesos

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Flink and DataFlow

A common bricks library for building scalable and portable distributed machine learning.

Distributed training framework with parameter server

Fast and light-weight memcached client for C++ / #python / #golang #libmc

Make blocking C library work with gevent

Demo project for building Python wheels for Linux with Travis-CI

Distributed FM and LR based on PS with Ftrl

A tutorial repository for Strata Beijing 2016. It contains setup instructions and exercises