Train transformer language models with reinforcement learning.

TuShare is a utility for crawling historical data of China stocks

StarCraft II Client - protocol definitions used to communicate with StarCraft II.

This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.

Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning

Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.

Python Dynamic Mode Decomposition

Guided Policy Search

Aerial Gym Simulator - Isaac Gym Simulator for Aerial Robots

Awesome papers for markerless animal motion capture and 3D reconstruction.

Differentiable MPM Simulator

[SIGGRAPH Asia 2025] Motion2Motion official codes

Implementation of the Gaussian Process Autoregressive Regression Model

Interactive surface flow toy implemented in Taichi

These are the codes I used in my youtube videos

Steering-based control of a two-wheeled vehicle using RL-PPO and NVIDIA Isaac Gym.

I used this paper as inspiration https://arxiv.org/pdf/1904.03367.pdf

Multi-layered multi-pattern CPG for adaptive locomotion of humanoid robots

Demo for the Maki robot for use with a tablet and speakers. No IRB protected data is stored in this project.

StarCraft II Learning Environment

Minimalistic gridworld environment for OpenAI Gym

Additional supporting files for maki_demo and running Maki that are not included in maki_demo.

Character Animation Diffusion with Any Topology

Python clone of agar.io game, made with pygame.