Official implementation of paper "ACON: Optimizing Context Compression for Long-horizon LLM Agents"

Code accompanying the LMI paper

Entropy estimation via normalizing flow

The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source LLMs.

This repository contains the code for "Your copula is a classifier in disguise: classification-based copula density estimation" accepted at AISTATS 25.

Gaussian copula

A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

Simple RL training for reasoning

📰 Must-read papers and blogs on Speculative Decoding ⚡️

Neural Mutual Information Estimate --- PyTorch

Diffeomorphic Information Neural Estimation (DINE) - AAAI 2023

The official repo of continuous speculative decoding

Neural Joint Entropy Estimiator, based on corss-entropy loss

Gaussian mixture models in PyTorch.

Official pytorch implement of paper InfoNet: Neural Estimation of Mutual Information without Test-Time Optimization

Official implementation of MINDE: Mutual Information Neural Diffusion Estimation

The implementation codes of the paper "A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets"

Package for information-theoretic data analysis

Mutual information estimators and benchmarks

Mutual Information Neural Estimation in Pytorch

Benchmarking MIAs against LLMs.