Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 23, 2024

• remove an unused import (#960)

  lancerts

  authored
  22339db

  Copy full SHA for 22339db

Commits on May 6, 2024

• Move packaging and ninja from install_requires to setup_requires (#937)

  Show description for 9c0e9ee
  weiji14

  authored
  9c0e9ee

  Copy full SHA for 9c0e9ee

Commits on Apr 26, 2024

• Bump to v2.5.8

  tridao

  committed
  9a11f44

  Copy full SHA for 9a11f44

• [CI] Compile for pytorch 2.2.2 and 2.3.0

  tridao

  committed
  35060e7

  Copy full SHA for 35060e7

• [CrossEntropy] Change ignored_index -> ignore_index

  tridao

  committed
  ec6d221

  Copy full SHA for ec6d221

Commits on Apr 8, 2024

• Bump to v2.5.7

  tridao

  committed
  85881f5

  Copy full SHA for 85881f5

• [CI] Compile with torch 2.3.0.dev20240207

  tridao

  committed
  2aea958

  Copy full SHA for 2aea958

• Use Cute's local_tile to get gQ, gK, gV

  tridao

  committed
  656daef

  Copy full SHA for 656daef

• Transpose out when swapping seqlen_q and num_groups

  tridao

  committed
  9eb3d09

  Copy full SHA for 9eb3d09

Commits on Apr 5, 2024

• Fix spurious re-compilations of `rotary_kernel` (#911)

  Show description for f692b98
  dfyz

  authored
  f692b98

  Copy full SHA for f692b98

Commits on Mar 28, 2024

• Add the option for the macro and note (#893)

  drisspg

  authored
  23e8fa5

  Copy full SHA for 23e8fa5

• Minor fix in compute_attn_1rowblock_splitkv (#900)

  beginlner

  authored
  3e9414f

  Copy full SHA for 3e9414f

Commits on Mar 19, 2024

• [LayerNorm] Update layer_norm_linear

  tridao

  committed
  36587c0

  Copy full SHA for 36587c0

Commits on Mar 15, 2024

• fix: cast the alibi slopes to torch.float32 (#846)

  Markus28

  authored
  6bbc532

  Copy full SHA for 6bbc532

• Add in, macrosf for defining __grid_constant__ (#852)

  drisspg

  authored
  4a73e90

  Copy full SHA for 4a73e90

• Enable paged attention in varlen forward (#831)

  Show description for 2a15840
  sgrigory

  authored
  2a15840

  Copy full SHA for 2a15840

Commits on Mar 14, 2024

• Support ARM builds (#757)

  arvindsun

  authored
  26c9e82

  Copy full SHA for 26c9e82

• Make nvcc threads configurable via environment variable (#885)

  chiragjn

  authored
  50896ec

  Copy full SHA for 50896ec

Commits on Mar 2, 2024

• Bump to v2.5.6

  tridao

  committed
  6c9e60d

  Copy full SHA for 6c9e60d

• [CI] Change torch 2.3.0.dev20240126 to 20240105 for nvcr 24.02

  tridao

  committed
  6e2fa30

  Copy full SHA for 6e2fa30

Commits on Feb 21, 2024

• Bump to v2.5.5

  tridao

  committed
  87a1277

  Copy full SHA for 87a1277

• Enable headdim 256 backward on consumer GPUs (Ampere, Ada)

  tridao

  committed
  2406f28

  Copy full SHA for 2406f28

• Bump to v2.5.4

  tridao

  committed
  43950dd

  Copy full SHA for 43950dd

• Update Cutlass to v3.4.1

  tridao

  committed
  4d6b794

  Copy full SHA for 4d6b794

Commits on Feb 20, 2024

• Don't need to reduce row_sum during online softmax

  tridao

  committed
  b32efb1

  Copy full SHA for b32efb1

Commits on Feb 18, 2024

• Optimize compile to 1: avoid oom 2: minimize swap usage 3: avoid threads starvation when letting ninja decide how many workers to spawn or manual MAX_JOBS "guesses". Logic is to take the min value …

  Show description for f45bbb4
  Qubitium

  authored
  f45bbb4

  Copy full SHA for f45bbb4

Commits on Feb 10, 2024

• Bump to v2.5.3

  tridao

  committed
  5cdabc2

  Copy full SHA for 5cdabc2

• Fix dv = torch::empty_like(k) for mha_bwd_varlen as well

  tridao

  committed
  d9a5cb2

  Copy full SHA for d9a5cb2

• Add window_size option to ParallelMHA

  tridao

  committed
  a190df0

  Copy full SHA for a190df0

• fix backward for when query and key have different contiguity (#818)

  bdhirsh

  authored
  2423cca

  Copy full SHA for 2423cca

Commits on Feb 8, 2024

• Fix Windows build (#816)

  sgrigory

  authored
  4687936

  Copy full SHA for 4687936

Commits on Jan 31, 2024

• Bump to v2.5.2

  tridao

  committed
  61a7772

  Copy full SHA for 61a7772

• [CI] Compile with torch 2.2.0 instead of 2.2.0.dev20231106

  tridao

  committed
  6a5c053

  Copy full SHA for 6a5c053

• Add window_size option to MHA and GPT

  tridao

  committed
  ef0ed10

  Copy full SHA for ef0ed10

Commits on Jan 30, 2024

• [CI] Install torch 2.3 using index

  tridao

  committed
  dc72d96

  Copy full SHA for dc72d96

Pagination

Previous

Next