Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 28, 2023

• Bump to v2.3.6

  tridao

  committed
  92dd570

  Copy full SHA for 92dd570

• [CI] Only compile for CUDA 11.8 & 12.2, MAX_JOBS=2,add torch-nightly

  tridao

  committed
  d4a7c8f

  Copy full SHA for d4a7c8f

Commits on Nov 27, 2023

• Allow varlen_fwd to take optional seqused_k (#647)

  Show description for ce3e728
  bottler

  authored
  ce3e728

  Copy full SHA for ce3e728

• Bump to v2.3.5

  tridao

  committed
  23b77c8

  Copy full SHA for 23b77c8

• Fix performance regression with causal

  tridao

  committed
  b4bf9cc

  Copy full SHA for b4bf9cc

Commits on Nov 20, 2023

• Bump to v2.3.4

  tridao

  committed
  2c3baba

  Copy full SHA for 2c3baba

• [CrossEntropy] Simplify the case of large vocab with Tensor Parallel

  tridao

  committed
  aaa1474

  Copy full SHA for aaa1474

• fix flash ce mp large vocab (#673)

  simonJJJ

  authored
  abf04a5

  Copy full SHA for abf04a5

• Write zero to out / grad if seqlen_q or seqlen_k is zero

  tridao

  committed
  db2f806

  Copy full SHA for db2f806

• Update cutlass to 3.2.2

  tridao

  committed
  43bb6d8

  Copy full SHA for 43bb6d8

• add checks (#640)

  drisspg

  authored
  dc4b9ad

  Copy full SHA for dc4b9ad

Commits on Nov 14, 2023

• [LayerNorm] Add postnorm residual + LayerNorm/RMSNorm in Triton

  tridao

  committed
  0177164

  Copy full SHA for 0177164

Commits on Nov 13, 2023

• [LayerNorm] Implement residual + LayerNorm/RMSNorm in Triton

  tridao

  committed
  79bd1a2

  Copy full SHA for 79bd1a2

Commits on Nov 9, 2023

• Fix typo in RotaryEmbedding forward output type (#666)

  antony-frolov

  authored
  3566596

  Copy full SHA for 3566596

Commits on Oct 24, 2023

• Bump to v2.3.3

  tridao

  committed
  83aef84

  Copy full SHA for 83aef84

• [CrossEntropy] Fix triton cross_entropy_loss IMA for >=2B elements

  tridao

  committed
  c79de85

  Copy full SHA for c79de85

Commits on Oct 12, 2023

• Clarify inference README is a placeholder

  tridao

  committed
  02ac572

  Copy full SHA for 02ac572

Commits on Oct 9, 2023

• Bump to v2.3.2

  tridao

  committed
  7f31e7c

  Copy full SHA for 7f31e7c

Commits on Oct 8, 2023

• Change constexpr int to constexpr static int

  tridao

  committed
  5a83425

  Copy full SHA for 5a83425

Commits on Oct 5, 2023

• Add change log

  tridao

  committed
  3a9fe7b

  Copy full SHA for 3a9fe7b

• Clarify that Windows is not supported right now

  tridao

  committed
  aa4fd2d

  Copy full SHA for aa4fd2d

Commits on Oct 4, 2023

• [CI] Use official Pytorch 2.1, add CUDA 11.8 for Pytorch 2.1

  tridao

  committed
  5e525a8

  Copy full SHA for 5e525a8

• Bump to v2.3.1

  tridao

  committed
  21c3b0d

  Copy full SHA for 21c3b0d

Commits on Oct 3, 2023

• [Gen] Accept cache_batch_idx to index into the KV cache

  tridao

  committed
  e279bf8

  Copy full SHA for e279bf8

Commits on Sep 27, 2023

• Bump to v2.3.0

  tridao

  committed
  601b4dc

  Copy full SHA for 601b4dc

Commits on Sep 26, 2023

• Implement local attention

  Show description for 083e8f5
  

  tridao

  and

  timlacroix

  committed
  083e8f5

  Copy full SHA for 083e8f5

Commits on Sep 25, 2023

• Fix NameError and typo in ApplyRotaryEmbQKV_ (#569)

  crowsonkb

  authored
  4c8ff91

  Copy full SHA for 4c8ff91

Commits on Sep 24, 2023

• Bump to v2.2.5

  tridao

  committed
  0a1d03c

  Copy full SHA for 0a1d03c

• Switch cutlass to newer commit to avoid compilation warning

  tridao

  committed
  812cb1c

  Copy full SHA for 812cb1c

• Don't over-allocate dq_accum in case of varlen

  tridao

  committed
  65c234e

  Copy full SHA for 65c234e

• Reduce number of templates for headdim > 128

  tridao

  committed
  1879e08

  Copy full SHA for 1879e08

Commits on Sep 22, 2023

• Add placeholder for inference example

  tridao

  committed
  dd9a6fa

  Copy full SHA for dd9a6fa

• Re-enable compilation for Hopper

  tridao

  committed
  bff3147

  Copy full SHA for bff3147

Commits on Sep 21, 2023

• Fix E1136 (#563)

  icyblade

  authored
  187c2a0

  Copy full SHA for 187c2a0

• Bump to v2.2.4

  tridao

  committed
  229080b

  Copy full SHA for 229080b

Pagination

Previous

Next