You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+10-7Lines changed: 10 additions & 7 deletions
Original file line number
Diff line number
Diff line change
@@ -1,8 +1,11 @@
1
-
# Byseqlib
2
-
Byseqlib is a high performance inference library for SOTA NLU/NLG models. It's built on
3
-
CUDA official library([cuBLAS](https://docs.nvidia.com/cuda/cublas/index.html),
4
-
[Thrust](https://docs.nvidia.com/cuda/thrust/index.html), [CUB](http://nvlabs.github.io/cub/)) and custom kernel functions which are specially fused and
5
-
optimized for these widely used models. In addition to model components, we also provide codes
1
+
# Byseqlib: A High Performance Inference Library for Sequence Processing and Generation
2
+
3
+
Byseqlib is a high performance inference library for sequence processing and generation implemented in CUDA.
4
+
It enables highly efficient computation of modern NLP models such as **BERT**, **GPT2**, **Transformer**, etc.
5
+
It is therefore best useful for *Machine Translation*, *Text Generation*, *Dialog*, *Language Modelling*, and other related tasks using these models.
6
+
7
+
The library is built on top of CUDA official library([cuBLAS](https://docs.nvidia.com/cuda/cublas/index.html),
8
+
[Thrust](https://docs.nvidia.com/cuda/thrust/index.html), [CUB](http://nvlabs.github.io/cub/)) and custom kernel functions which are specially fused and optimized for these widely used models. In addition to model components, we also provide codes
6
9
manage model weights trained from deepleanring framework and servers as a custom backend for
0 commit comments