Skip to content

Pull requests: triton-inference-server/tutorials

New pull request New
Clear current search query, filters, and sorts
15 Open 106 Closed
15 Open 106 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add generate endpoint to Tutorial
#71 by fpetrini15 was merged Nov 14, 2023 Loading…
typo in README.md
#70 by JoanFM was merged Nov 22, 2023 Loading…
4
Update README.md
#69 by joaquincabezas was merged Dec 28, 2023 Loading…
11
Update TRT-LLM installation steps
#68 by krishung5 was merged Nov 8, 2023 Loading…
2
Extra comments to Llama2 tutorial
#67 by jbkyang-nvi was merged Nov 8, 2023 Loading…
10
Update path to tokenizer in llama tutorial
#66 by jbkyang-nvi was merged Nov 3, 2023 Loading…
Updated vllm tutorial to use vllm based container from NGC
#65 by oandreeva-nv was merged Oct 31, 2023 Loading…
22
Updated version of vllm
#64 by oandreeva-nv was merged Oct 26, 2023 Loading…
config the vLLM engineArgs in config.pbtxt
#63 by activezhao was closed Nov 22, 2023 Loading…
4
Llama tutorial for TRTLLM
#62 by jbkyang-nvi was merged Oct 27, 2023 Loading…
31
Normalize input tensor names
#59 by nnshah1 was closed Nov 21, 2023 Loading…
10
Make stream input optional for vLLM
#58 by rmccorm4 was merged Oct 9, 2023 Loading…
Decode bytes input to utf-8 string before passing to vllm engine
#57 by rmccorm4 was merged Oct 5, 2023 Loading…
4
Add request cancellation support to vLLM tutorial
#56 by kthui was closed Oct 6, 2023 Loading…
5
Minor vllm UX improvements
#55 by rmccorm4 was closed Oct 9, 2023 Loading…
8
Upgrade vLLM version in tutorial
#54 by the-david-oy was merged Oct 2, 2023 Loading…
Add more parameters to vLLM tutorial
#53 by the-david-oy was merged Oct 2, 2023 Loading…
5
Support input and parameter approaches for vLLM tutorial
#52 by the-david-oy was merged Sep 29, 2023 Loading…
2
Allow both input and parameter approach for vLLM
#51 by the-david-oy was merged Sep 29, 2023 Loading…
Resolve unsupported InferenceRequest parameters in BLS
#50 by the-david-oy was merged Sep 29, 2023 Loading…
Hugging Face Transformer Deployment Tutorial
#49 by fpetrini15 was merged Oct 24, 2023 Loading…
64
Improve documentation for multi-GPU support
#48 by tanmayv25 was merged Sep 20, 2023 Loading…
1
Use pip for vLLM tutorial
#46 by the-david-oy was merged Sep 20, 2023 Loading…
17
Resolve unsupported InferenceRequest parameters in BLS
#45 by tonywang10101 was closed Sep 29, 2023 Loading…
8
Lower default temperature in vLLM example
#43 by rmccorm4 was merged Sep 9, 2023 Loading…
ProTip! Follow long discussions with comments:>50.