Skip to content

Conversation

yunfeng-scale
Copy link
Contributor

@yunfeng-scale yunfeng-scale commented Nov 1, 2023

Integrating TensorRT-LLM with LLM engine. there are lots of caveats in this integration:

fixes #363

@yunfeng-scale yunfeng-scale requested a review from a team November 1, 2023 20:59
Copy link
Member

@yixu34 yixu34 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor comments.

Can we create a github issue for visibility and link it to this PR?

@yunfeng-scale yunfeng-scale enabled auto-merge (squash) November 13, 2023 22:56
@yunfeng-scale yunfeng-scale merged commit 4e2ea6c into main Nov 15, 2023
@yunfeng-scale yunfeng-scale deleted the yunfeng-trt-llm branch November 15, 2023 05:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integrate TensorRT-LLM

2 participants