12 Pull requests merged by 6 people

• slice scatter support for dynamic cases

  #3513 merged Jul 7, 2025

• fix compiler cl not found error in windows

  #3660 merged Jul 7, 2025

• Lluo/cherry pick 3620

  #3658 merged Jul 4, 2025

• Refit debug patch

  #3620 merged Jul 4, 2025

• fix: replace add_identity by add_cast for type cast

  #3563 merged Jul 4, 2025

• feat: Add bf16 support to cast converter

  #3643 merged Jul 4, 2025

• adding rotary embedding example, with graph rewrite for complex subgraph

  #3570 merged Jul 3, 2025

• Lluo/cherry pick 3629

  #3656 merged Jul 3, 2025

• cherry pick 3642

  #3655 merged Jul 3, 2025

• feat: Refactor LLM model zoo and add KV cache support

  #3527 merged Jul 3, 2025

• Closed the perf gap of resnet and enabled refit

  #3629 merged Jul 2, 2025

• Fix dynamo core test failure on Windows

  #3642 merged Jul 2, 2025

13 Pull requests opened by 6 people

• Upgrade perf_run script to support TRT 10 and fix some issues

  #3650 opened Jul 2, 2025

• [kv_cache] integrated vlm code for benchmark (Stacked on #3527)

  #3652 opened Jul 3, 2025

• chore: Fix path in FLUX demo

  #3654 opened Jul 3, 2025

• Add Flux fp4 support

  #3657 opened Jul 4, 2025

• cherry pick 3660 to release/2.8

  #3661 opened Jul 7, 2025

• Cherrypick of PR 3570

  #3662 opened Jul 7, 2025

• fix the int8 quantization failure error

  #3663 opened Jul 7, 2025

• Cherrypick of PR 3513

  #3664 opened Jul 7, 2025

• cherry pick 3663: fix the int8 quantization error, remove duplicated lines

  #3665 opened Jul 7, 2025

• chore: cherry pick of bf16 cast PR (3643)

  #3666 opened Jul 7, 2025

• chore: cherry pick of KV cache PR (3527)

  #3667 opened Jul 8, 2025

• chore(deps): bump transformers from 4.49.0 to 4.51.0 in /tests/py

  #3668 opened Jul 8, 2025

• chore(deps): bump transformers from 4.50.0 to 4.51.0 in /examples/dynamo

  #3669 opened Jul 8, 2025

12 Issues closed by 3 people

• ❓ [Question] Why is `torch.bfloat16` excluded from the `allowed_casts` set ?

  #3637 closed Jul 4, 2025

• 🐛 [Bug] current BN implementation results in slower performance

  #3628 closed Jul 2, 2025

• 🐛 [Bug] Windows dynamo core tests failed

  #3631 closed Jul 2, 2025

• 🐛 [Bug] Test failure in tests/py/dynamo/conversion/test_abs_aten.py ModuleNotFoundError: No module named 'torch_tensorrt.dynamo.debug'

  #3575 closed Jul 1, 2025

• 🐛 [Bug] .tests.py.ts.api.test_classes

  #3576 closed Jul 1, 2025

• 🐛 [Bug] tests.py.dynamo.models.test_dtype_support.TestBF16Support.test_bf16_cpp

  #3579 closed Jul 1, 2025

• 🐛 [Bug] tests.py.dynamo.models.test_dyn_models.test_base_dynamic

  #3580 closed Jul 1, 2025

• 🐛 [Bug] FAILED automatic_plugin/test_automatic_plugin.py::TestAutomaticPlugin::test_mul_plugin_float_0 - AssertionError: Tensor-likes are not close!

  #3582 closed Jul 1, 2025

• 🐛 [Bug] FAILED runtime/test_002_lazy_engine_init.py::TestLazyEngineInit::test_lazy_engine_init_cpp_e2e - AssertionError: False is not true : Resnet18 TRT outputs don't match with the original model. Cosine sim score: nan Threshold: 0.99

  #3583 closed Jul 1, 2025

• 🐛 [Bug] FAILED runtime/test_003_cross_compile_for_windows.py::TestCrossCompileSaveForWindows::test_dynamo_cross_compile_for_windows_multiple_output - Failed: unexpected exception raised: Windows cross compilation feature is not available

  #3584 closed Jul 1, 2025

• 🐛 [Bug] MutableModule Test Failures

  #3586 closed Jul 1, 2025

• 🐛 [Bug] Dynamo core test failed in linux

  #3633 closed Jul 1, 2025

9 Issues opened by 5 people

• 🐛 [Bug] dynamo.compile fails in 2.9.0 nightly when mqt quantization is used

  #3659 opened Jul 7, 2025

• 🐛 [Bug] examples/dynamo/torch_compile_gpt2.py run failed

  #3653 opened Jul 3, 2025

• 🐛 [Bug] FLUX Accuracy Issue

  #3651 opened Jul 2, 2025

• 🐛 [Bug] Draw svg for flux model hangs

  #3649 opened Jul 1, 2025

• 🐛 [Bug] group_norm implementation may slows down SD vae

  #3648 opened Jul 1, 2025

• 🐛 [Bug] index and index_put don't support dynamic shapes

  #3647 opened Jul 1, 2025

• 🐛 [Bug] Flux does not produce the correct image

  #3646 opened Jul 1, 2025

• 🐛 [Bug] with torch_tensorrt.dynamo.Debugger on torch_tensorrt.dynamo.compile it failed due to no graphviz installed

  #3645 opened Jul 1, 2025

• 🐛 [Bug] with torch_tensorrt.dynamo.Debugger is not working with MutableTorchTensorRTModule

  #3644 opened Jul 1, 2025

5 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• TRT-LLM loading mechanism tool

  #3398 commented on Jul 7, 2025 • 12 new comments

• 🐛 [Bug] Large Accuracy Issue

  #3626 commented on Jul 1, 2025 • 0 new comments

• 🐛 [Bug] Weight streaming test failures

  #3585 commented on Jul 1, 2025 • 0 new comments

• Remove Bazel files from wheel

  #3615 commented on Jul 3, 2025 • 0 new comments

• Removal of BAZEL build files from python package and changes to make cpp tests work

  #3641 commented on Jul 7, 2025 • 0 new comments