7 Pull requests merged by 5 people

• Update README.md for r25.05 release

  #8200 merged May 9, 2025

• proper 25.05 version

  #8198 merged May 9, 2025

• TPRD-1509: Upadate OpenVINO version to 2025.1.0

  #8196 merged May 8, 2025

• boost vLLM to 0.8.5

  #8193 merged May 8, 2025

• Fix: Update element count handling

  #8182 merged May 7, 2025

• Update default branch post-25.04

  #8188 merged May 7, 2025

• test: Add backend_api_test to test backend APIs

  #8185 merged May 7, 2025

3 Pull requests opened by 3 people

• build: Upgrade vllm version to 0.8.5.post1

  #8190 opened May 7, 2025

• test: L0_orca_trtllm fixed

  #8191 opened May 7, 2025

• build: Convert vLLM index url ARGS into docker secrets

  #8197 opened May 9, 2025

6 Issues opened by 6 people

• How to get token usage from openai frontend?

  #8194 opened May 8, 2025

• 25.01 vllm tritonserver panic TRITONBACKEND_ResponseFactoryIsCancelled

  #8192 opened May 8, 2025

• vLLM backend: Model-specific GPU assignment ignored — both models loaded on GPU 0 despite config.pbtxt specifying gpus: [0] and gpus: [1]

  #8189 opened May 7, 2025

• Docker Image Security Report

  #8187 opened May 6, 2025

• Support deterministic algorithm configuration in PyTorch backend

  #8186 opened May 5, 2025

• The model instance placement on GPU seems incorrect?

  #8184 opened May 5, 2025

6 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• draft: Update handling of large array sizes

  #8174 commented on May 9, 2025 • 2 new comments

• Is it possible to make gRPC to use a unix socket instead of TCP in Triton Server?

  #4095 commented on May 5, 2025 • 0 new comments

• Got run time error `0 active drivers ([]). There should only be one.` when using PipelineModule through ray and deepspeed

  #8007 commented on May 7, 2025 • 0 new comments

• vllm_backend: What is the right way to use downloaded model + `model.json` together?

  #7912 commented on May 7, 2025 • 0 new comments

• No valid engine configs for ConvFwd_

  #8137 commented on May 9, 2025 • 0 new comments

• fix: Fix L0_backend_python env test

  #8178 commented on May 9, 2025 • 0 new comments