Skip to content

Commit 12063d7

Browse files
authored
update package versions for medical device training assistant (NVIDIA#264)
* update package versions * update README
1 parent bc5107b commit 12063d7

File tree

4 files changed

+20
-16
lines changed

4 files changed

+20
-16
lines changed

industries/healthcare/medical-device-training-assistant/README.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,10 @@ Complete the [common prerequisites](../../../docs/common-prerequisites.md). This
5151
Assuming you would like to enable RIVA ASR and TTS to use your voice for interacting with the RAG, refer to the [Local RIVA Server](../../../docs/riva-asr-tts.md#local-riva-server) section on running RIVA containers on the local machine's compute resources, or refer to [Riva API Endpoint on NVIDIA API Catalog](../../../docs/riva-asr-tts.md#riva-api-endpoint-on-nvidia-api-catalog) to access RIVA speech models on NVIDIA API Catalog instead of hosting them locally. Refer to the rest of the [documentation on RIVA](../../../docs/riva-asr-tts.md) to configure the docker-compose.yaml file.
5252

5353
### Hardware Requirement
54-
The Milvus Vector Database is GPU-enabled by default in this IFU RAG application, which is specified in [docker-compose-vectordb.yaml](./docker-compose-vectordb.yaml). Please refer to the section [Configuring Milvus with GPU Acceleration](../../../docs/vector-database.md#configuring-milvus-with-gpu-acceleration) to see how to set GPU acceleration on and off.
54+
There is no GPU requirement to run this repository, and you could optionally configure components of this repository to utilize GPUs.
55+
56+
You can optionally self host the NIMS for [LLM](https://docs.nvidia.com/nim/large-language-models/latest/getting-started.html), [embedding](https://docs.nvidia.com/nim/nemo-retriever/text-embedding/latest/getting-started.html), and [reranking](https://docs.nvidia.com/nim/nemo-retriever/text-reranking/latest/getting-started.html) models, or use NVIDIA AI Endpoints. For RIVA ASR and TTS, as stated in [RIVA Setup](#riva-setup) you could choose to host them locally or use the endpoints.
57+
The Milvus Vector Database is CPU-enabled by default in this IFU RAG application, which is specified in [docker-compose-vectordb.yaml](./docker-compose-vectordb.yaml). Please refer to the section [Configuring Milvus with GPU Acceleration](../../../docs/vector-database.md#configuring-milvus-with-gpu-acceleration) to see how to set GPU acceleration on.
5558

5659
## Build and Start the Containers
5760

@@ -125,7 +128,7 @@ If you see any errors while navigating the web UI, you could use `docker logs ch
125128

126129
## Next Steps
127130

128-
- [Vector Database Customizations](../../../docs/vector-database.md) to disable GPU acceleration for the Milvus vector database.
131+
- [Vector Database Customizations](../../../docs/vector-database.md) to customize GPU acceleration for the Milvus vector database.
129132
- Stop the containers by running `docker compose down`.
130133
- If you're interested in adapting this application to use on premises machines for NVIDIA Inference Microservices (NIMs), for the LLM, embedding model and reranking model, please refer to [local-deploy README](../../../RAG/examples/local_deploy/README.md) for the requirement and configuration.
131134

industries/healthcare/medical-device-training-assistant/src/chain_server/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ENV DEBIAN_FRONTEND noninteractive
88

99
# Install required ubuntu packages for setting up python 3.10
1010
RUN apt update && \
11-
apt install -y curl software-properties-common libgl1 libglib2.0-0 && \
11+
apt install -y curl software-properties-common libgl1 libglib2.0-0 libmagic1 libmagic-dev && \
1212
add-apt-repository ppa:deadsnakes/ppa && \
1313
apt update && apt install -y python3.10 && \
1414
apt-get clean
@@ -28,7 +28,7 @@ RUN --mount=type=bind,source=src/chain_server/requirements.txt,target=/opt/requi
2828
# TODO Maybe copy app
2929
ARG APP_PATH
3030
COPY ${APP_PATH} /opt/${APP_PATH}
31-
RUN python3.10 -m nltk.downloader averaged_perceptron_tagger
31+
RUN python3.10 -m nltk.downloader averaged_perceptron_tagger_eng
3232

3333
# Copy required common modules for all examples
3434
# TODO copy only relevant files

industries/healthcare/medical-device-training-assistant/src/chain_server/requirements.txt

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,25 @@
11
fastapi==0.110.0
22
uvicorn[standard]==0.27.1
33
python-multipart==0.0.9
4-
langchain==0.1.9
4+
langchain==0.3.14
5+
langchain-community==0.3.14
6+
langchain-core==0.3.29
57
unstructured[all-docs]==0.12.5
68
sentence-transformers==3.0.0
7-
llama-index-core==0.10.27
8-
llama-index-readers-file==0.1.22
9-
llama-index-llms-langchain==0.1.3
10-
llama-index-embeddings-langchain==0.1.2
11-
llama-index-vector-stores-milvus==0.1.6
12-
llama-index-vector-stores-postgres==0.1.5
13-
pymilvus==2.4.0
9+
llama-index-core==0.12.10
10+
llama-index-readers-file==0.4.3
11+
llama-index-llms-langchain==0.5.0
12+
llama-index-embeddings-langchain==0.3.0
13+
llama-index-vector-stores-milvus==0.5.0
14+
llama-index-vector-stores-postgres==0.4.1
15+
pymilvus==2.5.3
1416
dataclass-wizard==0.22.3
1517
opencv-python==4.8.0.74
1618
minio==7.2.5
1719
asyncpg==0.29.0
1820
psycopg2-binary==2.9.9
19-
pgvector==0.2.5
20-
langchain-core==0.1.29
21-
langchain-nvidia-ai-endpoints==0.1.6
21+
pgvector==0.3.6
22+
langchain-nvidia-ai-endpoints==0.3.7
2223
opentelemetry-sdk==1.23.0
2324
opentelemetry-api==1.23.0
2425
opentelemetry-exporter-otlp-proto-grpc==1.23.0

industries/healthcare/medical-device-training-assistant/src/rag_playground/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ENV DEBIAN_FRONTEND noninteractive
88

99
# Install required ubuntu packages for setting up python 3.10
1010
RUN apt update && \
11-
apt install -y dpkg openssl libgl1 linux-libc-dev libksba8 curl software-properties-common build-essential libssl-dev libffi-dev && \
11+
apt install -y dpkg openssl libgl1 linux-libc-dev libksba8 curl software-properties-common build-essential libssl-dev libffi-dev ffmpeg && \
1212
add-apt-repository ppa:deadsnakes/ppa && \
1313
apt update && apt install -y python3.10 python3.10-dev python3.10-distutils
1414

0 commit comments

Comments
 (0)