Skip to content

python -m fastdeploy.entrypoints.openai.api_server --model /root/fssd/PaddlePaddle/ERNIE-4.5-VL-28B-A3B-Base-Paddle 执行失败 #2693

Open
@liuxun0436

Description

@liuxun0436

运行python -m fastdeploy.entrypoints.openai.api_server --model /root/fssd/PaddlePaddle/ERNIE-4.5-VL-28B-A3B-Base-Paddle --port 8180 --metrics-port 8181 --engine-worker-queue-port 8182 --max-model-len 32768 --max-num-seqs 32 --reasoning-parser ernie-45-vl --enable-mm直接卡死如下,没有任何显示
Loading Weights: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [01:03<00:00, 1.59it/s]
Loading Layers: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:08<00:00, 12.48it/s]

然后ctrl c终止 报错如下

Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/entrypoints/openai/api_server.py", line 385, in
main()
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/entrypoints/openai/api_server.py", line 376, in main
if load_engine() is None:
^^^^^^^^^^^^^
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/entrypoints/openai/api_server.py", line 85, in load_engine
if not engine.start(api_server_pid=os.getpid()):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/engine/engine.py", line 242, in start
self._stop_profile()
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/engine/engine.py", line 1152, in _stop_profile
time.sleep(1)
KeyboardInterrupt
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 6 leaked shared_memory objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/worker_healthy_live_signal.10375': [Errno 2] No such file or directory: '/worker_healthy_live_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/exist_swapped_task_signal.10375': [Errno 2] No such file or directory: '/exist_swapped_task_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/exist_task_signal.10375': [Errno 2] No such file or directory: '/exist_task_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/worker_ready_signal.10375': [Errno 2] No such file or directory: '/worker_ready_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/model_weights_status.10375': [Errno 2] No such file or directory: '/model_weights_status.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/prefill_time_signal.10375': [Errno 2] No such file or directory: '/prefill_time_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))

然后查看fastdeploy.log日志

WARNING 2025-07-03 10:26:36,668 10454 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.cpu import failed, it may be not compiled.
WARNING 2025-07-03 10:26:36,669 10454 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.xpu import failed, it may be not compiled.
WARNING 2025-07-03 10:26:36,669 10454 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.npu import failed, it may be not compiled.
INFO 2025-07-03 10:27:47,841 10454 engine_worker_queue.py[line:219] Connected EngineWorkerQueue client_id: 0, number of connected clients: 2
WARNING 2025-07-03 10:27:49,634 10375 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.cpu import failed, it may be not compiled.
WARNING 2025-07-03 10:27:49,634 10375 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.xpu import failed, it may be not compiled.
WARNING 2025-07-03 10:27:49,635 10375 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.npu import failed, it may be not compiled.
INFO 2025-07-03 10:30:07,810 10375 zmq_client.py[line:178] Closing ZMQ connection...
WARNING 2025-07-03 10:30:07,811 10375 zmq_client.py[line:157] Context was terminated
ERROR 2025-07-03 10:30:07,811 10375 engine.py[line:375] Engine stops inserting zmq task into scheduler

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions