Description
运行python -m fastdeploy.entrypoints.openai.api_server --model /root/fssd/PaddlePaddle/ERNIE-4.5-VL-28B-A3B-Base-Paddle --port 8180 --metrics-port 8181 --engine-worker-queue-port 8182 --max-model-len 32768 --max-num-seqs 32 --reasoning-parser ernie-45-vl --enable-mm直接卡死如下，没有任何显示
Loading Weights: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [01:03<00:00, 1.59it/s]
Loading Layers: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:08<00:00, 12.48it/s]
然后ctrl c终止 报错如下
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/entrypoints/openai/api_server.py", line 385, in
main()
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/entrypoints/openai/api_server.py", line 376, in main
if load_engine() is None:
^^^^^^^^^^^^^
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/entrypoints/openai/api_server.py", line 85, in load_engine
if not engine.start(api_server_pid=os.getpid()):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/engine/engine.py", line 242, in start
self._stop_profile()
File "/root/fssd/ERNIE-4.5-Base/lib/python3.11/site-packages/fastdeploy/engine/engine.py", line 1152, in _stop_profile
time.sleep(1)
KeyboardInterrupt
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 6 leaked shared_memory objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/worker_healthy_live_signal.10375': [Errno 2] No such file or directory: '/worker_healthy_live_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/exist_swapped_task_signal.10375': [Errno 2] No such file or directory: '/exist_swapped_task_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/exist_task_signal.10375': [Errno 2] No such file or directory: '/exist_task_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/worker_ready_signal.10375': [Errno 2] No such file or directory: '/worker_ready_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/model_weights_status.10375': [Errno 2] No such file or directory: '/model_weights_status.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
/root/fssd/ERNIE-4.5-Base/lib/python3.11/multiprocessing/resource_tracker.py:267: UserWarning: resource_tracker: '/prefill_time_signal.10375': [Errno 2] No such file or directory: '/prefill_time_signal.10375'
warnings.warn('resource_tracker: %r: %s' % (name, e))
然后查看fastdeploy.log日志
WARNING 2025-07-03 10:26:36,668 10454 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.cpu import failed, it may be not compiled.
WARNING 2025-07-03 10:26:36,669 10454 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.xpu import failed, it may be not compiled.
WARNING 2025-07-03 10:26:36,669 10454 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.npu import failed, it may be not compiled.
INFO 2025-07-03 10:27:47,841 10454 engine_worker_queue.py[line:219] Connected EngineWorkerQueue client_id: 0, number of connected clients: 2
WARNING 2025-07-03 10:27:49,634 10375 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.cpu import failed, it may be not compiled.
WARNING 2025-07-03 10:27:49,634 10375 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.xpu import failed, it may be not compiled.
WARNING 2025-07-03 10:27:49,635 10375 import_ops.py[line:47] Ops of fastdeploy.model_executor.ops.npu import failed, it may be not compiled.
INFO 2025-07-03 10:30:07,810 10375 zmq_client.py[line:178] Closing ZMQ connection...
WARNING 2025-07-03 10:30:07,811 10375 zmq_client.py[line:157] Context was terminated
ERROR 2025-07-03 10:30:07,811 10375 engine.py[line:375] Engine stops inserting zmq task into scheduler