Poor reasoning performance

[shiqiangz-git]

Gpu concurrent reasoning is too slow, CPU reasoning occupancy is too high, resNet50 image classification

[shiqiangz-git]

With gpu 1080ti

[michaelgsharp]

Can you share any results/numbers you are seeing along with what you would expect to be seeing? And share a sample project that repros the situation.

[shiqiangz-git]

Can you share any results/numbers you are seeing along with what you would expect to be seeing? And share a sample project that repros the situa

Can you share any results/numbers you are seeing along with what you would expect to be seeing? And share a sample project that repros the situation.

Sorry, I can't share my project. I just import about 670,000 pictures, then train them with resnet50, and then build webapi with pudectpool. If I use CPU, the CPU utilization rate slowly rises, and the gpu speed is not ideal. Can you tell me the reason? The performance has not reached an acceptable range, and the CPU utilization rate of a few pictures is 100.

[shiqiangz-git]

6,7w pictures