[Benchmarking] check if runner helps to restore benchmarking (huggingface#8929)

* check if runner helps.

* remove caching

* gpus

* update runner group

Author: sayakpaul

.github/workflows/benchmark.yml

@@ -19,10 +19,11 @@ jobs:
     strategy:
       fail-fast: false
       max-parallel: 1
-    runs-on: [single-gpu, nvidia-gpu, a10, ci]
+    runs-on: 
+      group: aws-g6-4xlarge-plus
     container:
       image: diffusers/diffusers-pytorch-compile-cuda
-      options: --shm-size "16gb" --ipc host -v /mnt/hf_cache:/mnt/cache/ --gpus 0
+      options: --shm-size "16gb" --ipc host --gpus 0
     steps:
       - name: Checkout diffusers
         uses: actions/checkout@v3