[HANDS-ON BUG] Incorrect CLI command for DPO Hands-on implementation

[Josh-Weston]

Describe the bug

The CLI command for lighteval in the submission for DPO Hands-on implementation causes errors

To Reproduce

Run the current CLI command provided in the course

hf jobs uv run \
    --flavor a10g-large \
    --with "lighteval[vllm]" \
    --secrets HF_TOKEN \
    lighteval vllm "model_name=<your-username>/<your-model-name>" \
    "lighteval|truthfulqa:mc2|0|0,lighteval|hellaswag|0|0,lighteval|arc:challenge|0|0" \
    --push-to-hub --results-org <your-username>

This will result in task errors ValueError: Cannot find task lighteval|truthfulqa:mc2 in task list or in custom task registry

Screenshots

Additional context

To fix the errors, use the tasks specified in V0.11.0 of the lighteval package

All Tasks

hf jobs uv run \
    --flavor a10g-large \
    --with "lighteval[vllm]" \
    --secrets HF_TOKEN \
    lighteval vllm "model_name=<your-username>/<your-model-name>" \
    "leaderboard|truthfulqa:mc|0|0,leaderboard|hellaswag|0|0,leaderboard|arc:challenge|0|0" \
    --push-to-hub --results-org <your-username>