Description
训练完的奖励模型使用数据集推理： @Jintao-Huang @hjh0119 @tastelikefeet 期待您的解答
NPROC_PER_NODE=8 \
MAX_PIXELS=1003520 \
swift infer \
--model /cache/zzh/critic_model/ \
--max_batch_size 4 \
--infer_backend pt \
--dataset_shuffle false \
--val_dataset_shuffle false \
--temperature 0 \
--val_dataset /cache/zzh/critic_qa_data/test_rm_system_five_swift_new.jsonl \
--result_path /cache/test.jsonl
其中输入测试集的每个样本的形式可以是下面这样吗？
"""
{"messages":
[{"role": "system", "content": "You are an impartial evaluator. Please assess the quality of the AI assistant's response to the user's question."},
{"role": "user", "content": "Provide an intricate description of every entity in the image."},
{"role": "assistant", "content": "The image depicts a modern kitchen interior with a clean and organized design. Here's a detailed description of the various elements present:\n\n1. Cabinets: The upper and lower cabinets are white, giving a sleek and minimalistic appearance. They have a smooth finish without visible handles or knobs.\n\n2. Countertops: The countertops are made of a gray speckled material, possibly granite or quartz, providing a durable and elegant workspace.\n\n3. Backsplash: The backsplash behind the stove area is composed of dark gray tiles, which contrasts nicely with the white cabinets.\n\n4. Sink: There is a double-basin stainless steel sink located on one of the countertops. A modern faucet with a high arc is positioned above the sink.\n\n5. Stove: A stainless steel gas range with multiple burners is built into the countertop. Above the stove is a matching stainless steel range hood.\n\n6. Refrigerator: To the left, there is a stainless steel refrigerator with a side-by-side door design. It has a water and ice dispenser integrated into the freezer door.\n\n7. Microwave: Built into the cabinetry above the stove is a stainless steel microwave, likely installed at a convenient height for easy access.\n\n8. Lighting: Track lighting with adjustable spotlights is installed on the ceiling, providing focused illumination over the kitchen areas.\n\n9. Decor Items: On the countertop to the right of the stove, there is a small decorative plant in a black pot. There are also some jars and containers, possibly holding spices or other kitchen essentials.\n\n10. Tray: On the foreground countertop, there is a metallic tray holding two decorative baskets or bowls, along with some gold-colored items inside them. \n\n11. Appliances and Containers: Additional items like a coffee maker and other small kitchen appliances are placed on the counters, contributing to the functional aspect of the kitchen.\n\n12. Walls and Ceiling: The walls appear to be painted a light color, complementing the overall bright and airy feel of the kitchen. The ceiling is plain and white.\n\nOverall, this kitchen combines functionality with modern aesthetics, featuring high-quality materials and well-thought-out design elements."}],
"images": ["/cache/zzh/critic_qa_data/test_data_images/hallucination_detect/VG_100K/2371193.jpg"]}
""""