Search results

Can not reproduce results on the table

Status: Open.

#3 In declare-lab/instruct-eval;

· simplelifetime opened on Apr 21, 2023

Add config to save eval results

Status: Open.

#12 In declare-lab/instruct-eval;

· arthurtobler opened on Jun 20, 2023

Integrate the evaluation in the Transformers trainer with transformers.TrainerCallback

Status: Open.

#7 In declare-lab/instruct-eval;

· BaohaoLiao opened on May 31, 2023

[Feature Request] Saving Prediction Results

Status: Open.

#14 In declare-lab/instruct-eval;

· guanqun-yang opened on Jun 30, 2023

Reproduce the accuracy of chavinlo/alpaca-native on MMLU

Status: Open.

#25 In declare-lab/instruct-eval;

· sglucas opened on Oct 25, 2023

What are the metrics for the evaluation results?

Status: Open.

#26 In declare-lab/instruct-eval;

· zhimin-z opened on Dec 12, 2023

C-Eval

Status: Open.

#17 In declare-lab/instruct-eval;

· duanqiyuan opened on Jul 20, 2023

Is there any parallel processing methods?

Status: Open.

#13 In declare-lab/instruct-eval;

· wwngh1233 opened on Jun 28, 2023

AutoModelForCausalLM supports llama models now

Status: Open.

#6 In declare-lab/instruct-eval;

· passaglia opened on May 31, 2023

请问能加入对baichuan大模型的支持吗

Status: Open.

#16 In declare-lab/instruct-eval;

· linghongli opened on Jul 7, 2023

Evaluate on a single 24GB/32GB GPU

Status: Open.

#29 In declare-lab/instruct-eval;

· lemyx opened on Jan 16, 2024

[Prompt Template] Silent bug - Performance Killer

Status: Open.

#27 In declare-lab/instruct-eval;

· timothylimyl opened on Jan 5, 2024