Skip to content

Commit a5ec199

Browse files
Lingjiao ChenLingjiao Chen
Lingjiao Chen
authored and
Lingjiao Chen
committed
upload the eval code
1 parent 9393cdb commit a5ec199

File tree

94 files changed

+84504
-62767
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

94 files changed

+84504
-62767
lines changed

Intro.ipynb

Lines changed: 16186 additions & 631 deletions
Large diffs are not rendered by default.

config/evaluate_prime.json

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
{ "query_params":{"dataset_name":"prime",
2+
"querypath":"../../data/prime/questions.json",
3+
"answerpath":"../../data/prime/answers.json",
4+
"savepath":"../../generation/PRIME_FULL.csv"
5+
},
6+
7+
"model_list":["openaichat/gpt-3.5-turbo-0301","openaichat/gpt-3.5-turbo-0613","openaichat/gpt-4-0314","openaichat/gpt-4-0613"],
8+
9+
"model_params":{"max_tokens":1000,
10+
"temperature":0.1,
11+
"stop":["\n\n\n\n\n"]
12+
},
13+
14+
"trail":1,
15+
"system_prompts":[""],
16+
17+
"note":"config files for prime"
18+
}

0 commit comments

Comments
 (0)