Skip to content

Commit 0b06476

Browse files
authored
Update readme
1 parent 4e19841 commit 0b06476

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -55,10 +55,10 @@ python train.py --dataset rocstories --desc rocstories --submit --analysis --dat
5555
#### Accuracy on the ROCStories test set
5656
Finetuning the PyTorch model for 3 Epochs on ROCStories takes 10 minutes to run on a single NVidia K-80.
5757

58-
The test accuracy of this PyTorch version (with the default TensorFlow hyper-parameters) is 83.43%.
59-
60-
The authors reports a median accuracy of 10 runs with the TensorFlow code of 85.8%.
58+
The test accuracy of this PyTorch version (with the default TensorFlow hyper-parameters not finetuned for the differences between PyTorch and TensorFlow internal operations) is 83.43%.
59+
The authors reports a median accuracy with the TensorFlow code of 85.8%.
6160
The paper reports a best accuracy of 86.5%.
61+
The previous SOTA on the ROCStories dataset is 77.6 (Hidden Coherence Model of Chaturvedi et al. in "Story Comprehension for Predicting What Happens Next" EMNLP 2017. Which is a very nice paper by the way, you should check it out)
6262

6363
As noted by the author, the code can be non-deterministic due to various GPU ops.
6464

0 commit comments

Comments
 (0)