Conditional Random Field (CRF) model for sequence labeling as the baseline model for Quote Detection task.
Example 1:
python qtask_baseline.py --dataset='T50' --iter=500 --from_scratch
Example 2:
python qtask_baseline.py --dataset='MOVIE' --iter=500
pip install rouge
rouge -f data/pred_quotes.txt data/true_quotes.txt --avg
Metric | T50 | MOV |
---|---|---|
R1 | 20.28 ± 2.99 | 26.42 ± 0.13 |
R2 | 14.38 ± 2.88 | 20.72 ± 0.32 |
RL | 19.38 ± 3.03 | 25.75 ± 0.20 |