Skip to content
This repository was archived by the owner on Feb 22, 2021. It is now read-only.

Commit 09a65c2

Browse files
author
Philipp Dowling
committed
write string, not list
1 parent 31c2951 commit 09a65c2

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

resources/fix_corpus.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -50,11 +50,11 @@ def __iter__(self):
5050
line = "".join(line_parts)
5151

5252
line = utils.to_unicode(line)
53-
yield line.split()
53+
yield line + "\n"
5454

5555

5656
def fix_corpus(path_to_corpus):
5757
fixed = PreprocessingLineSentence(path_to_corpus)
5858
with open(path_to_corpus + "_fixed", "w") as f:
5959
for line in fixed:
60-
f.write(" ".join(line) + "\n")
60+
f.write(line)

0 commit comments

Comments
 (0)