Skip to content

Commit

Permalink
updated requirement.txt; fixed cmd parsing
Browse files Browse the repository at this point in the history
  • Loading branch information
Edward Hu committed Apr 4, 2019
1 parent b4af02b commit f67dc80
Show file tree
Hide file tree
Showing 3 changed files with 5 additions and 4 deletions.
2 changes: 1 addition & 1 deletion custom_constraints.py
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ def createJSON(text, src_bpe, trg_bpe, neg_lists=[], pos_lists=[], expand=True):
if len(splitted_sent) >= 3:
if splitted_sent[2] != '':
pos_constraints = splitted_sent[2].split('|')
sentence = sentence.split('\t')[0]
sentence = sentence.split('\t')[0]

en_line = tokenizeEngWithSpacy(sentence, return_str=True)

Expand Down
2 changes: 2 additions & 0 deletions post.sh
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
#!/bin/bash

sed -r 's/@@( |$)//g' \
| \
python detok.py
5 changes: 2 additions & 3 deletions requirement.txt
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
spacy==2.0.18
https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-2.0.0/en_core_web_sm-2.0.0.tar.gz#egg=en
mosestokenizer==1.0.0
mxnet==1.3.1
numpy==1.15.4
sockeye==1.18.67
mxnet==1.4.0
sockeye==1.18.85
subword-nmt==0.3.6

0 comments on commit f67dc80

Please sign in to comment.