diff options
author | mjdenkowski <michael.j.denkowski@gmail.com> | 2014-03-12 22:06:35 -0400 |
---|---|---|
committer | mjdenkowski <michael.j.denkowski@gmail.com> | 2014-03-12 22:06:35 -0400 |
commit | 0afd9d510cde40c340cf2c389b1aa22b5a9379c5 (patch) | |
tree | 60dd8ccb34b015cb1b8febaa260f4d993e7bbcd3 /corpus/support | |
parent | 23fe12f6d5083c66d755b797b8d0d5587f95de8e (diff) |
XML file tokenization for all your WMT needs.
Diffstat (limited to 'corpus/support')
-rwxr-xr-x | corpus/support/fix-eos.pl | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/corpus/support/fix-eos.pl b/corpus/support/fix-eos.pl index 584f8b46..fe03727b 100755 --- a/corpus/support/fix-eos.pl +++ b/corpus/support/fix-eos.pl @@ -1,4 +1,6 @@ #!/usr/bin/perl -w +$|++; + use strict; use utf8; |