diff options
| author | Patrick Simianer <patrick@lilt.com> | 2026-02-26 10:05:59 +0000 |
|---|---|---|
| committer | Patrick Simianer <patrick@lilt.com> | 2026-02-26 10:05:59 +0000 |
| commit | b31ace79ea5f6b3f279c544cd3a443d6fbf2a24d (patch) | |
| tree | 31f2b599fa5f6996aeb134390d58deb63eefe04a /sentencepiece-decode | |
| parent | 8805e95ae94d798c6441f7e1b72c90e049563f17 (diff) | |
Diffstat (limited to 'sentencepiece-decode')
| -rwxr-xr-x | sentencepiece-decode | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/sentencepiece-decode b/sentencepiece-decode index 5e07ffa..e715d09 100755 --- a/sentencepiece-decode +++ b/sentencepiece-decode @@ -1,9 +1,8 @@ #!/usr/bin/env ruby -require 'zipf' +require "zipf" while line = STDIN.gets line = line.split.join "" puts line.gsub "▁", " " end - |