diff options
| author | Kenneth Heafield <github@kheafield.com> | 2011-08-18 12:14:01 +0100 |
|---|---|---|
| committer | Kenneth Heafield <github@kheafield.com> | 2011-08-18 12:14:01 +0100 |
| commit | 2c14cf2218031c29a9884bccf17e9273c71a33b2 (patch) | |
| tree | c6afcdffb542dea214fe0bd3fad865527e65eb5c /klm/lm/quantize.cc | |
| parent | d73b5d25bd0af14a4a83490d67ba2553b6af9884 (diff) | |
KenLM update: Bhiksha's trick, simple test for lms without unk, auto-detect binary files instead of requiring them to be specified at runtime.
Diffstat (limited to 'klm/lm/quantize.cc')
| -rw-r--r-- | klm/lm/quantize.cc | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/klm/lm/quantize.cc b/klm/lm/quantize.cc index 4bb6b1b8..fd371cc8 100644 --- a/klm/lm/quantize.cc +++ b/klm/lm/quantize.cc @@ -43,6 +43,7 @@ void SeparatelyQuantize::UpdateConfigFromBinary(int fd, const std::vector<uint64 if (read(fd, &version, 1) != 1 || read(fd, &config.prob_bits, 1) != 1 || read(fd, &config.backoff_bits, 1) != 1) UTIL_THROW(util::ErrnoException, "Failed to read header for quantization."); if (version != kSeparatelyQuantizeVersion) UTIL_THROW(FormatLoadException, "This file has quantization version " << (unsigned)version << " but the code expects version " << (unsigned)kSeparatelyQuantizeVersion); + AdvanceOrThrow(fd, -3); } void SeparatelyQuantize::SetupMemory(void *start, const Config &config) { |