diff options
| author | Kenneth Heafield <github@kheafield.com> | 2011-08-18 12:14:01 +0100 |
|---|---|---|
| committer | Kenneth Heafield <github@kheafield.com> | 2011-08-18 12:14:01 +0100 |
| commit | 7607b0a7873f52d6e3ea387bf88c773cbb55f8ee (patch) | |
| tree | 908fd94fea8d09725bc86ec9b3752b89c78338e5 /klm/lm/config.hh | |
| parent | d92124ccc866192e4cdc689f2b41f0324d35dd3b (diff) | |
KenLM update: Bhiksha's trick, simple test for lms without unk, auto-detect binary files instead of requiring them to be specified at runtime.
Diffstat (limited to 'klm/lm/config.hh')
| -rw-r--r-- | klm/lm/config.hh | 5 |
1 files changed, 4 insertions, 1 deletions
diff --git a/klm/lm/config.hh b/klm/lm/config.hh index dcc7cf35..227b8512 100644 --- a/klm/lm/config.hh +++ b/klm/lm/config.hh @@ -73,9 +73,12 @@ struct Config { // Quantization options. Only effective for QuantTrieModel. One value is // reserved for each of prob and backoff, so 2^bits - 1 buckets will be used - // to quantize. + // to quantize (and one of the remaining backoffs will be 0). uint8_t prob_bits, backoff_bits; + // Bhiksha compression (simple form). Only works with trie. + uint8_t pointer_bhiksha_bits; + // ONLY EFFECTIVE WHEN READING BINARY |