summaryrefslogtreecommitdiff
path: root/klm/util/tokenize_piece.hh
AgeCommit message (Collapse)Author
2011-10-24KenLM update. EnumerateVocab moved up a namespace. Fix trie building when ↵Kenneth Heafield
bigrams are pruned. Make Chris feel better about MurmurHashNative.
2011-09-21Updated kenlm. Includes left state support but not the cdec-side use of it. ↵Kenneth Heafield
Updated binary format.