diff options
| author | Kenneth Heafield <github@kheafield.com> | 2011-10-24 18:17:24 +0100 |
|---|---|---|
| committer | Kenneth Heafield <github@kheafield.com> | 2011-10-24 18:17:24 +0100 |
| commit | 3106cf8eca76df8b46d139b8f5ce5002200d660d (patch) | |
| tree | 637930011a082de54bf21a97078cb67483ea248c /training | |
| parent | b2171f53c6c597ac4326f63250269aa13df84718 (diff) | |
KenLM update. EnumerateVocab moved up a namespace. Fix trie building when bigrams are pruned. Make Chris feel better about MurmurHashNative.
Diffstat (limited to 'training')
| -rw-r--r-- | training/augment_grammar.cc | 2 | ||||
| -rw-r--r-- | training/test_ngram.cc | 2 |
2 files changed, 2 insertions, 2 deletions
diff --git a/training/augment_grammar.cc b/training/augment_grammar.cc index e89a92d5..1e5af9a1 100644 --- a/training/augment_grammar.cc +++ b/training/augment_grammar.cc @@ -18,7 +18,7 @@ using namespace std; vector<lm::WordIndex> word_map; lm::ngram::ProbingModel* ngram; -struct VMapper : public lm::ngram::EnumerateVocab { +struct VMapper : public lm::EnumerateVocab { VMapper(vector<lm::WordIndex>* out) : out_(out), kLM_UNKNOWN_TOKEN(0) { out_->clear(); } void Add(lm::WordIndex index, const StringPiece &str) { const WordID cdec_id = TD::Convert(str.as_string()); diff --git a/training/test_ngram.cc b/training/test_ngram.cc index c481b564..4597cc01 100644 --- a/training/test_ngram.cc +++ b/training/test_ngram.cc @@ -12,7 +12,7 @@ namespace po = boost::program_options; using namespace std; lm::ngram::ProbingModel* ngram; -struct GetVocab : public lm::ngram::EnumerateVocab { +struct GetVocab : public lm::EnumerateVocab { GetVocab(vector<lm::WordIndex>* out) : out_(out) { } void Add(lm::WordIndex index, const StringPiece &str) { out_->push_back(index); |