summaryrefslogtreecommitdiff
path: root/decoder/tdict.cc
AgeCommit message (Collapse)Author
2010-08-02disable undefined token to stringgraehl@gmail.com
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@467 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-08-02fake tdict names for non-ids, push viterbi cost to root in hg, store as ↵graehl@gmail.com
feature. type erased fsa feature via virtual interface. made lexical_cast assume C locale for speed. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@465 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27fsa feature templated Accum interface, phrase interface allows exceeding ↵graehl
markov order e.g. unigram state, 3gram lm. use Accum,set_value rather than clear,add_value. warning: 3gram fsa lm disagrees with bottom-up in 4th decimal place git-svn-id: https://ws10smt.googlecode.com/svn/trunk@431 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21disabled TD reserved stuff - debug init assertion latergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@364 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21tdict TD:: ss se unk and reserved(i)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@362 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20tokenization works. oops.graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@346 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20beautiful (?) low-level tokenization to fix valgrind problem with previous ↵graehl
TD string->Sentence git-svn-id: https://ws10smt.googlecode.com/svn/trunk@345 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20optional google dense_hash_map, srim vocab (TDICT) as static - may help ↵graehl
valgrind warning? git-svn-id: https://ws10smt.googlecode.com/svn/trunk@339 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-23use centralized makeredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@11 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-22initial checkinredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@2 ec762483-ff6d-05da-a07a-a48fb63a330f