summaryrefslogtreecommitdiff
path: root/decoder/ff_lm.cc
AgeCommit message (Collapse)Author
2011-03-10remove dependency on SRILMChris Dyer
2010-08-11major refactor, break bad circular depsredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@509 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-08-07propagation of feature name+debug from factory, return correct features ↵graehl
array for fsa ffs git-svn-id: https://ws10smt.googlecode.com/svn/trunk@486 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-08-02fake tdict names for non-ids, push viterbi cost to root in hg, store as ↵graehl@gmail.com
feature. type erased fsa feature via virtual interface. made lexical_cast assume C locale for speed. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@465 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-31definegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@462 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-28debugging print - still no idea on .05% difference scoring 3gram using phrasesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@446 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-28fsa lm phrase mystery remains, but bool fsa::simple_phrase_score indicates ↵graehl
whether stateless features should copy phrases from rules (e.g. unigram lm) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@444 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27set fsa features() properlygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@433 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27fsa feature templated Accum interface, phrase interface allows exceeding ↵graehl
markov order e.g. unigram state, 3gram lm. use Accum,set_value rather than clear,add_value. warning: 3gram fsa lm disagrees with bottom-up in 4th decimal place git-svn-id: https://ws10smt.googlecode.com/svn/trunk@431 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26comment cleanupgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@421 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26include contextBOW prob when shortening contextgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@418 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26shorten fsa lm state using contextIDgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@415 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26LanguageModelFsa works. TODO: sri context shortening?graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@414 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23comment about unary (1 var) goal rule having no target terminals - seems to ↵graehl
be assumed git-svn-id: https://ws10smt.googlecode.com/svn/trunk@392 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23bottom-up FF from fsa FF - WordPenaltyFsa - needs debugginggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@373 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21tdict TD:: ss se unk and reserved(i)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@362 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20optional google dense_hash_map, srim vocab (TDICT) as static - may help ↵graehl
valgrind warning? git-svn-id: https://ws10smt.googlecode.com/svn/trunk@339 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15oracle bleu refactorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@259 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-12DEBUG_PROMISE - looks okgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@220 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08feature functions support e.g. --usage=LanguageModel, report feature ids, ↵graehl
warn about duplicate ids, 0-expand weight vector for no segfault, --warn_0_weight, and know their own names to simplify registration git-svn-id: https://ws10smt.googlecode.com/svn/trunk@192 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08actually use -n feature_name in LanguageModel. FF factory usage facility, ↵graehl
FF feature ids facility (not used yet) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@186 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-07safe hg pruning without needing additional inside reachability pass (max ↵graehl
margin tightness is less at bottom of derivation tree) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@181 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-07getgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@172 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06commentgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@171 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06finish ff_lm checkingraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@147 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-050 size 1gram lm worksgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@144 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-050 bytes state for -o 1 (1gram)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@143 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05lm spec verify order>0 and filename givengraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@134 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05reuse of same-filename Ngram objects (caveat: lifetime is up to you)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@132 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05TODO (mostly low priority) notesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@128 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-01docsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@92 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-22initial checkinredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@2 ec762483-ff6d-05da-a07a-a48fb63a330f