summaryrefslogtreecommitdiff
path: root/decoder
AgeCommit message (Collapse)Author
2010-08-02inside_outsidegraehl@gmail.com
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@468 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-08-02disable undefined token to stringgraehl@gmail.com
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@467 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-08-02fake tdict names for non-ids, push viterbi cost to root in hg, store as ↵graehl@gmail.com
feature. type erased fsa feature via virtual interface. made lexical_cast assume C locale for speed. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@465 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-31shorten_left commentgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@464 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-31definegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@462 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-28debugging print - still no idea on .05% difference scoring 3gram using phrasesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@446 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-28fsa lm phrase mystery remains, but bool fsa::simple_phrase_score indicates ↵graehl
whether stateless features should copy phrases from rules (e.g. unigram lm) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@444 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27disable fsa lm phrase due to slight (.05%) diff in scores - solve it latergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@434 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27set fsa features() properlygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@433 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27sample fsa ffs compilegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@432 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27fsa feature templated Accum interface, phrase interface allows exceeding ↵graehl
markov order e.g. unigram state, 3gram lm. use Accum,set_value rather than clear,add_value. warning: 3gram fsa lm disagrees with bottom-up in 4th decimal place git-svn-id: https://ws10smt.googlecode.com/svn/trunk@431 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26kbest compilegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@427 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26cpbin sentserver too (dep used by parallelize.plgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@425 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26fix name collisionredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@423 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26comment cleanupgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@421 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26include contextBOW prob when shortening contextgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@418 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26shorten fsa lm state using contextIDgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@415 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26LanguageModelFsa works. TODO: sri context shortening?graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@414 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-26stateful ff_from_fsa works - fixed bug that never moved right state from ↵graehl
rightmost variable up to result git-svn-id: https://ws10smt.googlecode.com/svn/trunk@413 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25USE_INFO_EDGE 0 includegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@412 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25USE_INFO_EDGE works for exh, cubegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@411 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25being ensuring edge debug info is copied when apply_models - new hg.AddEdge ↵graehl
methods git-svn-id: https://ws10smt.googlecode.com/svn/trunk@409 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25fixed CreateViterbiHypergraph (old impl did not work), so --show_derivation ↵graehl
works git-svn-id: https://ws10smt.googlecode.com/svn/trunk@408 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25more comprehensible (but untested) edge/node filtering, awesome per-edge ↵graehl
debugging streams git-svn-id: https://ws10smt.googlecode.com/svn/trunk@407 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25method that might help phil compile his local stuff (trunk was fine)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@406 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25cleaned up kbest, new USE_INFO_EDGE 1 logs per edge, --show_derivation ↵graehl
(needs work; handle kbest deriv, viterbi deriv, sort hg exposing viterbi?) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@405 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25defer to subclass Scan1graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@403 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-24compilegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@400 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-24FSA: simpler Scan1 ScanT1 methods, otherewise also expose edge to full Scangraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@399 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-24sparse_vector non-const [], consistently use default ctor, operator bool ↵graehl
instead of explicit 0 git-svn-id: https://ws10smt.googlecode.com/svn/trunk@398 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-24minor - disable hash sparse_vector for nowgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@396 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23deterministic FF_FSA debug in constructorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@395 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23strip debug param from feature spec; debug info on from_fsa Initgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@394 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23strip debug param from feature spec; debug info on from_fsa Initgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@393 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23comment about unary (1 var) goal rule having no target terminals - seems to ↵graehl
be assumed git-svn-id: https://ws10smt.googlecode.com/svn/trunk@392 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23prettiergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@391 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23prettygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@390 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23prettygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@389 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23more FF_FSA_DEBUG logsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@388 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23implicit first param to ffs: "debug". fsa final traversal set feature=0 ↵graehl
first. set FF_FSA_DEBUG (also FSA_DEBUG). git-svn-id: https://ws10smt.googlecode.com/svn/trunk@387 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23fixed (NULL-1 < 0) segfault for fsa stateful feature with empty eos stringgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@385 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23sparse_vector use google::dense_hash_map, fsa scan logginggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@383 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23fsa: stateless works, debug sample bigram {Longer,Shorter}ThanPrevgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@375 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23fsa: final features opt. for 0 state, correct left_end when # words = 0graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@374 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23bottom-up FF from fsa FF - WordPenaltyFsa - needs debugginggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@373 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21disabled TD reserved stuff - debug init assertion latergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@364 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21tdict TD:: ss se unk and reserved(i)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@362 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21Score::Clone() via CRTPgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@360 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21vest generate options valgrind fixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@356 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21gzstreamgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@353 ec762483-ff6d-05da-a07a-a48fb63a330f