summaryrefslogtreecommitdiff
path: root/decoder/cdec.cc
AgeCommit message (Collapse)Author
2010-08-07usage for FSA featuresgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@485 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-08-07dynamic fsa ff, factory for fsa and ff shares code, factory moved to ↵graehl
ff_factory.cc git-svn-id: https://ws10smt.googlecode.com/svn/trunk@483 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-28debugging print - still no idea on .05% difference scoring 3gram using phrasesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@446 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27sample fsa ffs compilegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@432 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-27fsa feature templated Accum interface, phrase interface allows exceeding ↵graehl
markov order e.g. unigram state, 3gram lm. use Accum,set_value rather than clear,add_value. warning: 3gram fsa lm disagrees with bottom-up in 4th decimal place git-svn-id: https://ws10smt.googlecode.com/svn/trunk@431 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25more comprehensible (but untested) edge/node filtering, awesome per-edge ↵graehl
debugging streams git-svn-id: https://ws10smt.googlecode.com/svn/trunk@407 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-25cleaned up kbest, new USE_INFO_EDGE 1 logs per edge, --show_derivation ↵graehl
(needs work; handle kbest deriv, viterbi deriv, sort hg exposing viterbi?) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@405 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23sparse_vector use google::dense_hash_map, fsa scan logginggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@383 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21Score::Clone() via CRTPgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@360 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21gzstreamgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@353 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20remove duplicate notifygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@338 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19shared_ptr for scores. todo: intrusive.graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@327 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-18boost cmd line notify(conf) was missinggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@313 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle refactor, oracle vest directions, sparse_vectorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@280 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle is_nullgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@279 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle directionsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@276 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15move kbest to oracle_bleugraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@262 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15oracle bleu refactorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@259 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15cdec parameter name changevladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@256 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-14Added oracle forest rescoringvladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@254 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13cdec now supports coarse-to-fine decoding (for SCFG only).adam.d.lopez
CTF has several options: -coarse_to_fine_beam_prune=<double> (required to activate CTF) assign an alpha parameter for pruning the coarse foreast -ctf_beam_widen=<double> (optional, defaults to 2.0): ratio to widen coarse pruning beam if fine parse fails. -ctf_num_widenings=<int> (optional, defaults to 2): number of times to widen coarse beam before defaulting to exhaustive source parsing -ctf_no_exhaustive (optional) do not attempt exhaustive parse if CTF fails to find a parse. Additionally, script extools/coarsen_grammar.pl will create a coarse-to-fine grammar (for X?? categories *only*). cdec will read CTF grammars in a format identical to the original, in which refinements of a rule immediately follow the coarse projection, preceded by an additional whitespace character. Not fully tested, but should be backwards compatible. Also not yet integrated into pipelines, but should work on the command line. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@231 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-12inebriated, but sped up inside/outside pruning and made cube poplimit scale ↵graehl
with promise of nodes from previous global pruning, if --promise_power=N for N>0. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@219 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09cdec --compgen bash completions generationgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@199 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09optional max arity param for Arity_N features (no hardcoded max of N=9); ↵graehl
FF::rule_feature() should be true for non-source-span dependent 0-state features. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@196 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09-u Feature short for --usagegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@194 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08feature functions support e.g. --usage=LanguageModel, report feature ids, ↵graehl
warn about duplicate ids, 0-expand weight vector for no segfault, --warn_0_weight, and know their own names to simplify registration git-svn-id: https://ws10smt.googlecode.com/svn/trunk@192 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08warning only on feat dotprod vs. viterbi prob mismatchgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@187 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08miscgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@185 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08--show_featuresgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@184 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-07compute viterbi result once only per node (for best edge)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@182 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06cdec --[prelm_]density_prunegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@150 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05verbose feature info, cdec --keep_prelm_cube_ordergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@142 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05report features used in prelm pruninggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@137 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05report features excluded from prelm pruning because they have stategraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@136 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05exhaustive --prelm_weightsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@127 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-02cdec --prelm_weights wf: rescore forest with 0-state features before ↵graehl
prelm_beam_prune git-svn-id: https://ws10smt.googlecode.com/svn/trunk@123 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-01endlgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@97 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-01factor forest stats (show size post pruning, and portion kept) and cdec ↵graehl
--scale_prune_srclen git-svn-id: https://ws10smt.googlecode.com/svn/trunk@96 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-30timer for just forest rescoringgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@84 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-29add joshua visualization supportredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@69 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-25allow --beam_prune=0graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@26 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-24prune -LM forestgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@25 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-06-22initial checkinredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@2 ec762483-ff6d-05da-a07a-a48fb63a330f