summaryrefslogtreecommitdiff
path: root/decoder
AgeCommit message (Collapse)Author
2010-07-15oracle bleu refactorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@259 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15typedefgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@258 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15cdec parameter name changevladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@256 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-14Added oracle forest rescoringvladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@254 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13cdec now supports coarse-to-fine decoding (for SCFG only).adam.d.lopez
CTF has several options: -coarse_to_fine_beam_prune=<double> (required to activate CTF) assign an alpha parameter for pruning the coarse foreast -ctf_beam_widen=<double> (optional, defaults to 2.0): ratio to widen coarse pruning beam if fine parse fails. -ctf_num_widenings=<int> (optional, defaults to 2): number of times to widen coarse beam before defaulting to exhaustive source parsing -ctf_no_exhaustive (optional) do not attempt exhaustive parse if CTF fails to find a parse. Additionally, script extools/coarsen_grammar.pl will create a coarse-to-fine grammar (for X?? categories *only*). cdec will read CTF grammars in a format identical to the original, in which refinements of a rule immediately follow the coarse projection, preceded by an additional whitespace character. Not fully tested, but should be backwards compatible. Also not yet integrated into pipelines, but should work on the command line. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@231 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13randomgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@230 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13Tanimoto coeff fixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@228 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13vest: combine over-similar search directions, exclude primary directions, ↵graehl
skeleton for oracle directions git-svn-id: https://ws10smt.googlecode.com/svn/trunk@227 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-12DEBUG_PROMISE - looks okgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@220 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-12inebriated, but sped up inside/outside pruning and made cube poplimit scale ↵graehl
with promise of nodes from previous global pruning, if --promise_power=N for N>0. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@219 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09cdec --compgen bash completions generationgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@199 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09warn 0 fid if warn 0 wtgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@197 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09optional max arity param for Arity_N features (no hardcoded max of N=9); ↵graehl
FF::rule_feature() should be true for non-source-span dependent 0-state features. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@196 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09exhaustive rather than cube, if ModelSet is statelessgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@195 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09-u Feature short for --usagegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@194 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08feature functions support e.g. --usage=LanguageModel, report feature ids, ↵graehl
warn about duplicate ids, 0-expand weight vector for no segfault, --warn_0_weight, and know their own names to simplify registration git-svn-id: https://ws10smt.googlecode.com/svn/trunk@192 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08compilegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@188 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08warning only on feat dotprod vs. viterbi prob mismatchgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@187 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08actually use -n feature_name in LanguageModel. FF factory usage facility, ↵graehl
FF feature ids facility (not used yet) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@186 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08miscgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@185 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08--show_featuresgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@184 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-07compute viterbi result once only per node (for best edge)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@182 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-07safe hg pruning without needing additional inside reachability pass (max ↵graehl
margin tightness is less at bottom of derivation tree) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@181 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-07getgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@172 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06commentgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@171 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06warningsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@168 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06prune epsilon, comments, use inside pruning for probably no segfaults in vestgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@167 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06Boolean semiringgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@166 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06hg density prune epsilon workaround comment - fundamental bug probably still ↵graehl
exists git-svn-id: https://ws10smt.googlecode.com/svn/trunk@162 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06epsilon distance for pruning - should alter densitygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@159 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06log density prunegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@152 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06cdec --[prelm_]density_prunegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@150 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-06finish ff_lm checkingraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@147 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-050 size 1gram lm worksgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@144 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-050 bytes state for -o 1 (1gram)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@143 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05verbose feature info, cdec --keep_prelm_cube_ordergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@142 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05report features used in prelm pruninggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@137 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05report features excluded from prelm pruning because they have stategraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@136 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05lm spec verify order>0 and filename givengraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@134 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05comment unused var names, todograehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@133 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05reuse of same-filename Ngram objects (caveat: lifetime is up to you)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@132 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05TODO (mostly low priority) notesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@128 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-05exhaustive --prelm_weightsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@127 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-02cdec --prelm_weights wf: rescore forest with 0-state features before ↵graehl
prelm_beam_prune git-svn-id: https://ws10smt.googlecode.com/svn/trunk@123 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-02filter and score in a single fileredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@118 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-02deal with samt catsredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@101 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-02sort / filter rules by p(e|f), permit more featuresredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@100 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-01endlgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@97 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-01factor forest stats (show size post pruning, and portion kept) and cdec ↵graehl
--scale_prune_srclen git-svn-id: https://ws10smt.googlecode.com/svn/trunk@96 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-01docsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@92 ec762483-ff6d-05da-a07a-a48fb63a330f