summaryrefslogtreecommitdiff
path: root/decoder
AgeCommit message (Collapse)Author
2010-07-20tokenization works. oops.graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@346 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20beautiful (?) low-level tokenization to fix valgrind problem with previous ↵graehl
TD string->Sentence git-svn-id: https://ws10smt.googlecode.com/svn/trunk@345 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20hash.hgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@342 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20google::dense_hash_mapgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@341 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20optional google dense_hash_map, srim vocab (TDICT) as static - may help ↵graehl
valgrind warning? git-svn-id: https://ws10smt.googlecode.com/svn/trunk@339 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20remove duplicate notifygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@338 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20Score::TimesEquals for vlad-mira, intrusive refcount for Score, shared_ptr ↵graehl
compile fixes for decoder progs git-svn-id: https://ws10smt.googlecode.com/svn/trunk@331 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20shared_ptr WriteFile and shared impl between read/writegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@330 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19fixed oracle generate, detailed score info with --verbosegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@329 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19shared_ptr for scores. todo: intrusive.graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@327 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19shared_ptr for ReadFile and doc_scorer; init ds to GetOne() in oraclegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@322 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19Changed string delimiter, hope this doesn't screw anything up ... philblunsom
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@316 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19vest generate --verbosegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@315 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-18boost cmd line notify(conf) was missinggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@313 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-17fix compilation problemredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@308 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16small/sparse vector fixesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@304 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16smallvector templategraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@302 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16small_vectorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@290 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16vest: oracle_loss argument bugfixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@287 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle refactor, oracle vest directions, sparse_vectorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@280 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle is_nullgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@279 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16disable ill defined operations, add binary + -graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@278 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle is_nullgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@277 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle directionsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@276 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16more scale-insensitive creep - will work even if LogVal is using float (1e-6 ↵graehl
of log of cutoff) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@275 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16possibly to replace string storage of state: non-resizable better valarray ↵graehl
compatible with vector git-svn-id: https://ws10smt.googlecode.com/svn/trunk@274 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16refactor vest mapper input; --optimize_feature (s) should now limit ↵graehl
non-oracle directions git-svn-id: https://ws10smt.googlecode.com/svn/trunk@273 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15Fix bug in Density/BeamPruneInsideOutsideadam.d.lopez
-only affected code calling these (legacy) functions, which have been refactored. -DensityPIO implemented BeamPIO and vice versa. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@266 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15move kbest to oracle_bleugraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@262 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15fsa model sketchgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@260 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15oracle bleu refactorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@259 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15typedefgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@258 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15cdec parameter name changevladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@256 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-14Added oracle forest rescoringvladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@254 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13cdec now supports coarse-to-fine decoding (for SCFG only).adam.d.lopez
CTF has several options: -coarse_to_fine_beam_prune=<double> (required to activate CTF) assign an alpha parameter for pruning the coarse foreast -ctf_beam_widen=<double> (optional, defaults to 2.0): ratio to widen coarse pruning beam if fine parse fails. -ctf_num_widenings=<int> (optional, defaults to 2): number of times to widen coarse beam before defaulting to exhaustive source parsing -ctf_no_exhaustive (optional) do not attempt exhaustive parse if CTF fails to find a parse. Additionally, script extools/coarsen_grammar.pl will create a coarse-to-fine grammar (for X?? categories *only*). cdec will read CTF grammars in a format identical to the original, in which refinements of a rule immediately follow the coarse projection, preceded by an additional whitespace character. Not fully tested, but should be backwards compatible. Also not yet integrated into pipelines, but should work on the command line. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@231 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13randomgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@230 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13Tanimoto coeff fixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@228 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13vest: combine over-similar search directions, exclude primary directions, ↵graehl
skeleton for oracle directions git-svn-id: https://ws10smt.googlecode.com/svn/trunk@227 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-12DEBUG_PROMISE - looks okgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@220 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-12inebriated, but sped up inside/outside pruning and made cube poplimit scale ↵graehl
with promise of nodes from previous global pruning, if --promise_power=N for N>0. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@219 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09cdec --compgen bash completions generationgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@199 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09warn 0 fid if warn 0 wtgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@197 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09optional max arity param for Arity_N features (no hardcoded max of N=9); ↵graehl
FF::rule_feature() should be true for non-source-span dependent 0-state features. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@196 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09exhaustive rather than cube, if ModelSet is statelessgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@195 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-09-u Feature short for --usagegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@194 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08feature functions support e.g. --usage=LanguageModel, report feature ids, ↵graehl
warn about duplicate ids, 0-expand weight vector for no segfault, --warn_0_weight, and know their own names to simplify registration git-svn-id: https://ws10smt.googlecode.com/svn/trunk@192 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08compilegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@188 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08warning only on feat dotprod vs. viterbi prob mismatchgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@187 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08actually use -n feature_name in LanguageModel. FF factory usage facility, ↵graehl
FF feature ids facility (not used yet) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@186 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-08miscgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@185 ec762483-ff6d-05da-a07a-a48fb63a330f