summaryrefslogtreecommitdiff
path: root/decoder
AgeCommit message (Collapse)Author
2010-07-23fixed (NULL-1 < 0) segfault for fsa stateful feature with empty eos stringgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@385 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23sparse_vector use google::dense_hash_map, fsa scan logginggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@383 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23fsa: stateless works, debug sample bigram {Longer,Shorter}ThanPrevgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@375 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23fsa: final features opt. for 0 state, correct left_end when # words = 0graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@374 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-23bottom-up FF from fsa FF - WordPenaltyFsa - needs debugginggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@373 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21disabled TD reserved stuff - debug init assertion latergraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@364 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21tdict TD:: ss se unk and reserved(i)graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@362 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21Score::Clone() via CRTPgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@360 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21vest generate options valgrind fixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@356 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21gzstreamgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@353 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21vest generate options valgrind fixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@352 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-21gzstreamgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@351 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20fabulous string tokenization testedgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@350 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20Fixed major bug with spaces in regex.philblunsom
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@348 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20whining comment about lack of safety in taking address of string[0]graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@347 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20tokenization works. oops.graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@346 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20beautiful (?) low-level tokenization to fix valgrind problem with previous ↵graehl
TD string->Sentence git-svn-id: https://ws10smt.googlecode.com/svn/trunk@345 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20hash.hgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@342 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20google::dense_hash_mapgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@341 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20optional google dense_hash_map, srim vocab (TDICT) as static - may help ↵graehl
valgrind warning? git-svn-id: https://ws10smt.googlecode.com/svn/trunk@339 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20remove duplicate notifygraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@338 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20Score::TimesEquals for vlad-mira, intrusive refcount for Score, shared_ptr ↵graehl
compile fixes for decoder progs git-svn-id: https://ws10smt.googlecode.com/svn/trunk@331 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-20shared_ptr WriteFile and shared impl between read/writegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@330 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19fixed oracle generate, detailed score info with --verbosegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@329 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19shared_ptr for scores. todo: intrusive.graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@327 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19shared_ptr for ReadFile and doc_scorer; init ds to GetOne() in oraclegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@322 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19Changed string delimiter, hope this doesn't screw anything up ... philblunsom
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@316 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-19vest generate --verbosegraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@315 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-18boost cmd line notify(conf) was missinggraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@313 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-17fix compilation problemredpony
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@308 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16small/sparse vector fixesgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@304 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16smallvector templategraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@302 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16small_vectorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@290 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16vest: oracle_loss argument bugfixgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@287 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle refactor, oracle vest directions, sparse_vectorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@280 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle is_nullgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@279 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16disable ill defined operations, add binary + -graehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@278 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle is_nullgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@277 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16oracle directionsgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@276 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16more scale-insensitive creep - will work even if LogVal is using float (1e-6 ↵graehl
of log of cutoff) git-svn-id: https://ws10smt.googlecode.com/svn/trunk@275 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16possibly to replace string storage of state: non-resizable better valarray ↵graehl
compatible with vector git-svn-id: https://ws10smt.googlecode.com/svn/trunk@274 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-16refactor vest mapper input; --optimize_feature (s) should now limit ↵graehl
non-oracle directions git-svn-id: https://ws10smt.googlecode.com/svn/trunk@273 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15Fix bug in Density/BeamPruneInsideOutsideadam.d.lopez
-only affected code calling these (legacy) functions, which have been refactored. -DensityPIO implemented BeamPIO and vice versa. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@266 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15move kbest to oracle_bleugraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@262 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15fsa model sketchgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@260 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15oracle bleu refactorgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@259 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15typedefgraehl
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@258 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-15cdec parameter name changevladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@256 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-14Added oracle forest rescoringvladimir.eidelman
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@254 ec762483-ff6d-05da-a07a-a48fb63a330f
2010-07-13cdec now supports coarse-to-fine decoding (for SCFG only).adam.d.lopez
CTF has several options: -coarse_to_fine_beam_prune=<double> (required to activate CTF) assign an alpha parameter for pruning the coarse foreast -ctf_beam_widen=<double> (optional, defaults to 2.0): ratio to widen coarse pruning beam if fine parse fails. -ctf_num_widenings=<int> (optional, defaults to 2): number of times to widen coarse beam before defaulting to exhaustive source parsing -ctf_no_exhaustive (optional) do not attempt exhaustive parse if CTF fails to find a parse. Additionally, script extools/coarsen_grammar.pl will create a coarse-to-fine grammar (for X?? categories *only*). cdec will read CTF grammars in a format identical to the original, in which refinements of a rule immediately follow the coarse projection, preceded by an additional whitespace character. Not fully tested, but should be backwards compatible. Also not yet integrated into pipelines, but should work on the command line. git-svn-id: https://ws10smt.googlecode.com/svn/trunk@231 ec762483-ff6d-05da-a07a-a48fb63a330f