diff options
| author | graehl@gmail.com <graehl@gmail.com@ec762483-ff6d-05da-a07a-a48fb63a330f> | 2010-08-02 07:58:39 +0000 |
|---|---|---|
| committer | graehl@gmail.com <graehl@gmail.com@ec762483-ff6d-05da-a07a-a48fb63a330f> | 2010-08-02 07:58:39 +0000 |
| commit | 22bd86752547180089cd0c8c9daf0ed9dd32f462 (patch) | |
| tree | 39f894d88452a0643b48087f82bec195bfcaaaad /report/vest_mira_hope_direction | |
| parent | f9859ad4116733e145d7b8eb31c3cc9318ff7564 (diff) | |
oracle search direction experiment - no benefit or harm
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@466 ec762483-ff6d-05da-a07a-a48fb63a330f
Diffstat (limited to 'report/vest_mira_hope_direction')
| -rw-r--r-- | report/vest_mira_hope_direction/README | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/report/vest_mira_hope_direction/README b/report/vest_mira_hope_direction/README index c3641f4c..44dccc6f 100644 --- a/report/vest_mira_hope_direction/README +++ b/report/vest_mira_hope_direction/README @@ -7,3 +7,17 @@ dev.bleu.baseline.txt - usual search directions (orth+random) dev.bleu.oracle_mira_direction.txt - as above, but fewer random directions, 10 model->hope directions note that the search directions are recomputed after each MERT iteration. + +/home/jgraehl/tune/urdu/vest-dth-oracle* + +~/tune/urdu$ ls -d vest-dth* +vest-dth vest-dth-oracle vest-dth-oracle-bleuwt=0.1 vest-dth-oracle-bleuwt=10 vest-dth-oracle-bleuwt=100 + +oraclewt devtest-estimated-BLEU +0 22.01 (orth. dirs, 10 random dirs) +0.1 22.13 (orth. dirs, 10+10 model->hope and fear->hope random directions, 5 purely random dirs) +1 22.06 " +10 21.85 " +100 22.08 " + +no evidence of any advantage using oracle directions (TODO: decode mt09 as test set, check for any advantage when using many features) |