summaryrefslogtreecommitdiff
path: root/report
diff options
context:
space:
mode:
authorgraehl@gmail.com <graehl@gmail.com@ec762483-ff6d-05da-a07a-a48fb63a330f>2010-08-02 07:58:39 +0000
committergraehl@gmail.com <graehl@gmail.com@ec762483-ff6d-05da-a07a-a48fb63a330f>2010-08-02 07:58:39 +0000
commit22bd86752547180089cd0c8c9daf0ed9dd32f462 (patch)
tree39f894d88452a0643b48087f82bec195bfcaaaad /report
parentf9859ad4116733e145d7b8eb31c3cc9318ff7564 (diff)
oracle search direction experiment - no benefit or harm
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@466 ec762483-ff6d-05da-a07a-a48fb63a330f
Diffstat (limited to 'report')
-rw-r--r--report/vest_mira_hope_direction/README14
1 files changed, 14 insertions, 0 deletions
diff --git a/report/vest_mira_hope_direction/README b/report/vest_mira_hope_direction/README
index c3641f4c..44dccc6f 100644
--- a/report/vest_mira_hope_direction/README
+++ b/report/vest_mira_hope_direction/README
@@ -7,3 +7,17 @@ dev.bleu.baseline.txt - usual search directions (orth+random)
dev.bleu.oracle_mira_direction.txt - as above, but fewer random directions, 10 model->hope directions
note that the search directions are recomputed after each MERT iteration.
+
+/home/jgraehl/tune/urdu/vest-dth-oracle*
+
+~/tune/urdu$ ls -d vest-dth*
+vest-dth vest-dth-oracle vest-dth-oracle-bleuwt=0.1 vest-dth-oracle-bleuwt=10 vest-dth-oracle-bleuwt=100
+
+oraclewt devtest-estimated-BLEU
+0 22.01 (orth. dirs, 10 random dirs)
+0.1 22.13 (orth. dirs, 10+10 model->hope and fear->hope random directions, 5 purely random dirs)
+1 22.06 "
+10 21.85 "
+100 22.08 "
+
+no evidence of any advantage using oracle directions (TODO: decode mt09 as test set, check for any advantage when using many features)