summaryrefslogtreecommitdiff
path: root/report/vest_mira_hope_direction/README
diff options
context:
space:
mode:
authorChris Dyer <cdyer@cs.cmu.edu>2010-12-22 08:58:07 -0600
committerChris Dyer <cdyer@cs.cmu.edu>2010-12-22 08:58:07 -0600
commitb5ca2bd7001a385594af8dc4b9206399c679f8c5 (patch)
tree332cb09a27f783760532e688e14bde21a128bb2b /report/vest_mira_hope_direction/README
parent86805dcb8aaaa716fdc73725ad41e411be53f6a6 (diff)
remove report
Diffstat (limited to 'report/vest_mira_hope_direction/README')
-rw-r--r--report/vest_mira_hope_direction/README23
1 files changed, 0 insertions, 23 deletions
diff --git a/report/vest_mira_hope_direction/README b/report/vest_mira_hope_direction/README
deleted file mode 100644
index 44dccc6f..00000000
--- a/report/vest_mira_hope_direction/README
+++ /dev/null
@@ -1,23 +0,0 @@
-First column = tune iteration, second column = tune BLEU
-
-Choosing the average of a few random sentence's model->hope direction, With Vlad's default --bleu_weight=1, nothing improved, and convergenced seemed to be slower, which is the opposite of what we intended. 5 random directions and the orthogonal directions were still used (fewer than normal random directions; the oracle directions replaced some of them).
-
-dev.bleu.baseline.txt - usual search directions (orth+random)
-
-dev.bleu.oracle_mira_direction.txt - as above, but fewer random directions, 10 model->hope directions
-
-note that the search directions are recomputed after each MERT iteration.
-
-/home/jgraehl/tune/urdu/vest-dth-oracle*
-
-~/tune/urdu$ ls -d vest-dth*
-vest-dth vest-dth-oracle vest-dth-oracle-bleuwt=0.1 vest-dth-oracle-bleuwt=10 vest-dth-oracle-bleuwt=100
-
-oraclewt devtest-estimated-BLEU
-0 22.01 (orth. dirs, 10 random dirs)
-0.1 22.13 (orth. dirs, 10+10 model->hope and fear->hope random directions, 5 purely random dirs)
-1 22.06 "
-10 21.85 "
-100 22.08 "
-
-no evidence of any advantage using oracle directions (TODO: decode mt09 as test set, check for any advantage when using many features)