From 22bd86752547180089cd0c8c9daf0ed9dd32f462 Mon Sep 17 00:00:00 2001 From: "graehl@gmail.com" Date: Mon, 2 Aug 2010 07:58:39 +0000 Subject: oracle search direction experiment - no benefit or harm git-svn-id: https://ws10smt.googlecode.com/svn/trunk@466 ec762483-ff6d-05da-a07a-a48fb63a330f --- report/vest_mira_hope_direction/README | 14 ++++++++++++++ 1 file changed, 14 insertions(+) (limited to 'report/vest_mira_hope_direction') diff --git a/report/vest_mira_hope_direction/README b/report/vest_mira_hope_direction/README index c3641f4c..44dccc6f 100644 --- a/report/vest_mira_hope_direction/README +++ b/report/vest_mira_hope_direction/README @@ -7,3 +7,17 @@ dev.bleu.baseline.txt - usual search directions (orth+random) dev.bleu.oracle_mira_direction.txt - as above, but fewer random directions, 10 model->hope directions note that the search directions are recomputed after each MERT iteration. + +/home/jgraehl/tune/urdu/vest-dth-oracle* + +~/tune/urdu$ ls -d vest-dth* +vest-dth vest-dth-oracle vest-dth-oracle-bleuwt=0.1 vest-dth-oracle-bleuwt=10 vest-dth-oracle-bleuwt=100 + +oraclewt devtest-estimated-BLEU +0 22.01 (orth. dirs, 10 random dirs) +0.1 22.13 (orth. dirs, 10+10 model->hope and fear->hope random directions, 5 purely random dirs) +1 22.06 " +10 21.85 " +100 22.08 " + +no evidence of any advantage using oracle directions (TODO: decode mt09 as test set, check for any advantage when using many features) -- cgit v1.2.3