summaryrefslogtreecommitdiff
path: root/report/prune_results/README
diff options
context:
space:
mode:
authorgraehl <graehl@ec762483-ff6d-05da-a07a-a48fb63a330f>2010-07-28 08:26:10 +0000
committergraehl <graehl@ec762483-ff6d-05da-a07a-a48fb63a330f>2010-07-28 08:26:10 +0000
commit76272dba984264776ca4d68d3a50a032c48aa606 (patch)
tree7be443aaa70e3a668b10dffd8e7ce92eb8712163 /report/prune_results/README
parent94aa07e6f1a149942e709b5f3e01b51071d99402 (diff)
oracle prune graph data under 3 1st-pass tuning conditions
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@449 ec762483-ff6d-05da-a07a-a48fb63a330f
Diffstat (limited to 'report/prune_results/README')
-rw-r--r--report/prune_results/README21
1 files changed, 21 insertions, 0 deletions
diff --git a/report/prune_results/README b/report/prune_results/README
new file mode 100644
index 00000000..d448ce10
--- /dev/null
+++ b/report/prune_results/README
@@ -0,0 +1,21 @@
+tuned on urdu baselines (hiero) devtest, test on mt09
+
+hdt: single pass (no pruning of -LM forest). these weights were used for the
+final +LM rescoring in all cases. (tune BLEU 22.2)
+
+2pass-hdt: 1st pass weights same as final weights (bad) (tune BLEU ???)
+
+2pass-hdt0: 1st pass weights tuned without any lm (same final weights as hdt). (tune BLEU 14.7)
+
+2pass-hdt1: 1st pass weights tuned with unigram lm (same final). (tune BLEU 16.2)
+
+data files / graphs: 2nd column is BLEU
+
+2pass-hdt - first column is beam alpha scaled per source word.
+
+times.2pass-hdt - first column is +LM rescoring time
+
+space.2pass-hdt - first column is portion of -LM forest edges kept
+
+It would be nice to graph these with the same scale, or preferably as 3 lines in
+the same graph.