diff options
| author | redpony <redpony@ec762483-ff6d-05da-a07a-a48fb63a330f> | 2010-06-22 05:12:27 +0000 |
|---|---|---|
| committer | redpony <redpony@ec762483-ff6d-05da-a07a-a48fb63a330f> | 2010-06-22 05:12:27 +0000 |
| commit | 0172721855098ca02b207231a654dffa5e4eb1c9 (patch) | |
| tree | 8069c3a62e2d72bd64a2cdeee9724b2679c8a56b /extools/README | |
| parent | 37728b8be4d0b3df9da81fdda2198ff55b4b2d91 (diff) | |
initial checkin
git-svn-id: https://ws10smt.googlecode.com/svn/trunk@2 ec762483-ff6d-05da-a07a-a48fb63a330f
Diffstat (limited to 'extools/README')
| -rw-r--r-- | extools/README | 32 |
1 files changed, 32 insertions, 0 deletions
diff --git a/extools/README b/extools/README new file mode 100644 index 00000000..af91ce79 --- /dev/null +++ b/extools/README @@ -0,0 +1,32 @@ + +Categories have the format i-j:CAT where i and j are the indices of the spaces +between words in the TARGET language. For example, slash categories can be written: + + the blue house + 0-1:DT 1-2:JJ 2-3:NN 1-3:NBAR 0-2:NP/NN 0-3:NP + + +You may multiply label each span, e.g. + + NP + | + NBAR + | + NN + | + John + 0-1:NP 0-1:NBAR 0-1:NP + +However, this may result in a very large number of rules being extracted. + + +**** +* Filtering and Scoring of Unscored and Unfiltered Grammars +**** + +Take the unfiltered grammar, and a test set, and run: +./filter_grammar <test set> < unfiltered.grammar > filter.grammar + +Then, to score the new filtered grammar, run: +./score_grammar <alignment> < filtered.grammar > scored.grammar + |