diff options
Diffstat (limited to 'extools/README')
| -rw-r--r-- | extools/README | 32 |
1 files changed, 32 insertions, 0 deletions
diff --git a/extools/README b/extools/README new file mode 100644 index 00000000..af91ce79 --- /dev/null +++ b/extools/README @@ -0,0 +1,32 @@ + +Categories have the format i-j:CAT where i and j are the indices of the spaces +between words in the TARGET language. For example, slash categories can be written: + + the blue house + 0-1:DT 1-2:JJ 2-3:NN 1-3:NBAR 0-2:NP/NN 0-3:NP + + +You may multiply label each span, e.g. + + NP + | + NBAR + | + NN + | + John + 0-1:NP 0-1:NBAR 0-1:NP + +However, this may result in a very large number of rules being extracted. + + +**** +* Filtering and Scoring of Unscored and Unfiltered Grammars +**** + +Take the unfiltered grammar, and a test set, and run: +./filter_grammar <test set> < unfiltered.grammar > filter.grammar + +Then, to score the new filtered grammar, run: +./score_grammar <alignment> < filtered.grammar > scored.grammar + |