diff options
| -rw-r--r-- | phrasinator/README | 16 |
1 files changed, 16 insertions, 0 deletions
diff --git a/phrasinator/README b/phrasinator/README new file mode 100644 index 00000000..fb5b93ef --- /dev/null +++ b/phrasinator/README @@ -0,0 +1,16 @@ +The "phrasinator" uses a simple Bayesian nonparametric model to segment +text into chunks. The inferred model is then saved so that it can rapidly +predict segments in new (but related) texts. + + Input will be a corpus of sentences, e.g.: + + economists have argued that real interest rates have fallen . + + The output will be a model that, when run with cdec, will produce + a segmentation into phrasal units, e.g.: + + economists have argued that real_interest_rates have fallen . + + +To train a model, run ./train-phrasinator.pl and follow instructions. + |