Age | Commit message (Collapse) | Author |
|
|
|
|
|
|
|
feature detectors create additional features
|
|
|
|
- the linear-chain tagger is more of a proof of concept than a real tagger-- the context-free assumptions made in a number of places mean that the algorithms used may not be as efficient as they could be, but the model is as powerful as any CRF
- it would be easy to add latent variables or semi-CRF support (or both!)
- i've added a couple basic features that are often used for POS tagging
- non-pruning intersection is useful for lexical word alignment models and the tagger
- a sample POS tagger model will be committed later
|
|
for word aligner, final naming of directories, libraries in cdec
|