odenwald/rs, branch masterMirror of https://github.com/pks/odenwald.git
https://git.simianer.de/mirrored/odenwald/atom?h=master2026-02-26T18:28:22ZAdd Rust implementation of SCFG decoder2026-02-26T18:28:22ZPatrick Simianerpatrick@lilt.com2026-02-26T18:28:22Zurn:sha1:0abcdd7e4358cb902c320b008d3c04bde07b749e
Rust port of the Ruby prototype decoder with performance
optimizations for real Hiero-style grammars:
- Rule indexing by first terminal/NT symbol for fast lookup
- Chart symbol interning (u16 IDs) instead of string hashing
- Passive chart index by (symbol, left) for direct right-endpoint lookup
- Items store rule index instead of cloned rule data
Includes CKY+ parser, chart-to-hypergraph conversion, Viterbi
decoding, derivation extraction, and JSON hypergraph I/O.
Self-filling step in parse uses grammar lookup (not just
remaining active items) to handle rules that were consumed
during the parse loop or skipped by the has_any_at optimization.
Produces identical output to the Ruby prototype on all test examples.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>