Normalizes utterances by stripping quotes, trailing punctuation, normalization (numeric substitutions, expanded contractions), and removing articles. Original utterances are preserved and returned utterances are returned in order:
- No Punctuation, Normalized
- No Punctuation, Normalized, Removed Articles
- No Punctuation
- Original Utterances
Wrapping
"
symbols are removed from all normalized strings
This plugin can be enabled and configured as described below. By default, all normalization is completed.
utterance_transformers:
neon_utterance_normalizer_plugin:
remove_punctuation: True
remove_articles: False