dd89901b07
This is preparatory work to read locale extensions. The parser currently enforces that the entire string is consumed. But to parse extensions, parse_unicode_locale_id() will need parse_unicode_language_id() to just stop parsing on the first segment that does not match the language ID grammar. It will also need to know where the parsing stopped. Both of these needs are fulfilled by GenericLexer. The caveat is that we can no longer simply split the parsed string on separator characters. So parse_unicode_language_id() now operates as a small state machine. |
||
|---|---|---|
| .. | ||
| CharacterTypes.cpp | ||
| CharacterTypes.h | ||
| CMakeLists.txt | ||
| Forward.h | ||
| Locale.cpp | ||
| Locale.h | ||