Handling of dialect markers from CW (ý)

[fbanados]

ý characters are used in CW to denote a sound that change between different Cree dialects. For itwewina, these must be changed to y. We need a more consistent and future-proof way of handling these both in the crk-db repo and in morphodict.

See also #44, #30, #68, UAlbertaALTLab/morphodict#929, UAlbertaALTLab/morphodict#649, UAlbertaALTLab/morphodict#197, UAlbertaALTLab/morphodict#255,
UAlbertaALTLab/morphodict#96 (comment)
UAlbertaALTLab/itwewina#104 (comment),

crk-db/lib/convert/CW.js

Line 48 in 9278ba4

function proto2sro(string) {

,

• Ensure generation process currently replaces ý to y for itwewina morphodict
• Ensure crk-db utilizes correct spellings for merging with AECD (otherwise entries are removed)
• Decide on a future process to handle these characters uniformly

[aarppe]

Here's where this is discussed for the FST side:

giellalt/lang-crk#30

[fbanados]

This issue also affects the merging of entries: e.g. AECD has a yôwênam entry, while CW uses ýowênam. If the merging process does not handle this, definitions are left out.

[fbanados]

Agreement is that the strict analyzer FST should be slightly relaxed to accept ý -> y. Eventually, also the generator FST should generate ý whenever the data used to build the FST supports it (that is, not every y shall become ý). In this way, main entries with ý can preserve the letter in their identifier, and thus itwewina can later implement an option to either show or hide the ý in the presentation.

[aarppe]

We can have an optional conversion of ý (->) y on the analysis side of the strict (normative) analyzing FST.

[fbanados]

I've recompiled the FSTs and these have been deployed to the dev version for testing.

[fbanados]

A pending issue (linguist work) is to ensure that other dictionaries (MD and AECD) are consistently marked with dialect markers when they have no matching entry in CW. A first approach is to collect a list of words that could possibly be misspelled in each dictionary and could have a ý (they have a y), and wait for linguist confirmation of their status.