Missing symbols for Lithuanian language

[vilvoh]

EnternalD has reported a problem with Lithuanian language support at Simutranslator (link) but I think this is related with the font used by Simutrans to represent Lithuanian language.

There is even bigger problems: I manually converted some tabs to utf and copy pasted text from the browser (simple as that). Then I started game. The text was still distorted, but symbols where shown instead question marks. I think there is still problems with font prop-latin2.fnt. But this is a little bit disturbing since Lithuanian language uses some symbols common found in Czech and similar languages. These symbols could easily found in this article:
http://en.wikipedia.org/wiki/Lithuanian_alphabet
All of them are for symbols for special pronunciation of:
a, c, e, i, u, z letters.

The majority of the Lithuanian alphabet is in the Unicode block C0 controls and basic Latin (non accented symbols), and the rest of the Lithuanian alphabet (ąĄčČęĘėĖįĮšŠųŲūŪžŽ) is in the Latin Extended-A.

What could be be the possible solution?

[jonasbb]

I can change the used encoding to UTF-8. Then new texts should work fine.
But I don't know what will happen with existing texts.

I had nothing done with the languages.
Maybe Frank knows more about this?

[Dwachs]

Do I understand right, that the ISo-xx-2 encoding simply does not contain some of the Lithuanian special letters?

Changing the encoding will not help much, as a new font-file is needed to disply the texts inside Simutrans.

[prissi]

I think the current uft-8 file does not contain the Latin 2 codepage. (Albeit this can be changed easily, and should be probably done before next release.)

[vilvoh]

@Dwachs & Prissi: the modification needed may be similiar to this one.

[prissi]

THis was a lot less work, since it concerned only two characters.

EDIT: all available latin-2 characters are now in Unicode (cyr.bdf) font.

[Dwachs]

I think the current uft-8 file does not contain the Latin 2 codepage. (Albeit this can be changed easily, and should be probably done before next release.)

If I understand correctly, the problem is that some Lituanian letters are not contained in the Latin 2 codepage. They need another codepage (Latin-4 or Latin-7),

[prissi]

Thus they can use cyr.bdf. If letters are missing there, we have to draw them to match the overall simutrans font.

EDIT: a more permanent solution would be using freetype for rendiering any OS font to the desired size and use it within simutrans. But I would rahter save this for the next next version.

[Dwachs]

I can look after the missing letters.

[jonasbb]

So if I understand correctlyl:
Changing to UTF-8 would solve the problem? Because all letters are in the UTF-8 font?

[Dwachs]

yes: use the same export mechanism as for all the languages that use cyr.bdf (Russian etc). And change 'PROP_FONT_FILE' to 'cyr.bdf'. Some of the special letters are still missing but will be added soon.

[jonasbb]

So, I cannot change the encoding. The translator does not work at this point.
Frank if you read this: would you change the configuration in the db?

[Dwachs]

I added the missing Lithuanian and Hungarian letters to cyr.bdf. These languages can now be exported as utf8.

[EnternalD]

Thanks a lot for an effort solving the problems !

[Frank]

please test export from Lithuanian and Hungarian



Polish not set a letter list

Romana i think set wrong font file ( prop-latin2.fnt <--> ro_font.fnt )

[EnternalD]

Export works for Lithuanian, waiting nightly with new cyr.bdf.

[Dwachs]

You have to download the zip file 'incl history and logs', which contains also the fonts.

Edit: If you do not like some letters feel free to post improved versions of the font.

[Frank]

You have to download the zip file 'incl history and logs', which contains also the fonts.

Edit: If you do not like some letters feel free to post improved versions of the font.

simple way see attached graphics

[EnternalD]

I'm still testing font, I think it was nicelly done. Well only think left is to set utf -8 for all files not only base texts. A few thinks were not good, when I will tune font and test it I will post on this board.

[EnternalD]

A  little mod of font with some letter height. Everything else I think is working.

[Dwachs]

Thank you, your changes are incorporated.

Well only think left is to set utf -8 for all files not only base texts. A few thinks were not good, when I will tune font and test it I will post on this board.

What things do you mean?

[EnternalD]

Well coding of text files has been changed to utf-8 only for base texts lt.tab. Pak and pak128 translations and probably some others still appears to be stored in the latin2 (ISO 2). At least  changes in database still has no effect on export, in example:
with wordwithltletters saved in pak's lt.tab,
I export text and it seems that these symbols are lost. Various text editors say that it is not Utf-8.  Same as before.
Only tab file with base translations had been changed to incorporate utf-8 encoding properly.
Encoding change was local not global in translator for lithuanian language.

[Frank]

changed a item and then export the text

export files cached, no changed no new export