Docker image skips files with special characters in title and tag

[Underduc]

In order to circumvent restrictions of the minim server for my network players, I switched to the UMS.
Native tests on my ThinkPad (P16s with Fedora 44) convinced me.
After packing the latest image (15.7.0) into a container of my QNAP TS-451 NAS, I lost all songs that do not correspond to the German character set (e.g.: 01 17 Hippies - Ton Étrangère.wav) when importing to UMS.
First I thought this is aproblem of my NAS. So I setup a Docker Container on my ThinkPad and got the same error.

Renaming the title of the song doesn't help, I would have to rename the tags as well - this is not realy an option (> 15.000 Songs).

[mik_s]

Could you post your logs (see the section in red above)

It might be your system is not using the UTF-8 character encoding so is ignoring special characters.
I know next to nothing about docker but there may be an option to start up using this.
The logs will show the current configuration if this is the problem.

[Underduc]

Please find the logs attached.

In the meantime i found this link https://stackoverflow.com/questions/511 ... -in-docker

[mik_s]

The logs were very short so did not see any files with special characters.
There was a scan for folder music_wav_test but since they will already be in the database nothing is logged.

Try doing them again but add a folder with the problem files to the shared folders and browse to it on your renderer or in the web UI so I can see how UMS is handling them.

UMS is starting using UTF-8 encoding enabled so it might be a docker option as some suggest in that link.

Code: Select all

 JVM args: --add-modules=jdk.incubator.vector -Dfile.encoding=UTF-8 -Djava.net.preferIPv4Stack=true -Djna.nosys=true 
  Language: English (United States)
  Encoding: UTF-8 | resolved UTF-8 | native ANSI_X3.4-1968 | jnu ANSI_X3.4-1968 | stdout ANSI_X3.4-1968 | stderr ANSI_X3.4-1968

I remember another odd thing that can cause this on Linux.
Some old files can be encoded in ISO-8859-1 even if OS is using UTF-8 as Linux does not update its filesystem on locale change
You can see more about this here

Someone else had a similar problem with Docker but did not post logs files to troubleshoot further.
A recent comment says that the problem is the jnu encoding (yours is ANSI_X3.4-1968) in the container and can be changed with environment variables.

The reason for this behavior is incorrect jnu encoding (ANSI_X3.4-1968 in your example). sun.jnu.encoding charset is used for file paths (check https://openjdk.org/jeps/400), so setting file.encoding isn't enough. In JDK 17 you can't set jnu encoding manually, as it's taken from default system charset. You need to set locales in your container explicitly (both your build and official UMS images rely on ubuntu images, so configuration can be done the same way). Just add the following variables to environment section:
LANG=C.UTF-8
LC_ALL=C.UTF-8

[Underduc]

That's it, at least for the french title.

Adding LANG=C.UTF-8 and LC_ALL=C.UTF-8 as enviironment variables in the create procedure to my Nas-Container-Build was all to do.

Now I will check the complete musicbox.

Thanks a lot for you support.