Can't import files with Japanese/Chinese filenames

Name
Email
Subject
Comment *
File	Select/drop/paste files here
* = required field	[▶ Show post options & limits] Confused? See the FAQ.

Embed	(replaces files and can be used instead)
Options	Do not bump (you can also write sage in the email field) Spoiler images (this replaces the thumbnails of your images with question marks)
Password	(For file and post deletion.)
Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf Max filesize is 8 MB. Max image dimensions are 10000 x 10000. You may upload 5 per post.

File: 1442251864885.png (72.97 KB, 250x250, 1:1, 1304193636861.png)

Can't import files with Japanese/Chinese filenames Anonymous 09/14/15 (Mon) 17:31:04 No.1134

It just fails immediately, I'm guessing the function to open the files can't handle the character set. Python didn't get proper Unicode support until version 3.

If I rename the characters out of the files they import fine. Anything you can do about this?

hydrus_dev ## Board Owner 09/15/15 (Tue) 18:05:01 No.1138

File: 1442340301565.jpg (709.92 KB, 1683x1252, 1683:1252, 522054ef39df9cbf5afec520c4….jpg)

I just tried one on my dev machine and it worked ok, so can you paste your error traceback, if any? Which OS are you using?

Anonymous 09/17/15 (Thu) 02:58:16 No.1145

>>1138

No errors, it just instantly fails and proceeds with the other files in the import. Win 7 x64.

The file I was importing was Matroska, if that matters.

hydrus_dev ## Board Owner 09/20/15 (Sun) 20:45:06 No.1152

File: 1442781906981.jpg (267.11 KB, 1218x1732, 609:866, 056ad1a53a1d5a4f599e67a7bc….jpg)

>>1145

Thank you for the update. The problem is with video and only in Windows. The library I am using can't pass complicated characters to a particular place I need to generate video metadata.

I have moved the step down to a later stage, once the file is copied into the db, at which point it has a normalised filename. This fix will be in next Wednesday's release. Please let me know if you still get any problems.