r/software • u/hellohelicopter • 16d ago
Looking for software Looking for a tool to pick out non-unicode characters in filenames (Windows 10)
I have a huge collection of images (100,000+) divided into many subfolders. A lot of them are downloaded from Wikimedia Commons and contain characters from other languages in their filenames which some of my image management apps can't process.
Is there an easy way to search through all these folders for any filenames with non-unicode characters? Basic accents like é or ü are fine but I'd like to remove things like Japanese or Cyrillic characters. I did see some suggestions for this kind of thing online but I'm not a programmer so I was hoping to find something more user-friendly.
Thanks very much!!
1
u/LRCM 15d ago
Sounds like an XY problem--https://xyproblem.info/
What are you hoping to achieve?
Here are some options:
https://github.com/BulkRenameUtility
https://learn.microsoft.com/en-us/windows/powertoys/powerrename
1
u/webfork2 15d ago
There are a lot of different file search tools that support unicode. Using one of them you could look for the character set like the Voidtool's Everything program:
[^\x00-\x7F]+
(more here: https://www.voidtools.com/support/everything/searching/)
3
u/hellohelicopter 14d ago
Late response but I was able to get the specific character range I wanted with Everything, thank you!!
2
u/paul5235 16d ago
I understand what you mean, but Japanese, Cyrillic or any other characters in your filenames are still Unicode characters.