Platform Development • Re: I created a Python 3 port of UXP out of boredom...

Question is whether something like chardet would work reliably on the small snippets of text the build system sometimes receives from tools.

You could build an ad-hoc test script for that. I've no idea how long/complicated the byte strings would be. Personally I use charset_normalizer in some short scripts that deal with subtitles embedded in media files, but any of those modules mentioned above should do the job. Maybe a thorough test would prove which is most reliable (as in most accurate detection) for the task at hand.

On my system building Pale Moon takes amost three hours so it would be extremely difficult for me to test any changes to the build system in a reasonable manner.

If you need some head start here's a site I just found that deals with chardet and text encoding: link.