Like always when inspecting changes some software makes to the system I also had Process Monitor running while doing the changes. So I installed PDF-XChange into a test machine, set the UI language to 'English (Default)' and checked the above mentioned registry value. The problem was that I had no idea what should that value be. So clearly there was a property you could use to set the default language.