What error do you get when you try to change it later?
I don't think there's an English-only installer, but I believe you can change the language on the first page of the installer itself, when you click on the name of the language. Or, if you can understand the non-English language, you can choose a custom install and change the default language module installed.
Btw, what language does the installer start in? Does it correspond to the regional settings of your OS?