Make Language change specific to window/app not whole system (Windows 8.1)

Control Panel - Language - Advanced Settings - Let me set a different input for each app window

Noticing there's no reply re. Windows 10 (which was my problem and the reason I reached this forum), here are the setting to make language input application-specific in Windows 10:

Start > Settings > Time & Language > Region & language > Additional date, time & regional settings > (under Language) Change input methods > Advanced settings > (under switching input methods) Let me set a different input method for each app window

Good job Microsoft, I don't think you could have hid this any better :p

In my Windows 10, I do not have the Change input methods, so here is another flavor to make Windows remember the language input.

Start > Settings > Time & Language > Region & language > Advanced keyboard settings > Let me use a different input method for each app window.

You can simply type "advanced keyboard settings" in the start menu to reach it instantly.

And yet again, new path for latest Windows 10 build 1809:

Start > Settings > Time & Language > Language > Spelling, typings, & keyboard settings > Advanced keyboard settings > Let me use a different input method for each app window

or

Start > Settings > type into search: "Let me use"

A more simple and reliable way on Windows 10, press win key, then input Advanced keyboard settings, it will be shown at the top of Best match group, then click it and select "Let me use ..."