if you change the language and open up a new portal session in a new browser session -- are the apploicatons displayed as expected?
if so, you will need to adjust your language-change-logic to also end the portal session. (The user will get a new session immediately, as the user is anonymous) but you may need to take into account, whethere there are unsaved changes in the currently open application