Once we click EN version, it cannot go back to FR version

Hi all,

My website have two languages FR(default) and EN.
Once we click EN version, it cannot go back to FR version and still in EN version.
It is happening only for not login users even I have cleaned all cache in these few weeks.
Does anyone know how to solve it? Thank you all.