Is the context loaded into VRAM or RAM? Will a 24GB 4090 be able to handle 128K context?

[aimms321]

If the context can only be loaded into VRAM, it undoubtedly severely limits its success

[hb-jw]

Could you tell me if you are able to run the internlm-2.5-1m inference? I can't get it to run.