Testing large files (over 1GB) in Lichtblick, the system becomes unresponsive or crashes.

[JaplaVikash]

Hey @JaplaVikash,

First of all, thanks for reaching out and for using Lichtblick!
Regarding the issue you're experiencing: Lichtblick does have some known limitations when handling large files, primarily due to the 4GB heap memory cap imposed by the V8 engine it's built on. However, this limitation isn't directly tied to file size alone, we’ve seen cases where multi-gigabyte files (up to 50Gbs) work just fine.
The more common problem tends to be the structure of the file itself. For example, files with a very large number of messages or a high message frequency can cause performance issues, including out-of-memory crashes.

Could you share the message list from your file? You can use the MCAP CLI tool to extract that information. Also if you could share with us more info about your environment that could help us trying to understand what's going wrong. For instance are you using a lot of extensions? How's the layout you use, does it have many 3D panels or Raw Message panels? Could you even share your files with us so we can try to reproduce the problem?

Best regards,
Joao Luis

Originally posted by @ctw-joao-luis in #514

Yes, my file is a 25GB .mcap file, and we want to visualize multiple extensions at once. Can you please explain how to use the MCAP CLI?

[aneuwald-ctw]

Can you share the mcap?

For installing the MCAP CLI, please check this for installation instructions: https://mcap.dev/guides/cli

Then, after installed, run the command mcap info your_file.mcap, it will give you sort of a report that probably you can share with us.

Cheers,
Alex

[aneuwald-ctw]

@JaplaVikash as it is not an issue, I will convert this to a discussion

[carolinabamorim]

hi @JaplaVikash check this PR: #586