memory usage on windows

[miyeoni]

Insufficient memory to continue the execution of the program. System.OutOfMemoryException: Insufficient memory to continue the execution of the program.
at System.Runtime.InteropServices.Marshal.AllocHGlobal(IntPtr cb)
at K4os.Compression.LZ4.Streams.Frames.LZ4FrameReader2.ReadHeader(EmptyToken token) at Mutagen.Bethesda.Archives.Bsa.BsaFileRecord.AsStream() at Mutagen.Bethesda.Archives.Bsa.BsaFileRecord.AsStream() at SkyTexOpti.Services.Helpers.BsaHelpers.<>c__DisplayClass0_0.<<GetBsaTask>b__0>d.MoveNext() in /home/runner/work/sky-tex-opti/sky-tex-opti/Helpers/BsaHelpers.cs:line 22 --- End of stack trace from previous location --- at SkyTexOpti.Services.DefaultExclusionService.ExcludeTextures(ICollection1 textures) in /home/runner/work/sky-tex-opti/sky-tex-opti/Services/Exclusion/DefaultExclusionService.cs:line 57
at SkyTexOpti.Services.Program.Run(Options options, ISettingsParserService settingsParserService, IModsLoaderService modsLoaderService, IDiscoveryService discoveryService, IExclusionService exclusionService, IOptimizationService optimizationService) in /home/runner/work/sky-tex-opti/sky-tex-opti/Program.cs:line 101
at CommandLine.ParserResultExtensions.WithParsedAsync[T](ParserResult1 result, Func2 action)
at SkyTexOpti.Services.Program.Main(String[] args) in /home/runner/work/sky-tex-opti/sky-tex-opti/Program.cs:line 14
at SkyTexOpti.Services.Program.

(String[] args)
PS D:\cao\sky-tex-opti_win-x64>

it runs out of my 81.2gb committed memory somehow (i have a lot of pagefiles), is that normal?

[BenHUET]

Hello,

There is a RAM issue stated in the readme, not much I can do on my side. It's from Magick.NET : dlemstra/Magick.NET#1854

You could always run it again with --continue and you'll eventually get to the end of the process.

[nettoneko]

I've just managed to run a pass on a very large list - LoreRim - without OOMing even once! On the previous build I always had to resume at least twice for lists with this many textures.
(100 % - 11,257/11,257 - 00:26:49.1291815) Optimizing textures... Done.

[BenHUET]

That's a great news, are you on linux ? If so, it means the Magick.NET patch actually solved this issue.

I just noticed the OP was OOMing on windows, which should be unrelated to this Magick.NET patch actually...

[nettoneko]

That's a great news, are you on linux ? If so, it means the Magick.NET patch actually solved this issue.

Yes, I am using Linux. I never OOMed with this on Windows, either, so that is confusing.