Skip to content

Bug: v2 Dataset Generation Errors #12

@vincentczhou

Description

@vincentczhou

I've come across a couple errors when generating v2 "mmrs" datasets for training - notably, these errors occurred using source folders containing unranked (graveyard) beatmaps (I was not able to replicate them using source folders containing only ranked beatmaps).

  1. Unhandled exception. System.InvalidOperationException
    The latest beatmap parsed in this run was goreshit - beautiful loli thing.osz
202568 20_11_52_41\2369493 Forestpireo - Gouhou_Mahou Shoujo Hito Yonde! Magical Reimu & Chemical Marisa.osz
202568 20_11_52_41\2369494 WaterTower Music - Steve's Lava Chicken.osz
202568 20_11_52_41\2369499 goreshit - beautiful loli thing.osz
Unhandled exception. System.InvalidOperationException: The requested operation requires an element of type 'Number', but the target element has type 'Null'.
   at System.Text.Json.ThrowHelper.ThrowJsonElementWrongTypeException(JsonTokenType expectedType, JsonTokenType actualType)
   at System.Text.Json.JsonDocument.CheckExpectedType(JsonTokenType expected, JsonTokenType actual)
   at System.Text.Json.JsonDocument.TryGetValue(Int32 index, Int32& value)
   at System.Text.Json.JsonElement.TryGetInt32(Int32& value)
   at System.Text.Json.JsonElement.GetInt32()
   at Mapperator.ConsoleApp.Verbs.Dataset2.ParseBeatmapMetadata(JsonElement beatmapset, JsonElement beatmap)
   at Mapperator.ConsoleApp.Verbs.Dataset2.DoDataExtraction2(DatasetOptions2 args)
   at Mapperator.ConsoleApp.Program.<>c.<Main>b__0_8(DatasetOptions2 opts)
   at CommandLine.ParserResultExtensions.MapResult[T1,T2,T3,T4,T5,T6,T7,T8,T9,TResult](ParserResult`1 result, Func`2 parsedFunc1, Func`2 parsedFunc2, Func`2 parsedFunc3, Func`2 parsedFunc4, Func`2 parsedFunc5, Func`2 parsedFunc6, Func`2 parsedFunc7, Func`2 parsedFunc8, Func`2 parsedFunc9, Func`2 notParsedFunc)
   at Mapperator.ConsoleApp.Program.Main(String[] args)
  1. Unhandled exception. System.IO.InvalidDataException
    The latest beatmap parsed in this run was Sven Noon - S_Unfolding.osz, which is the highest index beatmap ID in the source folder containing the .osz files. Removing this beatmap and rerunning will produce the same error, with the next highest index beatmap ID as the latest beatmap parsed.
202568 20_11_52_41\2369543 Kordhell - Fatality.osz
202568 20_11_52_41\2369561 madk1d feat. CUPSIZE - 1 may.osz
202568 20_11_52_41\2369564 Sven Noon - S_Unfolding.osz
Unhandled exception. System.IO.InvalidDataException: End of Central Directory record could not be found.
   at System.IO.Compression.ZipArchive.ReadEndOfCentralDirectory()
   at System.IO.Compression.ZipArchive..ctor(Stream stream, ZipArchiveMode mode, Boolean leaveOpen, Encoding entryNameEncoding)
   at System.IO.Compression.ZipFile.Open(String archiveFileName, ZipArchiveMode mode, Encoding entryNameEncoding)
   at Mapperator.ConsoleApp.Verbs.Dataset2.FindOszFiles(String rootDirectory)+MoveNext()
   at Mapperator.ConsoleApp.Verbs.Dataset2.DoDataExtraction2(DatasetOptions2 args)
   at Mapperator.ConsoleApp.Program.<>c.<Main>b__0_8(DatasetOptions2 opts)
   at CommandLine.ParserResultExtensions.MapResult[T1,T2,T3,T4,T5,T6,T7,T8,T9,TResult](ParserResult`1 result, Func`2 parsedFunc1, Func`2 parsedFunc2, Func`2 parsedFunc3, Func`2 parsedFunc4, Func`2 parsedFunc5, Func`2 parsedFunc6, Func`2 parsedFunc7, Func`2 parsedFunc8, Func`2 parsedFunc9, Func`2 notParsedFunc)
   at Mapperator.ConsoleApp.Program.Main(String[] args)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions