Skip to content

Generate Interactive update streams #402

@szarnyasg

Description

@szarnyasg

For SNB Interactive, updates are continuous and not bound to daily batches. Therefore, inserts and deletes go into files sorted by creationDate/deletionDate (resp.).

For the inserts, each line should define an operation, which necessitates merging all outgoing edges (not just 1-N but also N-M ones) and attributes into the file. E.g. Forum.csv should have the Forum_hasTag_Tag edges merged as tagIds.

These features are currently implemented as Python scripts in https://github.com/ldbc/ldbc_snb_interactive_driver/tree/main/scripts

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions