Skip to content

File pulse connector is unable to skip invalid records and ingest rest of the onix file. #717

@hvinjarapu

Description

@hvinjarapu

Using file pulse connector while reading the xml file having 1000 products, if after ingesting 100 products, connector encounters a inconsistent tag , the file ingestion is stopping and the execution is not returning to process rest of the file even if the other products in the file are good. So, as soon as the first inconsistent tag is encountered, file is moved to error folder and ingestion is stopping.
Back ground : There are tags starting with "<x428>" (most of them) and "<x428 lang="eng">" (25 like this) in the xml file under parent product tag. Due to this discrepancy with same tag being represented in 2 different way, Kafka connector is failing the ingestion of full file.
Can someone please help

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions