Code

File Streaming#273

Code

Draft

ranjan-stha wants to merge 8 commits intoproject/historical-gdacs-pdcIFRCGo/montandon-etl:project/historical-gdacs-pdcfrom

feature/file-streamingIFRCGo/montandon-etl:feature/file-streamingCopy head branch name to clipboard

Commits

Commits on May 23, 2025

• add file as input inplace of data in transformer

  

  Rup-Narayan-Rajbanshi

  authored and

  ranjan-stha

  committed
  a8f12ea

  Copy full SHA for a8f12ea

• change input data fromat for emdat transformer to accept file

  

  Rup-Narayan-Rajbanshi

  authored and

  ranjan-stha

  committed
  7fb0bb6

  Copy full SHA for 7fb0bb6

• Add ijson library and jq tool

  ranjan-stha

  committed
  e6164c1

  Copy full SHA for e6164c1

• Refactor Data source for the IDUDataSourceV2

  Show description for 82eaecc
  ranjan-stha

  committed
  82eaecc

  Copy full SHA for 82eaecc

Commits on May 26, 2025

• send file as input for glide transformer.

  Show description for 6fb4fe3
  

  Rup-Narayan-Rajbanshi

  authored and

  ranjan-stha

  committed
  6fb4fe3

  Copy full SHA for 6fb4fe3

Commits on May 29, 2025

• send file as input for glide transformer.

  Show description for d342d5b
  Rup-Narayan-Rajbanshi

  committed
  d342d5b

  Copy full SHA for d342d5b

• Change data format for glide to accept file and memory data.

  Rup-Narayan-Rajbanshi

  committed
  b7a4945

  Copy full SHA for b7a4945

• Merge pull request #276 from IFRCGo/feature/multiple-file-as-input-gdacs-transformer

  Show description for 6e9fc50
  ranjan-stha

  authored
  6e9fc50

  Copy full SHA for 6e9fc50