Project/historical gdacs pdc #248
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Handle historical data for gdacs.
Feature/pdc historical data
Class based for gdacs.
- Split EMDAT historical data extraction - Update helm chart
Use new geocoder - Split EMDAT historical data extraction - Update helm chart
Use new geocoder - Split EMDAT historical data extraction - Update helm chart
Use new geocoder - Split EMDAT historical data extraction - Update helm chart
Use new geocoder - Split EMDAT historical data extraction - Update helm chart
Rup-Narayan-Rajbanshi
force-pushed
the
project/historical-gdacs-pdc
branch
from
7203d7f to
8a99fe0
Compare
Rup-Narayan-Rajbanshi
force-pushed
the
project/historical-gdacs-pdc
branch
from
24dc678 to
bd61008
Compare
Fix emdat historical data.
Remove task_queues (This will be handled by Automatic routing)
- Replace module name with shortname (including parent) - Short datetime
- Add Custom Exception RateLimitError for requests
Rate limit is now under same task
Compact the queue configs
Single request in base class
* Implement structured input schema for file/data for all the sources
Rup-Narayan-Rajbanshi
force-pushed
the
project/historical-gdacs-pdc
branch
from
5491831 to
6aa7014
Compare
Rup-Narayan-Rajbanshi
force-pushed
the
project/historical-gdacs-pdc
branch
from
88b5611 to
4d0b4be
Compare
Rup-Narayan-Rajbanshi
force-pushed
the
project/historical-gdacs-pdc
branch
from
e5cd566 to
7f1cadc
Compare
* feat(source): remove tmp file * fix: delete temp file after transformation. * fix(sources): remove tmp files --------- Co-authored-by: rup-narayan-rajbanshi <rup.rajbanshi@togglecorp.com>
* feat(etl): integrate proxy etl chore(celery): remove hard-coded queue values fix(config): remove none values error in parse proxy url feat(worker): configure worker to accept envAdditional chore(helm): update worker deployment to accept key value
* feat(sentry): add source label * Add the data type --------- Co-authored-by: Ranjan Shrestha <ranjan.shrestha.np@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Changes
This PR doesn't introduce any:
printThis PR contains valid: