transformation_trigger

A repo for the mirrulations trigger to transform data

This project contains source code and supporting files for a serverless application that you can deploy with the SAM CLI. It includes the following files and folders.

• lambda_functions - Code for the application's Lambda functions.
• common_layer - a submodule that contains functions to get secrets and connect to databases for the lambdas.
• events - Invocation events that you can use to invoke the functions.
• tests - Unit tests for the application code.
• template.yaml - A template that defines the application's AWS resources.

The application uses several AWS resources, including Lambda functions, SNS trigger, S3, and secrets manager. These resources are defined in the template.yaml file in this project. You can update the template to add AWS resources through the same deployment process that updates your application code.

Additional Documentation

Lambda Trigger Creation Guide
Moto Lambda Mocking Guide
Moto S3 Mocking Guide
Flake8 Installation & Setup Guide
Local Dev / Execution Guide
Adding New Lambda Functions Guide

Get Started

• To start, download the AWS SAM CLI here.

• We utilized Docker for the containerized deployment of the infrastructure, download Docker Desktop here

• Clone this repository

• cd into dev-env

• Clone the common layer ingest functions by running git submodule update --init

  • Make sure to occasionally rerun git submodule update whenever there are changes to the ingest repository!

Refer to the running locally documentation to build and run the stack in your local environment

Resources

See the AWS SAM developer guide for an introduction to SAM specification, the SAM CLI, and serverless application concepts.