This is example of a serverless data pipeline using AWS Lambda Functions, S3 and DynamoDB!
- Serverless framework
- Python3.6
- Pandas
- docker
On a daily basis, an external data source exports data of the pervious day in csv format to an S3 bucket. S3 event triggers an AWS Lambda Functions that do ETL process and save the data to DynamoDB.
sls deploy
$ aws s3 cp sample.csv s3://dev.document.files