This repository serves to store both lambda functions used in the netco AWS POC as well as instructions to help set up the AWS environment properly to use all of the services
The Architecture used for this project is similar to that of the architecture above by "https://www.skedler.com/blog/combine-text-analytics-search-aws-comprehend-elasticsearch-6-0/" but with the main differences being that the code has been amended for usage within lambda functions allowing it to be invoked through triggers instead of manual execution
- 2 Lambda functions
- 1 S3 bucket
- 1 Elasticsearch domain
- 1 SQS Queue
- 1 CloudWatch Events (daily trigger)
- A few IAM role tweaks
- Patience
- Set up an SQS Queue and an S3 bucket with both versioning, as well as events and link the events to the SQS queue that you set up
- Set up an Elasticsearch domain, within the domain go to Rule mappings and add your second Lambda functions ARN to the "all access" users when you make it
- Set up the first Lambda function using Lambdafunction1 code and attach a cloudevent to trigger it daily, weekly, etc. Within the lambda function change the bucket name from "homeofficebucket" to whatever you s3 bucket name is and change the lambda function arn to whatever your arn is for your second lambda function. Add IAM roles for all the services used as a safety precaution
- Set up the second lambda function mentioned in the instructions beforehand using Lambdafunction2 code. Add IAM roles for all the services used as a safety precaution .Change host to your elasticsearch endpoint, change bucketname and change SQS queue name to yours.
