I am using AWS and my use case is as below.
Dynamo DB has multiple table and this DyDB table changes is invoked thorough “Lambda” function to a Kinesis Firehose
DyDB -> Lambda -> Kinesis Firehose -> S3
In this pipeline DyDB and s3 is managed by separate Team( I can’t add DyDB, S3 as resource in my serverless.yml). So basically I have to deploy lambda and Kinesis firehose. And my lambda should listen to the change in the table and stream the data.
Currently I am doing this manually.
My DyDB: arn:aws:dynamodb:eu-west-1:199574976045:table/PromotionMake/stream/2018-05-10T10:09:51.315
My lambda: arn:aws:lambda:eu-west-1:199574976045:function:test_datalake_kinesis_connector
Here “PromotionMake” is a particular table name which is present in DyDB
Below is the snippet thought which I am trying to achieve the goal
functions:
KinesisConnector:
handler: fn/kinesis_connector.lambda_handler
events:
- stream:
type: dynamodb
arn: arn:aws:dynamodb:eu-west-1::table//stream/*
Can You suggest how I deploy this piece with serverless