Output APS DataBackupActivity data table to multiple S3 locations?
I have set the AWS Dataflow DynamoDB to S3DataNode using the DynamoDB-> Export menu option, which sets the basic pipeline template.
I run it once a day and it is outputted to the S3 folder like "TableName / DATE /". I set this through the Directory Path option in the S3DataNode:
#{myOutputS3Loc}/#{myDDBTableName}/#{format(@scheduledStartTime, 'YYYY-MM-dd-HH-mm-ss')}
I would also like to output it to an S3 folder like "TableName / LATEST" and whether to always rewrite the content there, so that there is one canonical url that always points to the last JSON backup of a specific table.
I experimented with adding CopyActivity and another S3DataNode, but didn't seem to copy anything. Thanks for the help!
+3
source to share
No one has answered this question yet
Check out similar questions: