Output APS DataBackupActivity data table to multiple S3 locations?

I have set the AWS Dataflow DynamoDB to S3DataNode using the DynamoDB-> Export menu option, which sets the basic pipeline template.

I run it once a day and it is outputted to the S3 folder like "TableName / DATE /". I set this through the Directory Path option in the S3DataNode:

#{myOutputS3Loc}/#{myDDBTableName}/#{format(@scheduledStartTime, 'YYYY-MM-dd-HH-mm-ss')}

      

I would also like to output it to an S3 folder like "TableName / LATEST" and whether to always rewrite the content there, so that there is one canonical url that always points to the last JSON backup of a specific table.

I experimented with adding CopyActivity and another S3DataNode, but didn't seem to copy anything. Thanks for the help!

+3


source to share





All Articles