AWS S3 CLI Multi-Page Download
When trying to upload a file to an AWS S3 bucket using aws-cli, does it automatically use multi-page upload on large files? Since everything he outputs is
Completed 3.0 GiB/9.4 GiB (18.4 MiB/s) with 1 file(s) remaining
which doesn't make me wiser.
I have checked several other sources of information and this this page tells me that it automatically starts, while Amazon help tells me otherwise.
source to share
They mention in AWS docs that CLI commands automatically perform multi-page loading for LOBs.
Excerpt from documentation :
All high-level commands that include loading objects into Amazon S3 (
aws s3 cp
,aws s3 mv
andaws s3 sync
) will automatically perform multi-page loading when the object is large.Failed downloads cannot be resumed using these commands. If multiple downloads fail due to timeout or manually canceled push CTRL+C, AWS CLI clears all generated files and aborts the download. This process can take several minutes.
If the process is interrupted by a kill command or a system crash, the unfinished multipage load remains in Amazon S3 and must be cleaned up manually in the AWS Management Console or using
s3api abort-multipart-upload
.
source to share