Why S3-WriteObject Kept the Upload Going When I Control-C’d it

Written by James McDonald

June 6, 2017

I would recommend just using the AWS Cli for windows instead of powershell

Uploading 650MB chunks using S3-WriteObject. Didn’t want to choke link during day so CTRL-C’d to exit the powershell script and found in the morning that the upload had happened any way.

The Amazon docs may have the answer: http://docs.aws.amazon.com/AmazonS3/latest/dev/uploadobjusingmpu.html Note what it says about multi-part uploads

“Once you initiate a multipart upload there is no expiry; you must explicitly complete or abort the multipart upload.” — Amazon Docs

 

And more:

Using multipart upload provides the following advantages:

  • You can upload parts in parallel to improve throughput.
  • Smaller part size minimizes the impact of restarting a failed upload due to a network error.
  • You can upload object parts over time. “Once you initiate a multipart upload there is no expiry; you must explicitly complete or abort the multipart upload.”
  • You can upload an object as you are creating it.

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The reCAPTCHA verification period has expired. Please reload the page.

You May Also Like…

Squarespace Image Export

To gain continued access to your Squarespace website images after cancelling your subscription you have several...

MySQL 8.x GRANT ALL STATEMENT

-- CREATE CREATE USER 'tgnrestoreuser'@'localhost' IDENTIFIED BY 'AppleSauceLoveBird2024'; GRANT ALL PRIVILEGES ON...

Exetel Opt-Out of CGNAT

If your port forwards and inbound and/or outbound site-to-site VPN's have failed when switching to Exetel due to their...