Upload files to Google Cloud Storage without downloading them locally?

Question

I want to upload 120 files, each around 1.2GB so about 150GB in total, from an HTTPS website onto my Google Cloud Storage.

I really, really don't want to have to download them all locally, and then upload them individually.

Is there any way around this? Surely I can just give Google Cloud Storage a URL to pull from? I don't control the HTTPS server.

It seems to be possible to upload from S3 to Google Cloud Storage, but S3 seems to suffer from the same problem.

Why the close vote? Sure the answer is out there, but not in words such that I was able to find it by Googling... exactly the use case that SO was designed for! — Richard

Mike Schwartz Mike Schwartz · Accepted Answer · 2015-11-03T03:51:50

If your website allows public access you can use the GCS Transfer Service to do it: https://cloud.google.com/storage/transfer/