Download all blobs files locally from azure container using python

Question

I'm using python 3.6 in visual studio and I want to download all blobs files from my azure container in single folder. This is my code but the problem is, that it downloads 1 blob file in the folder and then when downloading the second file it overwrite the first file and in the end I only have the last blob in my local folder. How can I download all the blobs files at once in a single folder?

from azure.storage.blob import BlockBlobService
block_blob_service = BlockBlobService(account_name=ACCOUNT_NAME, account_key=ACCOUNT_KEY)

generator = block_blob_service.list_blobs(CONTAINER_NAME)
        for blob in generator:
            block_blob_service.get_blob_to_path(CONTAINER_NAME, blob.name, LOCAL_FILE)

Do you mean to download them and append the blobs into a single file? — Hai Vu
You'd need to combine them yourself. Or maybe download them to a single stream. But the get_blob_to_path() method isn't going to append to files. — David Makogon
Have you tried to pass open_mode='ab' to get_blob_to_path? — Hai Vu

Peter Pan Peter Pan · Accepted Answer · 2017-03-20T06:34:53

Based on my understanding, I think there are two solutions for your needs.

Download all blobs from a container, and write these blob content to a single file via the method get_blob_to_bytes or get_blob_to_stream, please see my sample code as below.

from azure.storage.blob import BlockBlobService

block_blob_service = BlockBlobService(account_name=ACCOUNT_NAME, account_key=ACCOUNT_KEY)

generator = block_blob_service.list_blobs(CONTAINER_NAME)

fp = open('<your-local-file-name>', 'ab')

for blob in generator:
    # Using `get_blob_to_bytes`
    b = service.get_blob_to_bytes(container_name, blob.name)
    fp.write(b.content)
    # Or using `get_blob_to_stream`
    # service.get_blob_to_stream(container_name, blob.name, fp)

fp.flush()
fp.close()

Download all blobs from a container, and write these blobs into a zip file via the method get_blob_to_bytes, please see my sample code below.

from azure.storage.blob import BlockBlobService
import zipfile

block_blob_service = BlockBlobService(account_name=ACCOUNT_NAME, account_key=ACCOUNT_KEY)

generator = block_blob_service.list_blobs(CONTAINER_NAME)

zf = zipfile.ZipFile(CONTAINER_NAME+'.zip', 
             mode='w',
             compression=zipfile.ZIP_DEFLATED, 
             )

for blob in generator:
    b = service.get_blob_to_bytes(container_name, blob.name)
    zf.writestr(blob.name, b.content)

zf.close()

Hope it helps. Any concern, please feel free to let me know.

Download all blobs files locally from azure container using python

1 Answers