Data Machine

This is C# code for an Azure function to upload a file to an AWS bucket.

There is a curl command included to run it on the cmd line. This has been tested on large file sizes ymmv.

Here’s the zip file:

I usually exec this using ADF, so you’ll see the params being passed via this kind of JSON string in the ADF Azure function activity, dynamically :

-d “{\”ADFsettings\”: [{\”SettingName\”:\”blobUri\”,\”SettingVal\”:\”https://storageaccountxx.blob.core.windows.net/container/filenamex.csv\”},{\”SettingName\”: \”bucketName\”,\”SettingVal\”:\”hostname-us-east-1/incoming\”}]}”