-
Notifications
You must be signed in to change notification settings - Fork 1.3k
upload_data #774
Copy link
Copy link
Closed
Labels
contributions welcomestatus: pending releaseThe fix have been merged but not yet released to PyPIThe fix have been merged but not yet released to PyPI
Metadata
Metadata
Assignees
Labels
contributions welcomestatus: pending releaseThe fix have been merged but not yet released to PyPIThe fix have been merged but not yet released to PyPI
Type
Fields
Give feedbackNo fields configured for issues without a type.
Please fill out the form below.
System Information
Describe the problem
upload_data() under sessions.py can not upload to encrypted s3 buckets right now. Fortunately, The boto3 function that upload_data() is based on, upload_file(), can accept 'ExtraArgs' as a parameter, in which the encryption key and such can be defined.
For example, upload_data may look like the following, with ExtraArgs being passed to upload_file
upload_data(....,ExtraArgs = {'ServerSideEncryption':'aws:kms', 'SSEKMSKeyId':'alias/aws/s3'})
note that estimator uses a different format to pass in the KMSKEY info. Perhaps there is a standard way of passing this info.
Minimal repro / logs
Please provide any logs and a bare minimum reproducible test case, as this will be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.