feat(s3): Add support for hive.s3.min-part-size when writing

[czentgr]

This PR introduces the hive.s3.min-part-size option available in Presto Java. It defines the minimum size of a buffer before multipart uploads are used. As a result files less than the min-part-size are sent in a single PUT request. Previously, even smaller files were sent through the multi-part upload. However, AWS limits the minimum size of a part to 5MB.
As a result, some S3 backends such as Apache Ozone ignored uploads of parts with less than 5MB leading to errors when finishing the multi-part upload.

The default part size is 10MB to match the existing hard coded value. Every part is of size min-part-size to conform to other S3 backends where each part size must be exactly the same size except the last part. As a result min-part-size is also the effective part size. Therefore, this change may affect performance with the default configuration.

[netlify]

✅ Deploy Preview for meta-velox canceled.

Name	Link
🔨 Latest commit	2917136
🔍 Latest deploy log	https://app.netlify.com/projects/meta-velox/deploys/69d01c0d2219b30008a7f130

[majetideepak]

minor comments.

[majetideepak]

base class has a variable with the same name config_. Let's name this s3Config_

[github-actions]

Build Impact Analysis

Selective Build Targets (building these covers all 13 affected)

cmake --build _build/release --target velox_query_replayer velox_read_benchmark velox_s3config_test velox_s3file_test velox_s3finalize_test velox_s3insert_test velox_s3metrics_test velox_s3multiendpoints_test velox_s3read_test velox_s3registration_test velox_tool_trace_test

Total affected: 13/557 targets

Warning: 1 file(s) could not be mapped to any target. A full build may be needed.

• velox/docs/configs.rst

Affected targets (13)

Directly changed (9)

Target	Changed Files
velox_s3config_test	S3Config.h, S3ConfigTest.cpp
velox_s3file_test	S3FileSystem.h, S3WriteFile.h
velox_s3finalize_test	S3FileSystem.h
velox_s3fs	S3Config.cpp, S3Config.h, S3FileSystem.cpp, S3FileSystem.h, S3WriteFile.cpp, ... (+1 more)
velox_s3insert_test	S3FileSystem.h, S3InsertTest.cpp
velox_s3metrics_test	S3FileSystem.h, S3WriteFile.h
velox_s3multiendpoints_test	S3FileSystem.h
velox_s3read_test	S3FileSystem.h
velox_s3registration_test	S3FileSystem.h

Transitively affected (4)

• velox_query_replayer
• velox_query_trace_replayer_base
• velox_read_benchmark
• velox_tool_trace_test

---

Fast path • Graph from main@95ce7612570fe718a42403cd294fe6900fc04e82

[meta-codesync]

@bikramSingh91 has imported this pull request. If you are a Meta employee, you can view this in D99502533.

[meta-codesync]

@bikramSingh91 merged this pull request in 95894c3.