#amazon-s3

[ follow ]
#data-management #aws-sdk-extended #amazon-sqs #amazon-sns #large-messages #kubeflow #spark #scala #apache-iceberg
fromRubyflow
2 days ago

[ANN] aws-sdk-extended first release (0.0.1)

The Amazon SQS Extended Client allows clients to manage Amazon SNS and SQS message payloads that exceed the 256 KB message size limit, up to a size of 2 GB. In the event of publishing such large messages, the client accomplishes this feat by storing the actual payload in a S3 bucket and by storing the reference of the stored object in the SQS queue.
E-Commerce
fromInfoQ
6 months ago

Amazon S3 Adds Sort and Z-Order Compaction to Improve Apache Iceberg Query Performance

Amazon S3 now supports sort and z-order compaction for Apache Iceberg tables to improve query performance and reduce costs.
[ Load more ]