AWS Storage Blog
Tag: Amazon Simple Storage Service (Amazon S3)
Automate file retrieval from S3 Glacier when using FSx for Lustre
Customers are running modern high performance computing (HPC) workloads on AWS to process large datasets cost-effectively and optimize performance. These workloads typically rely on a high-performance file system to provide low latency and high throughput access to the data. A performant file system is important so that the file storage can keep up with the […]
How Torc Robotics reduces storage costs with S3 Intelligent-Tiering
Do you manage petabytes of data or tens to hundreds of buckets on Amazon S3 across multiple business units and multiple teams? If you do, chances are that application requirements and access patterns vary widely from one business unit to another. And, if you’re like many AWS customers today, you’re looking for the easiest and […]
Managing access to your Amazon S3 objects with a custom authorizer
Data protection is critical for most customers seeking to safeguard information, maintain compliance, secure applications, and more. Protecting data can become challenging when different entities or personas need different levels of access to data. In Amazon S3, access control can be managed with tools like AWS Identity and Access Management (IAM) policies, bucket policies, access […]
Ten tips for multi-tenant, multi-Region object replication in Amazon S3
UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. Independent software vendors (ISV) want to build multi-tenanted applications to benefit from more efficient usage of resources in addition to global reach. These apps require a […]
Cost efficiently migrate billions of small files with AWS Snowball
Migrating billions of small files to the cloud can be challenging because of the time and cost required to do so. Solutions that move small files to the cloud – whether online or offline — can exponentially increase cost. This is primarily due to the size of each individual file being migrated. For clarity, a […]
How automated reasoning helps Amazon S3 innovate at scale
When we launched Amazon S3 a little over fifteen years ago, we put simplicity at the center of the customer experience. S3’s core API is just four REST commands (GET, PUT, LIST, and DELETE). Our customers tell us that they love the simplicity of S3 not just because of its API, but especially because of […]
Copying objects greater than 5 GB with Amazon S3 Batch Operations
Update (3/4/2022): Added support for Glacier Instant Retrieval storage class. Update (4/19/2022): Included the copy destination prefix parameter in the Amazon CloudFormation template. Update (10/26/2022):Added performance guidance and best practices, and included template optimized for copying objects restored from archive to a different storage class. A large number of customers store their data in Amazon […]
How Capital One uses Amazon S3 Glacier to optimize data storage costs and maximize resources
At Capital One, our goal is to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. Our founders believed that banking would be revolutionized by technology. Based on that vision, our technology leaders made an aggressive effort in building a talented in-house software engineering practice. This foresight helped us become a leader […]
Enhance data access control with AWS Transfer Family and Amazon S3 Access Points
Sharing data is at the core of collaboration efforts sparking innovation. Many industries rely on secure data access solutions that scale with their business. From pharmaceutical companies exchanging research data with partners in Amazon S3, to financial customers migrating and modernizing transaction data with traditional file transfer protocols, there is a persistent ask for fine-grained […]
Protect and manage Dell EMC PowerScale data on Amazon S3
Many customers across several industries use Dell EMC PowerScale to store various kinds of files over SMB, NFS, and HDFS protocols. Common workflows include building and analyzing data lakes, content production creation, genomics sequencing, and image rendering. Implementing and maintaining an efficient and secure data backup for Dell EMC PowerScale in the cloud is necessary […]