AWS Storage Blog

Category: Technical How-to

AWS DataSync Featured Image

Transferring file data across AWS Regions and accounts using AWS DataSync

Many customers that use Amazon EFS want to replicate their file systems to other AWS accounts or other AWS Regions. Customers may do this for business continuity purposes or to provide low-latency access to data for processes running in other Regions. AWS DataSync makes it easy for customers to replicate data from one Amazon EFS […]

AWS DataSync Featured Image

Monitor your AWS DataSync migrations using Amazon CloudWatch

Customers who have a large on-premises footprint of storing special types of data, like images for medical bills, audio files for customer interactions, and scanned objects, often run out of on-premises storage capacity. This is exacerbated by perpetual increases in business demand to store and maintain these images and files. It quickly becomes operationally challenging […]

Accessing SMB file shares remotely with Amazon FSx for Windows File Server

With remote work becoming the norm, customers often need a central repository for files that can be accessed from anywhere to enable collaboration and provide highly durable storage. For ease of use and increased productivity, customers are looking for shared file access that can be mounted as a network drive using built-in Windows, macOS, Linux, […]

AWS Storage Gateway Featured Image

Protecting backup archives with WORM and Tape Retention Lock

Many AWS customers use AWS Storage Gateway’s Tape Gateway to back up and archive long-term mission-critical on-premises data in Amazon S3 Glacier and Amazon S3 Glacier Deep Archive. Customers in regulated industries are mandated by governance policies or regulatory compliance rules to retain their data for many years, or even indefinitely. For example, large banks, broker-dealers, and […]

Automating Amazon EBS snapshot management using Data Lifecycle Manager

UPDATE: An updated version of this post was published on 7/14/2021. Please refer to that post for the most up-to-date content. Many AWS customers frequently look for ways to lower the operational costs and complexity of managing their backup operations. With Amazon EBS, you can create snapshots that are a convenient way to back up your block […]

AWS Outposts Featured Image

Connecting AWS Outposts to on-premises data sources

Millions of customers such as startups, enterprises, and leading government agencies are using AWS to lower costs, become more agile, and innovate faster. There are some workloads that must remain on-premises in order to interact with data that cannot, for variety of reasons, move to an AWS Region. Enter AWS Outposts. AWS Outposts is a […]

Amazon S3

Cross-account bulk transfer of files using Amazon S3 Batch Operations

As customers scale their business on AWS, they can have millions to billions of objects in their Amazon S3 buckets. Customers often run operations on a large number of these objects in their buckets, including copying objects across accounts, encrypting objects, or tagging. Running operations on a large number of objects in S3 involves listing […]

Automatically import Amazon S3 object updates into Amazon FSx for Lustre

Many enterprises and other AWS customers often store their datasets and build their data lakes on Amazon S3. Since Amazon FSx for Lustre is deeply integrated with S3, customers can create a new FSx for Lustre file system linked to their S3 bucket in minutes. FSx for Lustre file systems transparently present S3 objects as […]

Amazon EFS Featured Image

Deploying Jenkins on Amazon EKS with Amazon EFS

UPDATE (5/17/2021):  It looks like the Jenkins Helm repos have moved and the configurable parameters have been updated as well! You will need to modify the commands listed in the blog accordingly. Check out the new Jenkins helm repos and configurable parameters at the following links: https://github.com/jenkinsci/helm-charts/blob/main/charts/jenkins/README.md https://github.com/jenkinsci/helm-charts/blob/main/charts/jenkins/VALUES_SUMMARY.md Also, make sure your EKS cluster control […]

Amazon S3

Auditing Amazon S3 encryption methods for object uploads in real time

Encryption of data at rest is increasingly necessary for maintaining compliance and providing another layer of protection for data against unauthorized access. Amazon S3 offers multiple methods for server-side encryption (SSE) of new objects in your bucket. As not all encryption options are equal, customers often ask how to track and control the method of […]