AWS Storage Blog

Category: Migration & Transfer Services

Transferring files from on premises to AWS and back without leaving your VPC using AWS DataSync

AWS DataSync is a service we launched at re:Invent 2018 to simplify, automate, and accelerate data transfer between on-premises storage and AWS, such as Amazon Elastic File System (EFS) and Amazon S3. We recently expanded the service to support direct transfers to all S3 storage classes. Many of our customers are using DataSync to migrate […]

Simplify your AWS SFTP Structure with chroot and logical directories

UPDATE: The AWS CloudFormation template link provided in the “Try it for yourself” section was updated on 11/5/2020. Correspondingly, the blog post mentioned in the opening paragraph and shortly after the CloudFormation template as “my last blog post” has also been updated. In my last blog post, I showed how you can easily setup AWS […]

Data Migration Best Practices with AWS Snowball Edge

AWS Snowball Edge enables petabyte-scale offline data migrations from on-premises storage (SAN, NAS, parallel file systems) or databases into Amazon S3. AWS Snowball Edge is part of the AWS Snow Family and the greater AWS portfolio of data transfer services that can be used for data migration. The AWS portfolio of data transfer services also […]

Using AWS SFTP logical directories to build a simple data distribution service

We launched the AWS Transfer for SFTP (AWS SFTP) service in November of 2018, and it has since been adopted by many organizations to enable secure SFTP access to data hosted in Amazon S3. At AWS, we are continuously iterating on our services, and many of our customers have told us that they would like […]

AWS Loft

Free AWS Loft Events: Attend “AWS Storage Days” in San Francisco or NYC

As we gear up for AWS re:Invent 2019 December 2 – 6, we want to ensure you are up to speed on the full portfolio of AWS storage services. In San Francisco September 10 – 11 and in NYC September 24- 25, we will be conducting ‘AWS Storage Days’ at the AWS Loft locations. These […]

Online Tech Talk August 21st: ‘Migrating Data to AWS: Understanding Your Options’

Don’t miss our AWS online Storage Tech Talk on August 21st where we cover: ‘Migrating Data to AWS: Understanding Your Options‘ AWS offers a variety of data migration and transfer services to help you move everything from gigabytes to petabytes of data by using network links, express mail, or even a tractor trailer. In this […]

Migrating hundreds of TB of data to Amazon S3 with AWS DataSync

This blog is co-authored by Satish Kumar of Autodesk and Sona Rajamani of AWS. Enterprises are often faced with challenges in migrating vast amounts of data efficiently and effectively from their on-premises data storage environments to AWS. To aid and ease this migration, AWS offers offline data transfer services such as AWS Snowball, AWS Snowball […]

Using Okta as an identity provider with AWS Transfer for SFTP

AWS Transfer for SFTP (AWS SFTP) is a fully managed service that enables you to move file transfer workloads to AWS when they use the Secure Shell File Transfer Protocol (SFTP). Enterprises and startups across a range of industries can use AWS SFTP without needing to modify applications or manage any SFTP servers. Data uploaded […]

Getting started: Training resources for storage on AWS

With a wide variety of storage and data transfer and migration services, understanding where to start when considering AWS for your data storage can be a time consuming task. Where do you start? What resources are available to help guide you through unfamiliar territory? Where can you go if you need additional help? Whether you’ve […]

Excluding and including specific data in transfer tasks using AWS DataSync filters

UPDATE (8/25/2021): This post reflects that AWS DataSync now supports using both include and exclude filters when you create a task, giving you more granularity when specifying the files, folders, and objects that you want to transfer. AWS DataSync automates and accelerates copying data between your NFS servers, Amazon S3 buckets, and Amazon Elastic File […]