AWS Storage Blog
Category: Compute
Online Tech Talk April 23: Persistent storage for containers with Amazon EFS
Don’t miss our AWS Online Storage Tech Talk on April 23, where an AWS expert covers persistent storage for containers using Amazon EFS. This Tech Talk is at 9:00 AM – 10:00 AM PT (12:00 PM – 1:00 PM ET). Building containerized applications at-scale requires data storage solutions that are highly accessible and enables high-performance […]
Querying data without servers or databases using Amazon S3 Select
UPDATE (7/25/2024): Use Amazon Athena, S3 Object Lambda, or client-side filtering to query your data in Amazon S3. Learn more » In our time as Solutions Architects at AWS, we have supported all types of customers and use cases. We regularly hear the same feedback: instead of deploying and managing systems and infrastructure, customers want […]
Using Amazon FSx for Lustre for Genomics Workflows on AWS
Genomics datasets are getting larger year-over-year. Combining data from research initiatives across the globe, and having the ability to process it quickly, has been identified by large bioinformatics and genomics communities as an enabling mechanism for making significant scientific discoveries. Collaborating on a global scale requires data storage solutions that are globally accessible, highly available, […]
Query Amazon S3 Analytics data with Amazon Athena
I recently had a customer explain that they were aware of the benefits of various Amazon S3 storage classes, like S3 Standard, S3 Infrequent-Access, and S3 One-Zone Infrequent-Access, but they were not sure which tiers and lifecycle rules to apply to optimize their storage. This customer, and others like them, have multiple buckets and various […]
Automate restore of archived objects through AWS Storage Gateway
UPDATE: This post was updated on 8/4/2021 to include an AWS CloudFormation template for automation and also to modify relevant sections to reflect support for Amazon S3 Glacier Deep Archive and S3 Intelligent-Tiering Archive Access and Deep Archive Access tiers. AWS Customers who have on-premises file-based applications love having the ability to deploy an AWS Storage […]
Automate mounting Amazon EFS File Systems from the EC2 Launch Instance Wizard
Customers have provided us with great feedback on previous posts covering best practices and integrations for using Amazon Elastic File System (EFS) with other AWS services, and they have been asking for more. Today, I’ll show you how you can simplify and automate the mounting of Amazon EFS file systems to EC2 instances directly from […]
Automating Amazon EBS volume resizing with AWS Step Functions and AWS Systems Manager
In active applications, it’s possible for an Amazon EC2 instance’s Amazon EBS volume utilization to reach provisioned capacity. Depending on the application in use, this creates the risk of a customer-impacting application outage when that provisioned capacity is exhausted. One solution is to design a failover mechanism into the application. However, this can be a […]
Maximizing Microsoft SQL Server Performance with Amazon EBS
AWS customers have been running mission-critical Windows workloads, like SQL Server, on AWS for more than 10 years. In this post, I discuss how to maximize SQL Server performance with Amazon EBS storage. Persistent block storage is a critical component of a relational database management system (RDBMS) and is ultimately responsible for the speed, security, […]
Using AWS SFTP logical directories to build a simple data distribution service
We launched the AWS Transfer for SFTP (AWS SFTP) service in November of 2018, and it has since been adopted by many organizations to enable secure SFTP access to data hosted in Amazon S3. At AWS, we are continuously iterating on our services, and many of our customers have told us that they would like […]
Best practices for using Amazon EFS for container storage
Tens of thousands of companies are storing petabytes of data on Amazon Elastic File System (Amazon EFS), many of them using EFS to store data for containerized applications. Amazon EFS file systems can be attached to containers launched by both Amazon Elastic Container Service (ECS) and Elastic Kubernetes Service (EKS). Amazon EFS is a natural […]