AWS Storage Blog

Category: Technical How-to

re:Invent

Automating copying encrypted Amazon EBS snapshots across AWS accounts

UPDATE: The screenshots of the Amazon DLM interface in this post were updated on 7/14/2021. Many customers have disaster recovery (DR) best practices that require them to copy their Amazon EBS snapshots to an isolated account in a different Region and encrypt those snapshots with a different key. In doing so, customers are able to […]

re:Invent

Running Kubernetes cluster with Amazon EKS Distro across AWS Snowball Edge

AWS Snowball Edge customers are running applications for edge local data processing, analysis, and machine learning using Amazon EC2 compute instances on Snowball Edge devices in remote or disconnected locations. Customers use Snowball Edge devices in locations including, but not limited to, cruise ships, oil rigs, and factory floors with no or limited network connectivity. […]

Add storage to your high-performance file system with a single click

Many organizations have on-premises, high-performance workloads burdened with complex management and scalability challenges. Scaling data-intensive workloads on-premises typically involves purchasing more hardware, which can slow time to production and require high upfront investment. The agility to scale compute and storage resources to meet business needs is one of the reasons why our customers choose to […]

Amazon S3

Building a central asset register with Amazon S3 Inventory

UPDATE 7/12/2022: Amazon SQS policy updated to support every AWS Region (step 3 in the architecture diagram) in the central.yml template. Many AWS customers store millions of objects in their Amazon S3 buckets, due to the scalability, durability, and performance that S3 provides. Customers compelled to build an information asset register for compliance reasons or […]

Persistent storage for container logging using Fluent Bit and Amazon EFS

UPDATE 9/8/2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Logging is a powerful debugging mechanism for developers and operations teams when they must troubleshoot issues. Containerized applications write logs to standard output, which is redirected to local ephemeral storage, by default. These logs are lost when the container is terminated […]

Building an IoT solution at the edge with AWS Snowcone

UPDATE: The second blog post in this two-post series was published on January 5, 2020. Internet of Things (IoT) applications, like other applications, require edge solutions to operate in austere conditions with limited network connectivity or limited infrastructure. IoT applications at the edge can span numerous uses, like automation, optimization, and intelligent manufacturing to name […]

Automating shadow copies configuration on Amazon FSx for Windows File Server

We often hear from customers that they love the self-service, fine-grained file restore capability of the shadow copies feature on Amazon FSx for Windows File Server Filer Server (Amazon FSx). Our customers also relay to us the convenience of being able to schedule shadow copies on file systems using PowerShell commands. However, enabling Windows shadow […]

AWS Transfer Family Featured Image

OpenGamma improves security and reduces overhead using AWS Transfer Family

OpenGamma provides hosted analytics services to derivative-trading firms in the financial services industry. These firms often face the challenge of adapting to new regulatory standards. Since 2008, new regulation has aimed to improve global financial stability by increasing the requirements on firms to post margin in order to protect against default and systemic failure. As […]

Using VPC hosted endpoints in shared VPCs with AWS Transfer Family

AWS customers can now deploy AWS Transfer Family server endpoints in Amazon Virtual Private Clouds (Amazon VPCs) with shared resources. Amazon Virtual Private Cloud (VPC) sharing, which launched in early 2019, enables AWS customers to share specific resources with other AWS accounts within the same AWS Organization. VPC sharing benefits customers by enabling: Role-based separation […]

Processing file upload notifications from AWS Storage Gateway on Amazon S3

AWS customers often perform post-upload processing on groups of files transferred by AWS Storage Gateway from on premises to Amazon S3. Before now, they have been unable to reliably initiate this downstream processing based on individual file upload events. Today, we are launching a new AWS Storage Gateway feature, for File Gateway, which enables customers […]