AWS Storage Blog
Category: Foundational (100)
Two AWS Solutions Architects discuss advancing their cloud skill set with digital badges
If you are new to AWS and trying to figure out which Storage services to use, how to use them, and best practices, it can be challenging to find guidance that you can trust. The depth of features and options means that even experienced users can identify better solutions with continuous learning. But how do […]
Simplify and accelerate your data migration using AWS DataSync Discovery
UPDATE (4/25/2023): DataSync Discovery is now generally available. For more information on additional capabilities and extended availability, view the What’s New post and visit the feature page. Migrating your on-premises data to the cloud can be intimidating at first, particularly when you are working with large and complex storage systems. Estimating costs, understanding which data […]
How Devo’s security analytics solution uses Amazon EBS to optimize storage cost and performance
Devo is a cloud-native, multi-tenant centralized log management platform used by some of the world’s largest organizations to ingest, secure and enable real-time querying and analytics of their data. When managing data for major brand-name retail, financial services, and public sector organizations as Devo does, there’s no room for error when it comes to the […]
Ensure workload resilience with AWS Elastic Disaster Recovery and Arpio
Planning for disaster recovery (DR) is a critical component of any IT operations practice. Applications that run on AWS benefit from the reliability that is built into the platform. However, they can still be impacted by from natural disasters, technical failures, and accidental or malicious human actions. Consequently, implementing best practices around disaster recovery is […]
Break down silos with AWS Transfer Family and Dremio’s Data Lakehouse Platform
Becoming a data-driven organization is a top priority for the majority of executives. According to an IDC data culture survey from 2021, 83% of CEOs want their organizations to be more data-driven, and 87% of CxOs say that giving their organizations the ability to make better strategic, tactical and operational decisions is their top priority. […]
Optimizing cost with long-term pricing options for AWS Snowball
At the edge, in austere, non-data center environments, and in locations where there’s lack of consistent network connectivity, optimizing costs and operations is essential to successful outcomes. It can be difficult to manage costs and achieve goals in these austere environments, with limited resources and capabilities. The Snow Family, comprised of AWS Snowcone and AWS Snowball, enable you to […]
High-performance cloud storage comes of age with Amazon FSx for Lustre
The rapid maturation of cloud tools for high-performance workloads in the past several years has made it possible for household names like T-Mobile, Toyota, and Rivian to move their high-performance analytics and AI/ML environments to the cloud. These are hugely data-intensive workflows that many companies five years ago believed would never be able to be […]
MemQ by Pinterest: An efficient, scalable, cloud-native publish/subscribe system
The Logging Platform at Pinterest powers all data ingestion and transportation at Pinterest. At the heart of the Pinterest Logging Platform are distributed pub/sub systems that help our customers transport, buffer, and consume data asynchronously. Pub/sub messaging, is a form of asynchronous service-to-service communication used in serverless and microservices architectures. In a pub/sub model, any […]
Considering four different replication options for data in Amazon S3
UPDATE (2/10/2022): Amazon S3 Batch Replication, which is not covered in this blog post, launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. UPDATE (5/1/2023): Updated the comparison table to reflect the latest capabilities of the mechanisms covered in the table. […]
Best practices for archiving large datasets with AWS
As companies grow, they often find themselves managing an ever-increasing amount of data. Customers often need to retain backups for business continuity or disaster recovery, as well as records for compliance and audits. In addition, some customers may need to retain backups to create a centralized repository of information that is heterogeneous in nature, with […]