AWS Storage Blog

Tag: AWS Lambda

Setting file system-wide soft and hard quotas on Amazon Elastic File System (EFS)

Sometimes the infrastructure operations team might face a challenge in managing the development team’s data storage practices. The development team tends to store data in an uncontrolled manner, leading to potential issues such as excessive storage consumption and inefficient resource usage. This challenge arises from the lack of quota or capacity management capabilities in the […]

Amazon S3 featured image 2023

How Bridgewater maintains data consistency across Regions using Amazon S3 Replication

Bridgewater Associates is a global macro investment manager, with a core mission of understanding how the world’s markets and economies work by analyzing the drivers of markets and turning that understanding into high-quality portfolios and investment advice for their clients. The data that drives this economic research is stored in Bridgewater’s data lake, built on […]

Amazon S3 Metadata thumbnail image

Integrating custom metadata with Amazon S3 Metadata

Organizations of all sizes face a common challenge: efficiently managing, organizing, and retrieving vast amounts of digital content. From images and videos to documents and application data, businesses are inundated with information that needs to be stored securely, accessed quickly, and analyzed effectively. The ability to extract, manage, and use metadata from this content is […]

Figure 1: Multi-region FSx for NetApp ONTAP with SnapMirror replication for SQL Server DR

Archiving relational databases to Amazon S3 Glacier storage classes for cost optimization

Many customers are growing their data footprints rapidly, with significantly more data stored in their relational database management systems (RDBMS) than ever before. Additionally, organizations subject to data compliance including the Health Insurance Portability and Accountability Act (HIPAA), the Payment Card Industry Data Security Standard (PCI-DSS) and General Data Protection Regulation (GDPR) are often required […]

Amazon S3 featured image 2023

Cost-optimized log aggregation and archival in Amazon S3 using s3tar

According to a study by the International Data Corporation (IDC), the global datasphere is expected to grow from 33 zettabytes (ZB) in 2018 to 175 ZB by 2025, a staggering five-fold increase. Organizations that leverage distributed architectures generate a significant portion of their data footprint from observability data, including application logs, metrics, and traces, which […]

Amazon S3 Express One Zone thumbnail

Fundrise uses Amazon S3 Express One Zone to accelerate investment data processing

Fundrise is a financial technology company that brings alternative investments directly to individual investors. With more than 2 million users, Fundrise is one of the leading platforms of its kind in the United States. The challenge of providing a smooth, secure, and transparent experience for millions of users is largely unprecedented in the alternative investment […]

Amazon S3 Object Lambda

Access a point in time with Amazon S3 Object Lambda

Point-in-time ‘snapshots’ enable administrators, developers, testers, and end users to quickly access a storage volume or share how it was at an earlier point-in-time. They are a longstanding approach to data protection and recovery, tracking changes within a storage system to reduce both Recovery Point Objective (RTO) and Recovery Time Objective (RTO). However, traditional snapshots […]

Amazon FSx for NetApp ONTAP

Automate monitoring at scale for Amazon FSx for NetApp ONTAP volumes

User files are increasingly growing in number and size. Maintaining and managing file growth can be challenging without an effective set of tools and automation that scales with your data growth. Customers agree that visibility is key for managing existing files and for developing a plan to support future growth. Amazon CloudWatch is a service […]

Amazon S3 featured image 2023

Automatically scan for public Amazon S3 buckets and block public access

Data is a valuable asset for an organization and users are always looking for simple tools to protect their data from unauthorized access. While some use cases do require data to be publicly accessible at times, most enterprise use cases and data privacy depend on strictly managed permissions and no public access. Enterprises use Amazon […]

Amazon S3 featured image 2023

Secure data in a multi-tenant environment by automatically enforcing prefix-level encryption keys in Amazon S3

Many organizations need to store and process data that belong to multiple entities, commonly referred to as multi-tenancy. In these situations, it is important to secure every tenant’s data and ensure that a consumer can only access the data that they require for their responsibilities and nothing more. In particular, if a user or application […]