AWS Storage Blog
Tag: Amazon Simple Storage Service (Amazon S3)
Using Amazon FSx for Lustre for Genomics Workflows on AWS
Genomics datasets are getting larger year-over-year. Combining data from research initiatives across the globe, and having the ability to process it quickly, has been identified by large bioinformatics and genomics communities as an enabling mechanism for making significant scientific discoveries. Collaborating on a global scale requires data storage solutions that are globally accessible, highly available, […]
Aggregating logs with S3 Same-Region Replication
Aggregating logs to a secure dedicated location streamlines critical operations like Security Information and Event Management (SIEM). As more customers adopt a multi-account strategy, central logging becomes a key component of driving operational excellence. Considering the benefits, enterprise customers often use complex third-party tools to build their centralized log aggregation solution. With the announcement of […]
Query Amazon S3 Analytics data with Amazon Athena
I recently had a customer explain that they were aware of the benefits of various Amazon S3 storage classes, like S3 Standard, S3 Infrequent-Access, and S3 One-Zone Infrequent-Access, but they were not sure which tiers and lifecycle rules to apply to optimize their storage. This customer, and others like them, have multiple buckets and various […]
New enhancements for moving data between Amazon FSx for Lustre and Amazon S3
Introduction to Amazon FSx for Lustre Amazon FSx for Lustre is a high performance file system optimized for workloads such as machine learning, high performance computing, video processing, financial modeling, electronic design automation, and analytics. Amazon FSx works natively with Amazon S3, making it easy for you to process cloud data sets with high performance […]
Hurricane Dorian disaster response in the Bahamas using AWS Snowball Edge
Hurricane Dorian struck the Bahamas on September 1, 2019. The Category 5 storm set the record for the worst natural disaster to ever impact the island nation. It became one of the two most powerful storms to ever make landfall from the Atlantic Ocean. During a disaster of this magnitude it is the responsibility of […]
Monitor, review, and protect Amazon S3 buckets using Access Analyzer for S3
At AWS, Security is more than just features – it’s a mindset. Today, we announced Access Analyzer for S3, a new feature that monitors your resource policies so you don’t have to. By default, all buckets and objects created in S3 are private. AWS enables you with mechanisms like Access Control Lists (ACLs) and Bucket […]
Supporting big data and analytics engagements with AWS Transfer for SFTP
Leap Beyond is a multinational boutique consultancy that specialises in big data. Our goal is to help medium to large enterprises use their data to realise high-impact changes in their businesses and their bottom line. In my role as one of the managing partners, I have special responsibility and interest in how our engineers work […]
AWS Storage Day 2019
9:00 a.m. PST Welcome to AWS Storage Day! Welcome to the AWS Storage Day live blog! We’ve got a lot of news coming over the next few hours, and we’ll keep you updated here. Keep checking back from time to time for the latest. Start off by listening to Dave Vellante from theCUBE introducing all […]
Explore AWS file storage solutions at re:Invent 2019
UPDATE: The AWS re:Invent links in this post are outdated. Please visit the AWS Events channel on YouTube for a complete on-demand playlist of AWS Storage sessions at AWS re:Invent 2019. In today’s business environment, data is the foundation for innovation and transformation. Using data the right way can literally propel a business to becoming […]
Monitor data transfer costs related to Amazon S3 Replication
UPDATE (2/10/2022): Amazon S3 Batch Replication launched on 2/8/2022, allowing you to replicate existing S3 objects and synchronize your S3 buckets. See the S3 User Guide for additional details. In this post, we will review how to monitor the cost and usage details of Amazon S3 Replication for use-cases such as compliance, disaster recovery, or […]