Category: Intermediate (200)

Customers of all sizes, in all industries, are using data lakes to transform data from a cost that must be managed, to a business asset. From time to time, data scientists and business analysts need to restore subsets of historical datasets for longitudinal studies, machine learning retraining, and more. However, users commonly write queries that don’t […]

UPDATE (7/7/2022): We’ve revised this blog post to align with the latest AWS security best practices. We’ve removed the step of adding an AWS Identity and Access Management (IAM) user, and replaced it with using an EC2 instance profile when the source server is an EC2 instance (the AWS Replication Agent also retrieves credentials automatically from […]

VMware virtual machines (VMs) can run in a number of environments, and whether they run on-premises, in the cloud, or in a hybrid environment, one thing remains the same: backing up your virtual machines is an important step toward meeting business continuity and regulatory requirements. For VMware users, figuring out the best method of backing […]

Analyzing time-series data such as tick-by-tick quotes and trades is crucial to our financial services customers, specifically quantitative analysts, algorithm engineers, risk managers, and others handling various trading functions. From running global ticker plants to algorithm development, to risk management, these functions are critical to day-to-day business operations. With the increase in trading volume and […]

UPDATE (3/26/2024): When deploying the AWS DataSync agent, this repository contains a script designed to convert the DataSync Agent VHDX to VHD on Amazon Linux 2 (AL2), and upload the generated disk to Azure and create an Azure Virtual Machine. It’s not uncommon for organizations to have data located in multiple data centers, storage locations, […]

Update (4/17/2024): The solution presented in this post using AWS DataSync for migration to Amazon S3 from Google Cloud Storage works best if you are looking for a secure managed service for your data transfer workflow that provides data validation, integrated auditing and monitoring capabilities, and the ability to transfer changed data. If you are […]

Many organizations use databases to support their most mission-critical applications. Having a comprehensive strategy to protect these databases is the underpinning to meeting business service level agreements (SLAs). An optimal strategy includes using both backups and replication to protect databases in the event of a natural disaster, human error, or cyber threat. Customers can use […]

Monitoring and troubleshooting disaster recovery (DR) solutions is a critical component of any DR strategy. The ability to receive alerts and status updates is imperative when it comes to limiting downtime and maintaining operations. Often, monitoring a DR solution is a post-deployment afterthought. Administrators must be logged in to the tool to see if it’s […]

Keeping multiple copies and versions of data is a tried-and-true security and data protection protocol. In the event that one version is harmed or corrupted, another is ready as a backup. While increased security with multiple versions and copies is a plus, the added storage costs of (purposefully) redundant data must be carefully considered. It […]

Many organizations today are either amongst a cloud migration projects or have it as a top priority, but as IT professionals know migrating to the cloud is not an easy task. It takes time, a detailed plan, and expert orchestration between departments. Even with the most comprehensive, in-depth migration planning, issues can arise that result […]