Tag: open data

How do we avoid the next global pandemic? For researchers collaborating with the University of British Columbia Cloud Innovation Center (UBC CIC), the answer to that question lies in a massive library of genetic sequencing data. But there is a problem: the data library is so massive that traditional computing can’t comprehensively analyze or process it. So the UBC CIC team collaborated with computational virologists to create Serratus, an open-science viral discovery platform to transform the field of genomics—built on the massive computational power of the Amazon Web Services (AWS) Cloud.

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. We work with data providers to democratize access to data by making it available to the public for analysis on AWS; to develop new cloud-native techniques, formats, and tools that lower the cost of working with data; and to encourage the development of communities that benefit from access to shared datasets. This quarter, we released 19 new or updated datasets like validated OpenStreetMap data, bioacoustic data, COVID-19 detection data, and more.

Terabytes of Earth Observation (EO) data are collected each day, quickly leading to petabyte-scale datasets. By bringing these datasets to the cloud, users can use the compute and analytics resources of the cloud to reliably scale with growing needs. In this post, we show you how to set up a Pangeo solution with Kubernetes, Dask, and Jupyter notebooks step-by-step on Amazon Web Services (AWS), to automatically scale cloud compute resources and parallelize workloads across multiple Dask worker nodes.

Companies and asset managers looking to protect their financial investments from climate change-related risks, and invest in more sustainable solutions, can now access a new dataset on the Amazon Web Services (AWS) Cloud to help inform their decision making. Amazon announced that the Legal Entity Identifier (LEI) dataset is now available and free for anyone to access in the cloud. The dataset includes key reference information that supports clear and unique identification of legal entities participating in financial transactions, and each LEI contains information about an entity’s ownership structure, including ‘who is who’ and ‘who owns whom’.

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. We work with data providers to democratize access to data by making it available to the public for analysis on AWS; develop new cloud-native techniques, formats, and tools that lower the cost of working with data; and encourage the development of communities that benefit from access to shared datasets. Our full list of publicly available datasets are on the Registry of Open Data on AWS. This quarter, we released 26 new or updated datasets including datasets on climate, koala genomes, analysis ready radar data, and highly-queryable genomic data. Check out some highlights.

Ten Minute Tutorials for Research provides a way for researchers to quickly learn about topics and tools that are specific to their unique needs, covering the basics on how to get started and providing helpful links to get more in-depth information and support—all in ten minutes. The series is led by AWS solutions architects and AWS research business development specialists who work closely with researchers. Many of the presenters are former researchers themselves and content is specifically geared to a research audience.

The Allen Institute seeks to understand how our brains, cells, and immune systems work when we are healthy and, ultimately, how they go wrong in disease. Allen researchers have generated and shared atlases that map the brain, gene-edited stem cell lines, and many more resources that have been used by millions of scientists around the world to accelerate their research. In collaboration with AWS and the Registry of Open Data on AWS, they make many of their datasets publicly available. In celebration of Open Science Week, check out some of these open datasets from the Allen Institute, and their impact on the research community.

Weather radars see more than just the weather: they see smoke from fires, meteors, birds, mayflies, and almost anything else in the atmosphere. This makes weather radars an invaluable tool for scientists seeking to further the understanding of atmospheric processes and anything else that happens to be flying through the radar’s field of view. The Amazon Sustainability Data Initiative (ASDI) seeks to accelerate sustainability-related innovation and research by helping to minimizing the cost and time required to store, acquire, and analyze large weather and climate datasets.

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. This quarter, we released 44 new or updated datasets including satellite imagery over Africa, a large-scale climate ensemble, and product listings with 3D renderings. Learn how you can put these open datasets to work.

With a rapidly growing population, the world is increasingly dependent on the ability to develop and maintain sustainable agriculture and healthy environments. Learn how BASF Digital Farming is leveraging both National Oceanic and Atmospheric Administration (NOAA) weather data hosted on AWS, and commercial weather data, to develop digital solutions to help farmers effectively monitor and manage their fields, and help drive farm sustainability.