Build your Python skills with interactive courses for data science, data analysis and machine learning, curated by real-world experts

GitHub - jmartinezheras/2018-MachineLearning-Lectures-ESA: Machine Learning Lectures at the European Space Agency (ESA) in 2018

Moving Files from one Git Repository to Another, Preserving History | Greg Bayer

Geospatial data, including many climate and weather datasets, are often released by government and nonprofit organizations in compressed file formats such as the Network Common Data Form (NetCDF) or GRIdded Binary (GRIB). As the complexity and size of geospatial datasets continue to grow, it is more time- and cost-efficient to leave the files in one place, virtually query the data, and download only the subset that is needed locally. Unlike legacy file formats, the cloud-native Zarr format is designed for virtual and efficient access to compressed chunks of data saved in a central location such as Amazon S3. In this walkthrough, learn how to convert NetCDF datasets to Zarr using an Amazon SageMaker notebook and an AWS Fargate cluster and query the resulting Zarr store, reducing the time required for time series queries from minutes to seconds.