Awesome Pangeo

A curated list of awesome Pangeo related Python frameworks, libraries, software and resources.

• Awesome Pangeo
  • Pangeo Core Packages
  • Data Cataloging
  • Data Wrangling
  • Tutorials and Talks

---

Pangeo Core Packages

• Xarray - Tools for working with labelled multi-dimensional arrays
• Zarr - A Python package providing an implementation of chunked, compressed, N-dimensional arrays.
• Dask - A flexible library for parallel computing in Python.
• JupyterHub - A multi-user Hub, spawns, manages, and proxies multiple instances of the single-user Jupyter notebook server.
• Zero to JupyterHub - Resources for deploying JupyterHub to a Kubernetes Cluster
• Jupyterlab - The next-generation web-based user interface for Project Jupyter.

Data Cataloging

• Intake - A lightweight package for finding, investigating, loading and disseminating data.
• Intake-xarray - Intake plugin for xarray
• Intake-cmip - An intake plugin for reading CMIP5, and CMIP6 data using intake
• Intake-cesmle - An intake plugin for reading CESM Large Ensemble datasets.

Data Wrangling

• Esmlab - Tools for working with earth system multi-model analyses with xarray.

Tutorials and Talks

• Pangeo Tutorial at the 2018 AGU Fall Meeting - dask, xarray

• Pangeo Tutorial for 2018 UCAR SEA Conference - dask, xarray

• Dask for Parallel Computing and Big Data - dask, xarray

• Xarray for Multidimensional Data - xarray

• Python (and git) lesson for atmosphere and ocean scientists - xarray

• Pangeo: A Big Data Ecosystem for Scalable Earth System Science - SciPy 2018

• Parallelizing Scientific Python with Dask - SciPy 2018

  • Materials

• Dask examples

• ESIP Tech Dive: "Pangeo: A big data science platform"

• ESIP Tech Dive: "Intake"

• ESIP Tech Dive: "Zarr: An open, scalable solution for big NetCDF/HDF data on the Cloud"