VRE installed libs and tools
Here is a list of tools and libraries pre-installed into the VRE.
Base components
| Type | Library | Description |
|---|---|---|
| Python library | black | The uncompromising Python code formatter |
| Python library | bokeh | Bokeh is an interactive visualization library for modern web browsers |
| Python library | bqplot | 2-D plotting library for Project Jupyter |
| Python library | cookiecutter | Cookiecutter creates projects from project templates, e.g. Python package projects |
| Python library | dask | Dask provides advanced parallelism for analytics, enabling performance at scale for the tools you love |
| Python library | dask-jobqueue | Easily deploy Dask on job queuing systems like PBS |
| Python library | dask-distributed | Dask.distributed is a lightweight library for distributed computing in Python |
| Python library | flake8 | The modular source code checker |
| Python library | hvplot | A high-level plotting API for the PyData ecosystem built on HoloViews |
| Python library | ipywidgets | Interactive Widgets for the Jupyter notebook |
| Python library | isort | isort your python imports for you so you don't have to |
| Python library | matplotlib | Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations |
| Python library | numpy | NumPy is the fundamental package for scientific computing with Python |
| Python library | numpy-stl | Simple library to make working with STL files (and 3D objects in general) fast and easy |
| Python library | pandas | pandas is a fast, powerful, flexible and easy to use open source data analysis and manipulation tool |
| Python library | pandoc | If you need to convert files from one markup format into another, pandoc is your swiss-army knife |
| Python library | panel | Panel is an open-source Python library that lets you create custom interactive web apps and dashboards by connecting user-defined widgets to plots, images, tables, or text |
| Python library | papermill | Papermill is a tool for parameterizing and executing Jupyter Notebooks |
| Python library | plotly | An open-source, interactive graphing library for Python |
| Python library | pre-commit | A framework for managing and maintaining multi-language pre-commit hooks |
| Python library | pylint | Python static code analysis tool which looks for programming errors, helps enforcing a coding standard, sniffs for code smells and offers simple refactoring suggestions |
| Python library | pyscaffold | Template tool for putting up the scaffold of a Python project |
| Python library | pytest | Simple powerful testing with Python |
| Python library | pytest-cov | Pytest plugin for measuring coverage |
| Python library | scikit-image | scikit-image is a collection of algorithms for image processing |
| Python library | scipy | SciPy is a Python-based ecosystem of software for mathematics, science, and engineering |
| Python library | tables | PyTables is a package for managing hierarchical datasets and designed to efficiently and easily cope with extremely large amounts of data |
| Python library | termcolor | ANSII Color formatting for output in terminal |
| Python library | virtualenv | Virtual Python Environment builder |
| Python library | voila | Voilà allows you to convert a Jupyter Notebook into an interactive dashboard that allows you to share your work with others |
| JupyterLab extension | dask | Provides a JupyterLab extension to manage Dask clusters, as well as embed Dask's dashboard plots directly into JupyterLab panes |
| JupyterLab extension | drawio | A JupyterLab extension for standalone integration of drawio / mxgraph |
| JupyterLab extension | ipysheet | Spreadsheet in the Jupyter notebook |
| JupyterLab extension | nb-black | A simple extension for Jupyter Notebook and Jupyter Lab to beautify Python code automatically using Black |
| JupyterLab extension | plotly | JupyterLab support for plotly library |
Machine learning components
| Type | Library | Description |
|---|---|---|
| Python library | dask-ml | Dask-ML provides scalable machine learning in Python using Dask alongside popular machine learning libraries like Scikit-Learn |
| Python library | dvc | Open-source Version Control System for Machine Learning Projects |
| Python library | keras | Keras is a high-level neural networks API, written in Python and capable of running on top of TensorFlow, CNTK, or Theano |
| Python library | mlflow | Open source platform for the Machine Learning lifecycle |
| Python library | scikit-learn | Simple and efficient tools for predictive data analysis |
| Python library | tensorflow | The core open source library to help you develop and train ML models |
| Python library | torch | An open source machine learning framework that accelerates the path from research prototyping to production deployment |
| Python library | torchvision | The torchvision package consists of popular datasets, model architectures, and common image transformations for computer vision |
| Python library | xgboost | XGBoost is an optimized distributed gradient boosting library designed to be highly efficient, flexible and portable |
| JupyterLab extension | tensorboard | Provides Tensorboard integration into JupyterLab |
Earth observation components
| Type | Library | Description |
|---|---|---|
| Library | GDAL | GDAL (Geospatial Data Abstraction Library) is a library for reading and writing raster and vector geospatial data formats |
| Library | OTB | Orfeo Toolbox is a library for remote sensing image processing |
| Library | MicMac | Micmac is the photogrammetry software developped at the IGN (French National Geographic Institute) and ENSG (French national school for geographic sciences) |
| Library | OpenCV | OpenCV is an open-source library that includes several hundreds of computer vision algorithms |
| Python library | albumentations | Albumentations is a fast image augmentation library and easy to use wrapper around other libraries (based on OpenCV, imgaug and numpy) |
| Python library | cars | CARS is a dedicated and open source 3D tool to produce Digital Surface Models from satellite imaging by photogrammetry |
| Python library | cartopy | Cartopy is a Python package designed for geospatial data processing in order to produce maps and other geospatial data analyses |
| Python library | eodag | Python framework for searching, aggregating results and downloading remote sensed images |
| Python library | eodag-cube | eodag-cube is an external package of eodag that is used to access a product’s data, it is going to be used to calculate the NDVI of a product |
| Python library | fiona | Fiona reads and writes geographic data files with GDAL in a pythonic way |
| Python library | folium | Manipulate your data in Python, then visualize it in on a Leaflet map via folium |
| Python library | gdal | Python wrapper for GDAL |
| Python library | gdal2tiles | A python library for generating map tiles based on gdal2tiles.py script |
| Python library | geojson | Python bindings and utilities for GeoJSON |
| Python library | geopandas | GeoPandas extends the datatypes used by pandas to allow spatial operations on geometric types |
| Python library | glymur | Glymur is an interface to the OpenJPEG library which allows one to read and write JPEG 2000 files from Python |
| Python library | haversine | Calculate the distance bewteen 2 points on Earth |
| Python library | ipyleaflet | Interactive maps in the Jupyter notebook |
| Python library | ipyvolume | Python library to visualize 3d volumes and glyphs (e.g. 3d scatter plots), in the Jupyter notebook, with minimal configuration and effort |
| Python library | keplergl | This is the kepler.gl jupyter widget, an advanced geospatial visualization tool, to render large-scale interactive maps in Jupyter Notebook |
| Python library | mapboxgl | MapboxGL plugin for Jupyter Notebooks |
| Python library | opencv-python | OpenCV-Python is a library of Python bindings designed to solve computer vision problems |
| Python library | osmium | Python bindings for libosmium, the data processing library for OSM data |
| Python library | plotly-express | Plotly Express is a terse, consistent, high-level API for rapid data exploration and figure generation |
| Python library | pygeos | Python wrapper for GEOS into numpy ufuncs |
| Python library | rasterio | Rasterio reads and writes raster formats and provides a Python API based on Numpy N-dimensional arrays and GeoJSON |
| Python library | rasterstats | Rasterstats is a Python module for summarizing geospatial raster datasets based on vector geometries |
| Python library | rio-cogeo | CloudOptimized GeoTIFF (COGEO) creation plugin for rasterio |
| Python library | rio-tiler | rio-tiler was designed to create slippy map tiles ffrom any raster source supported by Rasterio/GDAL and render these tiles dynamically on a web map |
| Python library | rtree | R-Tree spatial index for Python GIS |
| Python library | sat-search | Sat-search is a Python 3 library and a command line tool for discovering and downloading publicly available satellite imagery using STAC compliant API |
| Python library | shapely | Geometric objects, predicates, and operations |
| Python library | snappy_esa | Python library to use SNAP Java API |
| Python library | spatialpandas | pandas and dask extensions for vectorized spatial and geometric operations |
| Python library | tripy | Tripy is a simple module with one purpose: triangulating polygons |
| Python library | xarray-spatial | xarray-based spatial analysis tools |
| JupyterLab extension | eodag-labextension | JupyterLab extension easing eodag search code generation; see also this tutorial |
| JupyterLab extension | geojson | Render GeoJSON file and structures into JupyterLab |
| Desktop client | Monteverdi | OTB desktop client |
| Desktop client | QGis | Open source Geographical Information System (GIS) |
AI4GEO components
| Type | Library | Description |
|---|---|---|
| Python library | ai4geo-pipeline | LoD0 product generation pipeline |
| Python library | bulldozer | DTM extraction using Drap cloth filter |
| Python library | dlcooker | DLCooker is a micro-framework that simplifies the training of deep learning algorithms |
| Python library | labelcooker | An efficient and scalable approach to AI training labels generation from geospatial vector data |
| Python library | playground-detection-scoring | |
| Python library | regularisation | Simplify and regularize polygon boundaries: regularization process transforms segmentation maps into structured individual building polygons |