Develop water level data ingest pipeline adaptors for IRA WL project
The IRA T2 water level project is developing a data pipeline that enables standardized data collection and processing across RAs, data access services, and delivery to key partners such as (NDBC and NCEI).
This project will leverage initial data pipeline infrastructure that’s available by the time of the Code Sprint, partially sourced from outcomes from the related OTT MODL project, to provide the RA WL data community tools to prototype and test developing adaptors to connect with WL data providers/APIs planned for use in the IRA WL project.
Expected Outcomes
- A set of adaptors for different water level data providers in the IRA-water-levels GitHub repo. https://github.com/ioos/IRA-water-levels.
- Lessons learned and requirements for data pipeline functionality to be fed back to the data pipeline development team for further development
Skills required
- Python (in particular Dagster, TBD?)
- A water level data provider account/API to work with for source data
Expertise
Intermediate
Topic Lead(s)
@mwengren, @srstsavage (TDB)
Relevant links
https://github.com/ioos/IRA-water-levels
Functioning Prototype
TBD
Workflow
Tasks:
Updates