Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fetching data from the Argo reference dataset #53

Open
kamwal opened this issue Feb 9, 2021 · 8 comments
Open

Fetching data from the Argo reference dataset #53

kamwal opened this issue Feb 9, 2021 · 8 comments
Assignees
Labels
enhancement New feature or request ignore-for-release Ignore this for next release

Comments

@kamwal
Copy link
Contributor

kamwal commented Feb 9, 2021

It's probably still too early, but argopy is able to fetch and return data from the Argo reference dataset !

from argopy import DataFetcher as ArgoDataFetcher
loader = ArgoDataFetcher(src='erddap', ds='ref')
ds1 = loader.region([-85, -45, 10, 20, 0, 1000, ‘2012-01’, ‘2012-02’]).to_xarray()

we could develop an access point that would work with owc, ie using distances instead of a rectangular space/time domain

Originally posted by @gmaze in #30 (comment)

@kamwal kamwal added the enhancement New feature or request label Feb 9, 2021
@gmaze gmaze self-assigned this Oct 8, 2021
@imab4bsh
Copy link
Member

Dear @kamwal and @gmaze,
Do we currently have API access to the CTD reference database via pyowc?
What I understand is that argopy can access the Argo reference database, but the CTD reference data used in pyowc is currently accessed locally reading the mat files.

@kamwal
Copy link
Contributor Author

kamwal commented Apr 22, 2022

Currently, there is no available API to access CTD reference data via pyowc. CTD data can be only accessed by pyowc locally by reading your mat files from your local archive.
@gmaze please correct me if I am wrong and something has changed.

@gmaze
Copy link
Member

gmaze commented Apr 25, 2022

@kamwal you're right, CTD reference data are not yet available from argopy since it's not available from the Ifremer erdapp either. Only Argo reference data are available from argopy

@imab4bsh
Copy link
Member

Ok, thanks. And which format shoud the CTD reference have to make it available in the Ifremer erdapp? netCDF I guess... It is possible to password protect the data in the erdapp?

@gmaze
Copy link
Member

gmaze commented Apr 26, 2022

The issue is not the format but the user authentification
It's possible to have an erddap behind a login/password, so that CTD ref data are made available like today with the ftp and mat files.
But this has to be implemented by the Coriolis team ...

@kamwal kamwal added the ignore-for-release Ignore this for next release label Nov 7, 2022
@kamwal
Copy link
Contributor Author

kamwal commented Nov 7, 2022

I think this ticket is not relevant with a main code functionality

@gmaze
Copy link
Member

gmaze commented Nov 8, 2022

I think this ticket is not relevant with a main code functionality

sorry @kamwal I don't understand

@gmaze
Copy link
Member

gmaze commented Sep 29, 2023

hi there,
I forget to mention that argopy is now able to retrieve both the Argo and the ship-CTD reference dataset !

Argo floats reference dataset for DMQC

from argopy import DataFetcher
loader = DataFetcher(src='erddap', ds='ref')
ds = loader.region([-85, -45, 10, 20, 0, 1000, ‘2012-01’, ‘2012-02’]).to_xarray()

Ship-CTD reference dataset for DMQC

Using user/password new argopy options, it is possible to fetch the Argo CTD reference database, with the CTDRefDataFetcher class. (#256) by G. Maze

from argopy import CTDRefDataFetcher

with argopy.set_options(user="john_doe", password="***"):
    f = CTDRefDataFetcher(box=[15, 30, -70, -60, 0, 5000.0])
    ds = f.to_xarray()

We're waiting for someone at @euroargodev/coriolis to update the erddap server for you to be able to use your login/password as provided by @coatanoan at the time of your request of the reference dataset.

When this will be done, we'll be good to go to update pywoc to fetch reference data online

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request ignore-for-release Ignore this for next release
Projects
None yet
Development

No branches or pull requests

3 participants