!vOdzGZKXWNcVUfgmVN:matrix.org

OpenPlanetary - mapping tools

46 Members
Part of the OpenPlanetary community | +open-planetary:matrix.org1 Servers

Load older messages


SenderMessageTime
22 Oct 2020
@_slack_openplanetary_U01DRLQ3PSL:matrix.orgSarah Hasnain set a profile picture.00:26:15
@_slack_openplanetary_U01DRLQ3PSL:matrix.orgSarah Hasnain changed their profile picture.18:23:18
23 Oct 2020
@_slack_openplanetary_U01D6BQKX50:matrix.orgJustin Cowart joined the room.06:37:03
@_slack_openplanetary_U01D6BQKX50:matrix.orgJustin Cowart changed their display name from _slack_openplanetary_U01D6BQKX50 to Justin Cowart.17:50:31
@_slack_openplanetary_U01D6BQKX50:matrix.orgJustin Cowart set a profile picture.17:50:33
29 Oct 2020
@_slack_openplanetary_U04CXH18V:matrix.orgarosp I mention here as we lack - odd - a #data or #data-access channel (meant as data availability). I think we should add. Not all is on PDS or PSA (or GSF), and some stuff is on Zenodo (try to look for e.g. “Mars”, you find things, but with high noise in the search results….). Probably the same for Figshare. Most very recent papers have some sort of (mandatory-ish) data repository somewhere associated, but some don’t. #data-discovery is also a possible channel / sub-channel . Some colleague asked me “where are data on valley networks?” . I recalled the data from Brian Hynek and that they were somewhere either on PDS Geosciences or USGS, but they are not linked not searchable anywhere (BTW, WUSTL used to have non-pds data, I think some from fcalef and Klaus Gwinner , too), are they still around? I don’t seem to find them anymore (I did not look for them for years). Anyway, things such as ftp://pdsimage2.wr.usgs.gov/pub/pigpen/mars/channels/ can be still useful but not all is discoverable thare , even googling based on (mis)trust of my memory…. I also realise that the paper of galemanno points to OPM, but acesssing (and to start with, finding) would be something interesting for several. 13:40:33
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U04CXH18V:matrix.org
I mention here as we lack - odd - a #data or #data-access channel (meant as data availability). I think we should add. Not all is on PDS or PSA (or GSF), and some stuff is on Zenodo (try to look for e.g. “Mars”, you find things, but with high noise in the search results….). Probably the same for Figshare. Most very recent papers have some sort of (mandatory-ish) data repository somewhere associated, but some don’t. #data-discovery is also a possible channel / sub-channel . Some colleague asked me “where are data on valley networks?” . I recalled the data from Brian Hynek and that they were somewhere either on PDS Geosciences or USGS, but they are not linked not searchable anywhere (BTW, WUSTL used to have non-pds data, I think some from fcalef and Klaus Gwinner , too), are they still around? I don’t seem to find them anymore (I did not look for them for years). Anyway, things such as ftp://pdsimage2.wr.usgs.gov/pub/pigpen/mars/channels/ can be still useful but not all is discoverable thare , even googling based on (mis)trust of my memory…. I also realise that the paper of galemanno points to OPM, but acesssing (and to start with, finding) would be something interesting for several.
Thia was a bit also one of the ideas behind https://meetingorganizer.copernicus.org/EPSC2018/EPSC2018-677-1.pdf but in general as easy as it is to find references on google scholar (also preprints show up) it is not for datasets attached to publications ... Like derived datasets (at yesterday Pss webinar at dps I was mentioning as an example one paper from jpmul and the companion data on ESA Gsf it's not always that easy and even in this case, i did know about it there is no data discovery for it
14:22:46
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply toundefined
The latter was linked to a short discussion with Laurent Montesi at the above webinar. But it's relevant for OP (not only planetsry mapping of course. Just geospatial data discovery could be possibly easier than other derived observations or models, e.g. plasma )
14:25:09
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply toundefined
(edited) ... possibly be easier ... => ... possibly easier ...
14:26:45
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U04CXH18V:matrix.org
The latter was linked to a short discussion with Laurent Montesi at the above webinar. But it's relevant for OP (not only planetsry mapping of course. Just geospatial data discovery could be possibly easier than other derived observations or models, e.g. plasma )
Astropedia of usgs has a nice interface and functionality (and dataset metadata ) but it does cover usgs only
14:34:04
@_slack_openplanetary_U5V8N9WMV:matrix.orgrbeyer
In reply to@_slack_openplanetary_U04CXH18V:matrix.org
Astropedia of usgs has a nice interface and functionality (and dataset metadata ) but it does cover usgs only
This is related to the concept of a Data Clearinghouse (Beyer et al 2018), but nothing has been created, and I haven't figured out how to get something like it funded. A channel would be okay, but I think this kind of "request" for where anyone knows where some kind of data is, is also relevant for #open-planetary:matrix.org.
14:50:15
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U5V8N9WMV:matrix.org
This is related to the concept of a Data Clearinghouse (Beyer et al 2018), but nothing has been created, and I haven't figured out how to get something like it funded. A channel would be okay, but I think this kind of "request" for where anyone knows where some kind of data is, is also relevant for #open-planetary:matrix.org.
I think something like that in the EU could be around or under OpenAire
15:22:20
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U04CXH18V:matrix.org
I think something like that in the EU could be around or under OpenAire
rbeyer yes #open-planetary:matrix.org is good to ask, but i meant a channel to discuss this sort of data discovery (particularly linked to publications as other data discovery is already taken care by archives or VO or alike ).
15:33:50
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
I think we are getting closer to these supporting these goals but one portal (or facility), on its own, trying to hold all the "analysis-ready" data doesn't really help -- unless it has everything! Thus one of Ross's key sentences is something I hope we can emulate as a community: The National Geospatial Data Clearinghouse does not, itself, primarily archive data. Instead, it acts as a central catalog of available data sets, through its https://www.geoplatform.gov portal, and those data sets are hosted elsewhere. But to make that a reality all portals whether they are USGS, JPL, PSA/GSF, Universities, ect. need to support the same catalog standard (which implies very similar metadata). Started in the early 2010s Astropedia/Annex was created with very strong ties with metadata based on the FGDC/ISO standards. But our misstep is that it remains a silo (not supporting a catalog standard or standardized API). Thus in 2015 we started researching how to use this home-grown infrastructure to support the OGC CSW (catalog standard). Thus this LPSC abstract: https://www.hou.usra.edu/meetings/lpsc2015/pdf/2476.pdf . To help get closer to that goal, we now we support the export for all products as a FGDC record (enhanced for planetary), but there is still no standardized API. Thus, we are currently transitions the back-end CMS for Astropedia/Annex to CKAN which is a proper (open source) geospatial data portal using OGC standards. But to really be useful, others will need to hopefully use the same standard. If there is different standard we need to look into we would be happy to hear about it. Also is OGC CSW the answer? Maybe, but it will have the same issues as other OGC standards which are highly Earth-centric. And again one CSW catalog doesn't help realize a Data Clearinghouse -- which can harvest records from multiple catalogs. Lastly, does the PDS play a role in this? I sure hope so, but remember PDS holds so many more data types than simply geospatial data (and much of it is not yet "analysis-ready"). But somehow cataloging the derived analysis-ready holdings of the PDS would be amazing. I assume we would need to support a translation from a PDS API (somewhat still in the works) to a CSW standard if we as a community land on that standard.
15:55:03
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... its own ,trying to ... => ... its own, trying to ...
15:55:36
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... as as a FGDC record (enhanced-for-planetary). But there is still no standardize API. Also is OGC CSW the answer? Maybe, but it will have the same issues as other OGC standards which are highly Earth-centric. And again *one* CSW catalog doesn't help realize a Data Clearinghouse -- which can harvest records from multiple catalogs. Thus we are currently transitions the back-end for Astropedia/Annex to CKAN (which is a proper geospatial data portal using OGC standards). But ... => ... as a FGDC record (enhanced-for-planetary). But there is still no standardize API. Also is OGC CSW the answer? Maybe, but it will have the same issues as other OGC standards which are highly Earth-centric. And again *one* CSW catalog doesn't help realize a Data Clearinghouse -- which can harvest records from multiple catalogs. Thus we are currently transitions the back-end for Astropedia/Annex to CKAN (which is a proper (open source) geospatial data portal using OGC standards. But ...
15:57:55
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... yet "analysis-ready". But somehow cataloging the derived analysis-ready ... => ... yet "analysis-ready"). But somehow cataloging the *derived* analysis-ready ...
15:58:32
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... the FCGD/ISO standards. ... => ... the FGDC/ISO standards. ...
16:06:46
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... API. Also is OGC CSW the answer? Maybe, but it will have the same issues as other OGC standards which are highly Earth-centric. And again *one* CSW catalog doesn't help realize a Data Clearinghouse -- which can harvest records from multiple catalogs. Thus we are currently transitions the back-end for Astropedia/Annex to CKAN (which is a proper (open source) geospatial data portal using OGC standards. But to really be useful, others will need to hopefully use the same standard. If there is different standard we need to look into we would be happy to hear about it. Lastly, ... => ... API. Thus we are currently transitions the back-end for Astropedia/Annex to CKAN (which is a proper (open source) geospatial data portal using OGC standards. But to really be useful, others will need to hopefully use the same standard. If there is different standard we need to look into we would be happy to hear about it. Also is OGC CSW the answer? Maybe, but it will have the same issues as other OGC standards which are highly Earth-centric. And again *one* CSW catalog doesn't help realize a Data Clearinghouse -- which can harvest records from multiple catalogs. Lastly, ...
16:07:47
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... . And now we support the export for all products as a FGDC record (enhanced-for-planetary). But there is still no standardize API. Thus we ... => ... . To help get closer to that goal, we now we support the export for all products as a FGDC record (enhanced-for-planetary), but there is still no standardize API. Thus, we ...
16:14:54
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... CKAN (which is ... => ... CKAN which is ...
16:15:33
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... record (enhanced-for-planetary), but there is still no standardize API. Thus, we are currently transitions the back-end for ... => ... record (enhanced for planetary), but there is still no standardized API. Thus, we are currently transitions the back-end CMS for ...
16:16:41
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U04E55F4Z:matrix.org
I think we are getting closer to these supporting these goals but one portal (or facility), on its own, trying to hold all the "analysis-ready" data doesn't really help -- unless it has everything! Thus one of Ross's key sentences is something I hope we can emulate as a community: The National Geospatial Data Clearinghouse does not, itself, primarily archive data. Instead, it acts as a central catalog of available data sets, through its https://www.geoplatform.gov portal, and those data sets are hosted elsewhere. But to make that a reality all portals whether they are USGS, JPL, PSA/GSF, Universities, ect. need to support the same catalog standard (which implies very similar metadata). Started in the early 2010s Astropedia/Annex was created with very strong ties with metadata based on the FGDC/ISO standards. But our misstep is that it remains a silo (not supporting a catalog standard or standardized API). Thus in 2015 we started researching how to use this home-grown infrastructure to support the OGC CSW (catalog standard). Thus this LPSC abstract: https://www.hou.usra.edu/meetings/lpsc2015/pdf/2476.pdf . To help get closer to that goal, we now we support the export for all products as a FGDC record (enhanced for planetary), but there is still no standardized API. Thus, we are currently transitions the back-end CMS for Astropedia/Annex to CKAN which is a proper (open source) geospatial data portal using OGC standards. But to really be useful, others will need to hopefully use the same standard. If there is different standard we need to look into we would be happy to hear about it. Also is OGC CSW the answer? Maybe, but it will have the same issues as other OGC standards which are highly Earth-centric. And again one CSW catalog doesn't help realize a Data Clearinghouse -- which can harvest records from multiple catalogs. Lastly, does the PDS play a role in this? I sure hope so, but remember PDS holds so many more data types than simply geospatial data (and much of it is not yet "analysis-ready"). But somehow cataloging the derived analysis-ready holdings of the PDS would be amazing. I assume we would need to support a translation from a PDS API (somewhat still in the works) to a CSW standard if we as a community land on that standard.
ok, but - say - each journal has a mapping of papers:datasets (and any machine with access to the full text). those could be entries (if geospatial) somewhere in an index (I am not sure if CSW is the answer). Most, I fear, as long as data are provided, are OK (it’s already a good thing to have any data available…). In any case, when you mention universities, and agencies, or institutions, they can have an active role yes, but say existing data archives or journals or data journals have already valuable data that people might be interested to use but not necessarily find so easily One thing that they do nicely in Earth Science is pangea.de that has a matching journal, I think Earth System Data of Copernicus). It’s a complex problem, but to start with, for geospatial data (say raster images used in a paper, or vector). even just based on their location (centroid, even just) , would be a start.
16:25:12
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U04CXH18V:matrix.org
ok, but - say - each journal has a mapping of papers:datasets (and any machine with access to the full text). those could be entries (if geospatial) somewhere in an index (I am not sure if CSW is the answer). Most, I fear, as long as data are provided, are OK (it’s already a good thing to have any data available…). In any case, when you mention universities, and agencies, or institutions, they can have an active role yes, but say existing data archives or journals or data journals have already valuable data that people might be interested to use but not necessarily find so easily One thing that they do nicely in Earth Science is pangea.de that has a matching journal, I think Earth System Data of Copernicus). It’s a complex problem, but to start with, for geospatial data (say raster images used in a paper, or vector). even just based on their location (centroid, even just) , would be a start.
anyway, based on the above thare rbeyer perhaps a #data-discovery channel would be OK 😉
16:33:41
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
bingo - pangea.de reminds me of what dataone.org and USGS's own ScienceBase (which have continued to look at for our needs -- but S.B. continues to be tough for planetary). This a great data portal example supporting APIs to allow for harvest. Interesting, Pangea has their own metadata standard (although perhaps based on DataCite metadata). Their API is also not OGC but The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) "is a protocol developed by the Open Archives Initiative. It can be used to harvest (or collect) the metadata descriptions of PANGAEA so that services (like data portals) can be built." Need to look into that.
16:58:16
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply toundefined
(edited) ... USGS's ScienceBase (which have continue to look at for our needs). The is a ... => ... USGS's own ScienceBase (which have continued to look at for our needs -- but S.B. continues to be tough for planetary). This a ...
16:59:14
@_slack_openplanetary_U04E55F4Z:matrix.orgthare
In reply to@_slack_openplanetary_U04E55F4Z:matrix.org
bingo - pangea.de reminds me of what dataone.org and USGS's own ScienceBase (which have continued to look at for our needs -- but S.B. continues to be tough for planetary). This a great data portal example supporting APIs to allow for harvest. Interesting, Pangea has their own metadata standard (although perhaps based on DataCite metadata). Their API is also not OGC but The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) "is a protocol developed by the Open Archives Initiative. It can be used to harvest (or collect) the metadata descriptions of PANGAEA so that services (like data portals) can be built." Need to look into that.
BTW, I tried to forgo the walled-garden that is Slack and head over to the OP Forum, but you all pulled me back in! 😉 So yes data-discovery sounds good.
17:03:42
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply to@_slack_openplanetary_U04E55F4Z:matrix.org
BTW, I tried to forgo the walled-garden that is Slack and head over to the OP Forum, but you all pulled me back in! 😉 So yes data-discovery sounds good.
Ok then I can pull you also on that newly created channel.. ;-) and yes we should go outside the walls too
17:04:34
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply toundefined
I might know some of the Pangea devs as we are "neighbors " if you need thare. But those i knew maybe have retired
17:05:59
@_slack_openplanetary_U04CXH18V:matrix.orgarosp
In reply toundefined
(edited) ... i kens maybe ... => ... i knew maybe ...
17:08:25

There are no newer messages yet.


Back to Room List