49 Members
Dataverse is open source research data repository software: http://dataverse.org Public logs at https://view.matrix.org/alias/%23dataverse:matrix.org2 Servers

Load older messages

22 Nov 2021
@oliver:bertuch.namepoikilothermThat's why I did the script13:51:56
@donsizemore:matrix.orgDon Sizemore@pdurbin how does this relate to the replacement schema.xml in the 5.8 release that fixed dataset search?13:52:00
@pdurbin:matrix.orgpdurbinIt's all highly related.13:52:42
@pdurbin:matrix.orgpdurbinSo maybe if I use the script I won't see the extra noise in the diff?13:52:56
@donsizemore:matrix.orgDon Sizemorebecause I've got to upgrade from 5.3 to 5.8+ at some point, with custom metadata blocks... 13:53:02
In reply to @pdurbin:matrix.org
Basically I curl http://localhost:8080/api/admin/index/solr/schema >> schema.xml and then edit the file with vi. Out with the old. In with the new.
Just do curl http://localhost:8080/api/admin/index/solr/schema | update-fields.sh schema.xml instead ;-)
In reply to @pdurbin:matrix.org
So maybe if I use the script I won't see the extra noise in the diff?
I'm not sure why the order of the study* fields changed. But as this is just what is given back by the API endpoint, sorting this is part of the Java code.
@oliver:bertuch.namepoikilothermUhm sorry but has there been any other change to the schema blocks lately?13:55:15
@pdurbin:matrix.orgpdurbinI don't think so. Anyway, I'll try the script and report back. Thanks.13:55:48
@oliver:bertuch.namepoikilothermI have no idea why the sorting in Java would have changed. No idea how that happened - sorry for that noise14:03:28
@oliver:bertuch.namepoikilothermThe schema files did not change since I merged the script14:03:44
@pdurbin:matrix.orgpdurbin poikilotherm: if you were to run the script on develop, schema.xml would be re-written to be the same file, right? A no-op, basically? 14:11:29
@pdurbin:matrix.orgpdurbinSo, by using the script it's an even bigger diff because indentation changes. If I do word-diff I see that studyAssayPlatform and friends change order as well. I think we should punt on all of this and deal with it when we pick up https://github.com/IQSS/dataverse/issues/824814:19:31
@pdurbin:matrix.orgpdurbin poikilotherm: I suspect you might be adding the extra indentation with this: sed -e 's#^# #' but I'm not sure. 14:23:42
@pdurbin:matrix.orgpdurbinThe output from the API is already indented.14:24:02
@pdurbin:matrix.orgpdurbin poikilotherm Don Sizemore do either of you have the cycles to try that no-op test I mentioned above? 14:26:28
@oliver:bertuch.namepoikilothermIIRC I delete the indentation but that might be just in my head14:26:28
@oliver:bertuch.namepoikilothermNot really - sorry14:39:21
@pdurbin:matrix.orgpdurbinNo worries. I'm still dinking around with it. At minimum, I'm fairly confident it will change the indentation. I'm less sure if it will change the order of those "study" fields or not.14:40:48
@donsizemore:matrix.orgDon Sizemore if it's just indentation we just could diff -w unless indentation breaks parsing? 14:42:26
In reply to @pdurbin:matrix.org
poikilotherm: that's an excellent point. scalarmotion you'd be welcome to have some time (maybe 5-10 minutes) to talk about what you're up to at a community call. We have them every other week. If this is of interest, please let me know and we can get you on the schedule. For more, please see https://dataverse.org/community-calls
Thanks for the invitation, I'll have to check with my supervisor to get back to you on that.
@oliver:bertuch.namepoikilotherm pdurbin: I pushed a first example https://github.com/IQSS/dataverse/pull/8254/files#diff-f7f8c09756ce44634bf7d9a243e628166a608079fffe7cd71f77f56f949114f6R764-L824 15:41:47
@pdurbin:matrix.orgpdurbin scalarmotion: another way to get some more attention and discussion is to post to https://groups.google.com/g/dataverse-community 15:50:44
@pdurbin:matrix.orgpdurbinAs you can see, we sometimes get in the weeds here. 😄15:51:01
@pdurbin:matrix.orgpdurbin poikilotherm: the database stuff is interesting. 15:53:02
@pdurbin:matrix.orgpdurbinWhen do we get to test S3? 😄15:53:13
@oliver:bertuch.namepoikilothermOh dear15:53:21
@oliver:bertuch.namepoikilothermLong way to go15:53:25

Show newer messages

Back to Room List