!AmypvmJtUjBesRrnLM:matrix.org

dataverse

189 Members
Dataverse is open source research data repository software: http://dataverse.org Public logs at https://view.matrix.org/alias/%23dataverse:matrix.org9 Servers

Load older messages


SenderMessageTime
21 Jun 2021
@pdurbin:matrix.orgpdurbin poikilotherm: I'm still quite happy with reviewdog barking about misplaces curlies. Thanks again. 🐶 18:06:15
@pdurbin:matrix.orgpdurbin * poikilotherm: I'm still quite happy with reviewdog barking about misplaced curlies. Thanks again. 🐶 18:16:33
22 Jun 2021
@xarthisius:matrix.orgKacper Kowalik pdurbin: problems continue... https://github.com/IQSS/dataverse/issues/7962 Seems like a lot of breakage went unnoticed solely due to the fact that we are using "prerecorded" responses from Dataverse in our test suite. We do that to make tests faster and avoid straining public DV instances, but it's clearly wrong approach... 15:08:45
@pdurbin:matrix.orgpdurbin Kacper Kowalik: hmm. Thanks for the heads up about that too. 16:44:57
23 Jun 2021
@vbernabe:matrix.orgvbernabe joined the room.07:59:26
@vbernabe:matrix.orgvbernabeHi there. Is there any documentation for backup and restore? We need to shutdown our server and re-create our Dataverse installation. 07:59:59
@vbernabe:matrix.orgvbernabeWe installed the same version to the new server, copied the old datafilee and import the database but it seems like the Datasets are not showing up.08:00:25
@pdurbin:matrix.orgpdurbin vbernabe: hi. During a session on data preservation in the Dataverse Community Meeting last week we talked about how we don't have a lot of docs on backups. This page is quite short: https://guides.dataverse.org/en/5.5/admin/backups.html 14:16:45
@pdurbin:matrix.orgpdurbinIf datasets aren't showing up, you might need to reindex Solr.14:17:18
@pdurbin:matrix.orgpdurbin Kacper Kowalik: so! Searching by entityId does work BUT we only index files from the latest published version of the dataset (plus drafts but don't worry about that). So the behavior you found is expected. 15:37:56
@pdurbin:matrix.orgpdurbinHere's how I put it just now in Slack: 3040230 is in v2 of the dataset but there’s a v3 that doesn’t have that file (it was replaced). So it’s expected that the file isn’t in the index.15:38:16
@pdurbin:matrix.orgpdurbin Kacper Kowalik: the thing we're wondering is... when did the search for that file stop working for you? It should have stopped working in 2017. 😀 17:59:27
24 Jun 2021
@oliver:bertuch.namepoikilotherm pdurbin: Look who just got merged. https://github.com/gdcc/dataverse/pull/6#event-4933611438 12:54:03
@oliver:bertuch.namepoikilothermIt works automatically :-)12:54:12
@oliver:bertuch.namepoikilotherm(It took some time, don't know why. Maybe waiting for Travis?)12:54:34
@pdurbin:matrix.orgpdurbin poikilotherm: cool. So you'll get all the commits from IQSS automatically plus some merge commits from the pull bot. 14:00:38
@oliver:bertuch.namepoikilothermYeah14:00:53
@oliver:bertuch.namepoikilothermUntil someone feels like adding the container stuff to upstream14:01:32
@oliver:bertuch.namepoikilotherm@pd14:35:13
@oliver:bertuch.namepoikilotherm * pdurbin: got Docker? 14:35:29
@pdurbin:matrix.orgpdurbin poikilotherm: yep 15:30:41
@oliver:bertuch.namepoikilothermYou might be interested in experimenting with Maven controlled container build & execution15:32:13
@oliver:bertuch.namepoikilothermAfter checking out the branch, it's a oneliner and some waiting until you can open a dev snapshot at localhost:808015:33:19
@pdurbin:matrix.orgpdurbinNice. I know you've had this in a branch for a whlie.15:34:00
@pdurbin:matrix.orgpdurbinOh, I see. You put a bunch of detail is Slack. How non-SLOPI of you. 😀15:36:52
@pdurbin:matrix.orgpdurbin * Oh, I see. You put a bunch of detail in Slack. How non-SLOPI of you. 😀15:36:59
@oliver:bertuch.namepoikilotherm

Hey devops peeps... I invested some time into a Maven controlled build of container images for Dataverse and a derived Solr image.
Feel free to checkout https://github.com/gdcc/dataverse/tree/develop+ct
It get's the latest and hottest commits from upstream develop automatically
And if you have Docker installed, just use Maven to build and run a containerized dev version of Dataverse
It's just mvn -Pct clean package docker:build docker:run
(You'll need to add the gdcc fork as a remote first and then checkout the branch)
It takes some time to build when there is no cache around, but at least it does not download the internet, reusing your local Maven packages.
The container image for Dataverse is highly optimized for production usage, but can be used for development, too.
If you folks wanna schedule a demo of what can be done with this, hit me
(I could do a little YT screencast video, too) (bearbeitet)
BTW scripts and Dockerfiles are checked for PRs with hadolint and shellcheck.
Things to come:

  • I want to add proper LABELS following https://github.com/opencontainers/image-spec/blob/master/annotations.md and push to Github Container Registry...
  • Before pushing, I want to execute some basic tests if deployments work etc. This is mostly about securing that the images work, not so much about Dataverse itself
15:37:54
@oliver:bertuch.namepoikilotherm Don Sizemore pdurbin you peeps might be interested in https://github.com/poikilotherm/dataverse/commit/624636992e4a27f0b52e430f0d54c983770a1b5c 15:39:58
@oliver:bertuch.namepoikilothermWorks with 5.2021.415:40:12
@pdurbin:matrix.orgpdurbin poikilotherm: that's better. Thanks! 15:44:27

Show newer messages


Back to Room ListRoom Version: 6