21 Jun 2021 |
pdurbin | poikilotherm: I'm still quite happy with reviewdog barking about misplaces curlies. Thanks again. 🐶 | 18:06:15 |
pdurbin | * poikilotherm: I'm still quite happy with reviewdog barking about misplaced curlies. Thanks again. 🐶 | 18:16:33 |
22 Jun 2021 |
Kacper Kowalik | pdurbin: problems continue... https://github.com/IQSS/dataverse/issues/7962 Seems like a lot of breakage went unnoticed solely due to the fact that we are using "prerecorded" responses from Dataverse in our test suite. We do that to make tests faster and avoid straining public DV instances, but it's clearly wrong approach... | 15:08:45 |
pdurbin | Kacper Kowalik: hmm. Thanks for the heads up about that too. | 16:44:57 |
23 Jun 2021 |
| vbernabe joined the room. | 07:59:26 |
vbernabe | Hi there. Is there any documentation for backup and restore? We need to shutdown our server and re-create our Dataverse installation. | 07:59:59 |
vbernabe | We installed the same version to the new server, copied the old datafilee and import the database but it seems like the Datasets are not showing up. | 08:00:25 |
pdurbin | vbernabe: hi. During a session on data preservation in the Dataverse Community Meeting last week we talked about how we don't have a lot of docs on backups. This page is quite short: https://guides.dataverse.org/en/5.5/admin/backups.html | 14:16:45 |
pdurbin | If datasets aren't showing up, you might need to reindex Solr. | 14:17:18 |
pdurbin | Kacper Kowalik: so! Searching by entityId does work BUT we only index files from the latest published version of the dataset (plus drafts but don't worry about that). So the behavior you found is expected. | 15:37:56 |
pdurbin | Here's how I put it just now in Slack: 3040230 is in v2 of the dataset but there’s a v3 that doesn’t have that file (it was replaced). So it’s expected that the file isn’t in the index. | 15:38:16 |
pdurbin | Kacper Kowalik: the thing we're wondering is... when did the search for that file stop working for you? It should have stopped working in 2017. 😀 | 17:59:27 |
24 Jun 2021 |
poikilotherm | pdurbin: Look who just got merged. https://github.com/gdcc/dataverse/pull/6#event-4933611438 | 12:54:03 |
poikilotherm | It works automatically :-) | 12:54:12 |
poikilotherm | (It took some time, don't know why. Maybe waiting for Travis?) | 12:54:34 |
pdurbin | poikilotherm: cool. So you'll get all the commits from IQSS automatically plus some merge commits from the pull bot. | 14:00:38 |
poikilotherm | Yeah | 14:00:53 |
poikilotherm | Until someone feels like adding the container stuff to upstream | 14:01:32 |
poikilotherm | @pd | 14:35:13 |
poikilotherm | * pdurbin: got Docker? | 14:35:29 |
pdurbin | poikilotherm: yep | 15:30:41 |
poikilotherm | You might be interested in experimenting with Maven controlled container build & execution | 15:32:13 |
poikilotherm | After checking out the branch, it's a oneliner and some waiting until you can open a dev snapshot at localhost:8080 | 15:33:19 |
pdurbin | Nice. I know you've had this in a branch for a whlie. | 15:34:00 |
pdurbin | Oh, I see. You put a bunch of detail is Slack. How non-SLOPI of you. 😀 | 15:36:52 |
pdurbin | * Oh, I see. You put a bunch of detail in Slack. How non-SLOPI of you. 😀 | 15:36:59 |
poikilotherm | Hey devops peeps... I invested some time into a Maven controlled build of container images for Dataverse and a derived Solr image. Feel free to checkout https://github.com/gdcc/dataverse/tree/develop+ct It get's the latest and hottest commits from upstream develop automatically And if you have Docker installed, just use Maven to build and run a containerized dev version of Dataverse It's just mvn -Pct clean package docker:build docker:run (You'll need to add the gdcc fork as a remote first and then checkout the branch) It takes some time to build when there is no cache around, but at least it does not download the internet, reusing your local Maven packages. The container image for Dataverse is highly optimized for production usage, but can be used for development, too. If you folks wanna schedule a demo of what can be done with this, hit me (I could do a little YT screencast video, too) (bearbeitet) BTW scripts and Dockerfiles are checked for PRs with hadolint and shellcheck. Things to come:
- I want to add proper LABELS following https://github.com/opencontainers/image-spec/blob/master/annotations.md and push to Github Container Registry...
- Before pushing, I want to execute some basic tests if deployments work etc. This is mostly about securing that the images work, not so much about Dataverse itself
| 15:37:54 |
poikilotherm | Don Sizemore pdurbin you peeps might be interested in https://github.com/poikilotherm/dataverse/commit/624636992e4a27f0b52e430f0d54c983770a1b5c | 15:39:58 |
poikilotherm | Works with 5.2021.4 | 15:40:12 |
pdurbin | poikilotherm: that's better. Thanks! | 15:44:27 |