!AmypvmJtUjBesRrnLM:matrix.org

dataverse

192 Members
Dataverse is open source research data repository software: http://dataverse.org Public logs at https://view.matrix.org/alias/%23dataverse:matrix.org10 Servers

Load older messages


SenderMessageTime
13 Aug 2021
@analia-s:matrix.organalia-sthanks! but, I already increased the limit to 4GB. But if there may be research files of 15GB or more and I would like to know how to upload them from the server or ftp14:44:15
@pdurbin:matrix.orgpdurbinOoooh, I see. Yes, you probably need to look at timeouts and such. Are you running Apache?14:47:25
@pdurbin:matrix.orgpdurbinAlso, what do you have for http.request-timeout-seconds? This: https://guides.dataverse.org/en/5.6/installation/config.html#http-request-timeout-seconds14:52:29
@pdurbin:matrix.orgpdurbinI must say that for files as large as 15 GB, the best solution we have right now is direct upload to S3: https://guides.dataverse.org/en/5.6/developers/big-data-support.html#s3-direct-upload-and-download14:53:41
@pdurbin:matrix.orgpdurbinBut you have to be using S3 for storage.14:53:50
@pdurbin:matrix.orgpdurbinWhich we are for Harvard Dataverse, and direct upload (and download) is great. The idea is for the client to talk to S3 directly (after a brief handoff from Dataverse).14:54:34
@analia-s:matrix.organalia-sI already configured the timeout, but I need to know if there is another way to upload files that exceed the limit, I know there is a trick but they did not explain its procedure to me.14:58:13
@pdurbin:matrix.orgpdurbinWell, like I said, you can switch to S3 if you aren't already on S3.15:27:41
@pdurbin:matrix.orgpdurbinThere's also stuff that's in development like Globus support.15:27:57
@analia-s:matrix.organalia-sThanks!15:43:29
@pdurbin:matrix.orgpdurbinSure. For more opinions you can also try the mailing list: https://groups.google.com/g/dataverse-community15:46:38
@pdurbin:matrix.orgpdurbinI'm heading out. Have a great weekend, everyone!20:47:39
16 Aug 2021
@pacian:matrix.orgpacianDear Philip and Dataverse Community, Our current Test Dataverse Environment for Researchers Only VMware Test Environment running Dataverse version 5.5 (Public port 443 only) All other ports, i.e., 4848, is accessible only through the university VPN Standard out-of-the-box configuration and settings with Make Data Count and File Previewer Local Dataverse Authentication (soon to test SSo (OIDC) Questions relating to SSO: SAML version 2.0 / OIDC Please note: We have determined that we will use OIDC for our SSO. We also anticipate our production environment to be very similar to our test environment. Given the above details for our Dataverse Test Environment, we are trying to determine if our researchers will be able to utilize API's with the use of the API tokens should we implement SSO (OIDC) Thank you in advance, Regards, Richard Dennis Special Advisor - Data Steward Copenhagen University Library11:09:24
@pdurbin:matrix.orgpdurbin pacian: yes, your OIDC users will be able to use API tokens. 15:11:35
@pdurbin:matrix.orgpdurbin(All users can use API tokens.)15:12:05
17 Aug 2021
@beckf:matrix.orgFrederic Beck joined the room.07:38:09
@beckf:matrix.orgFrederic BeckHello We have a dataverse instance running installed via the dataverse-ansible playbook After some network changes (IP address), we ran again the playbook to adapt the instance to the new parameters However, the interface does not display anymore our dataverses and datasets, but they are stil in the DB07:40:10
@pdurbin:matrix.orgpdurbin Frederic Beck: hmm. Maybe you need to reindex? https://guides.dataverse.org/en/5.6/admin/solr-search-index.html#full-reindex 14:25:03
@beckf:matrix.orgFrederic BeckI thought of something like that, I tried to reinstall the solr part but did not reindex yet, I'll give it a try as soon as the entworking issues are solved14:29:08
@beckf:matrix.orgFrederic Beckthanks14:30:12
@pdurbin:matrix.orgpdurbin Cool. Also, Don Sizemore can tell us more about dataverse-ansible but I think it's designed to only run once when you're first setting up the server. I've never run in twice on the same server. 14:34:49
@donsizemore:matrix.orgDon Sizemoreit was designed (and is mostly used) for initial installation, but offers Ansible tags for particular tasks (like "solr")14:36:26
@pdurbin:matrix.orgpdurbin poikilotherm: thanks for https://github.com/IQSS/dataverse/pull/7695 . I just pushed a fix so the docs will build. What's the easiest way for me to FACELETS_REFRESH_PERIOD? Hack on domain.xml? And add a system property? 18:53:02
@pdurbin:matrix.orgpdurbinIt works!19:57:31
@pdurbin:matrix.orgpdurbinasadmin create-system-properties "dataverse.jsf.refresh-period=1"19:57:48
@oliver:bertuch.namepoikilothermVery nice20:49:38
@oliver:bertuch.namepoikilothermThx for the docs fix20:49:45
@pdurbin:matrix.orgpdurbinSure. I pushed a couple more commits and moved it to QA. Can't wait to see it merged. Thanks again.20:50:43
@oliver:bertuch.namepoikilotherm🤩20:51:33
@oliver:bertuch.namepoikilothermGreat if sth makes DX better20:51:43

Show newer messages


Back to Room ListRoom Version: 6