| 21 Jan 2022 |
 Lincoln | In reply to @donsizemore:matrix.org
when you enabled direct uploads, did you enable CORS on the bucket? * i enabled the CORS but while uploading via gui I am getting "Upload Unsuccessful (0:Network Error)" | 12:18:45 |
 Don Sizemore | is your Ceph host reachable by the uploading client? | 12:20:49 |
| Lincoln | no direct access to client | 12:21:23 |
| Don Sizemore | I believe that's the problem. To use upload- and download redirects, the storage must be directly accessible. | 12:21:52 |
| Don Sizemore | Jim Myers could tell you more, either on dataverse-users or in the community Slack | 12:22:30 |
| Lincoln | In reply to @donsizemore:matrix.org
is your Ceph host reachable by the uploading client? just to be clear, do you mean User having PUT and GET access to buckets location? | 12:24:07 |
| Don Sizemore | My understanding is that, in case of direct upload or download, Dataverse generates a pre-signed URL which it hands off to the client. | 12:24:36 |
| Don Sizemore | So if the client can't connect to the storage service, the request will fail. | 12:24:58 |
| Lincoln | thank you for the info... Any workarounds | 12:27:27 |
| Lincoln | viz: Reverse Proxy | 12:27:48 |
| Lincoln | In reply to @donsizemore:matrix.org
My understanding is that, in case of direct upload or download, Dataverse generates a pre-signed URL which it hands off to the client. Also i as an admin am also cannot upload any files directly via S3 | 12:28:47 |
| Don Sizemore | I vaguely remember mailing list chatter about such a solution, but it's been a while. | 12:28:59 |
| Don Sizemore | If you suspect trouble with the S3 service, can you manually list and put to Ceph via CLI as your Dataverse service account? | 12:29:22 |
| Lincoln | i can manually list down buckets via CLI | 12:30:43 |
| Don Sizemore | can you manually upload a test file/ | 12:31:01 |
| Lincoln | with upload-redirect = true in domain.xml file..... No
orselse i have uploaded till 2GB of files on s3 (but via payara) | 12:31:48 |
| Don Sizemore | what did you mean when you said "Also i as an admin am also cannot upload any files directly via S3" | 12:32:53 |
| Don Sizemore | you'll want the payara/dataverse service account user to be able to list/read/write files, and also to update object tagging | 12:33:25 |
| Lincoln | In reply to @donsizemore:matrix.org
what did you mean when you said "Also i as an admin am also cannot upload any files directly via S3" i mean when "upload-redirect= true" I cannot upload via gui to s3 as admin as well | 12:35:46 |
| Don Sizemore | but, as the dataverse/payara service account user, you can manually upload a file? | 12:36:17 |
| Lincoln | In reply to @donsizemore:matrix.org
but, as the dataverse/payara service account user, you can manually upload a file? .let me check again | 12:39:48 |
| Lincoln | please | 12:40:18 |
| Don Sizemore | I was just double-checking because of the "admin cannot upload" sentence, but it sounds like you'll want to experiment with a reverse proxy, or leave direct upload and download disabled. | 12:40:46 |
| Lincoln | the idea is to enable direct upload-dwnload for all dataverse users | 12:41:49 |
| Lincoln | In reply to @donsizemore:matrix.org
but, as the dataverse/payara service account user, you can manually upload a file? sadly No | 12:48:42 |
| Don Sizemore | Arizona had trouble like this with Dell S3 storage - they solved it by updating the firmware | 12:53:31 |
| Lincoln | oh | 12:56:30 |
| 24 Jan 2022 |
 nightowlaz | hey there, just saw this (i'm from arizona) .. we got the dell s3 storage working without direct upload, but when we enable direct upload we get the same error (0network error) .. I believe that is because the s3 bucket is on a private subnet in the OneFS software .. waiting for the admins of the storage to add a public zone so we can test that theory .. would like to set up a reverse proxy to see if that works but not sure how to do that | 03:45:51 |
| nightowlaz | so we don't have to make the bucket public .. or something like CORS | 03:46:59 |
| Lincoln | In reply to @nightowlaz:matrix.org
hey there, just saw this (i'm from arizona) .. we got the dell s3 storage working without direct upload, but when we enable direct upload we get the same error (0network error) .. I believe that is because the s3 bucket is on a private subnet in the OneFS software .. waiting for the admins of the storage to add a public zone so we can test that theory .. would like to set up a reverse proxy to see if that works but not sure how to do that nightowlaz: thank you for the info...( i am also in the same scenario) | 08:01:46 |
