!vyoAfCLEKTekroqbEG:matrix.org

astronomy-commons GSoC

43 Members
Channel for astronomy-commons gsoc4 Servers

Load older messages


SenderMessageTime
27 Mar 2020
@techguybiswa:matrix.orgtechguybiswa * Hi bsipocz So regarding the project Jupyter widgets for spark, are you all running it this summer? 04:49:38
@_slack_uw-dirac_UCMFBJ36K:matrix.orgbsipocz
In reply to@_slack_uw-dirac_UCMFBJ36K:matrix.org
Hi @Dshivansh, We just had a call with the mentors for the project, and it became clear that we won’t be able to run this project this summer.
I urge you to look into the other projects being offered in Openastro. E.g. sunpy is a similarly big, mature organization with long history of mentoring successful gsoc projects. The other similarly veteran org is poliastro, but honestly I don’t know yet how their summer plans change, as Spain is being heavily affected in the pandemic, too.
04:49:55
@_slack_uw-dirac_UCMFBJ36K:matrix.orgbsipocz yes, the jupyter-spark project is going ahead, it is only the astropy n-way matcher. 04:50:20
@_slack_uw-dirac_UCMFBJ36K:matrix.orgbsipocz Had it been a normal summer, we could have run it, but we now just got enough extra on our plates to already see we can’t provide the level of mentoring the project deserves. We felt it’s fairer to say it now when there is still time to write a proposal for another project, than make the decision after the deadline passes. 04:52:22
@umerhasan17:matrix.orgumerhasan17
In reply to @_slack_uw-dirac_UCYHESQE8:matrix.org
Thanks for the demo, it looks excellent! It looks like Jupyter does a server side cross origin resource check (I found these issues: https://github.com/jupyterhub/jupyterhub/issues/1087, https://github.com/jupyterhub/jupyterhub/issues/1087). CORS can be enabled on the Jupyter-side by setting a configuration c.NotebookApp.allow_origin (a string; * will allow for all origins) and c.NotebookApp.allow_origin_pat (a regular expression to match against origins, e.g. localhost with any port would be a good one to set for us). I found this in the Jupyter docs: https://jupyter-notebook.readthedocs.io/en/stable/config.html. That might be a fix so that your demo doesn't require an extension to chrome to work
Hi Steven, I was looking into this while developing my extension as well. The error I received from the browser was that the request has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource. I thought this meant that we need to change spark configurations to append this header to the UI which is the requested resource in this case. This is why I thought modifying the Jupyter configurations which does the requesting wouldn't have made a difference. Is this incorrect?
16:31:32
@techguybiswa:matrix.orgtechguybiswa umerhasan17: Even I believe so. I mean the CORS needed to be configured on the spark side as the SPARK is causing the CORS issue. 17:07:26
@techguybiswa:matrix.orgtechguybiswa
In reply to @umerhasan17:matrix.org
Hi Steven, I was looking into this while developing my extension as well. The error I received from the browser was that the request has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource. I thought this meant that we need to change spark configurations to append this header to the UI which is the requested resource in this case. This is why I thought modifying the Jupyter configurations which does the requesting wouldn't have made a difference. Is this incorrect?
* umerhasan17: Even I believe so. I mean the CORS needed to be configured on the spark side as the SPARK is causing the CORS issue.
17:08:53
@umerhasan17:matrix.orgumerhasan17 Steven Stetzler: I've been looking through spark configurations but can't really find any mention of appending headers. I found a link where this was implemented in Java, but I'm not too sure how to implement the same for pyspark https://spinozakotlin.github.io/tutorials/cors. One way I thought we could bypass this is try to make the Jupyter server pretend to be a client so it can access like any other client. The other way is installing a chrome extension. 17:57:39
@_slack_uw-dirac_UCMFBJ36K:matrix.orgbsipocz (edited) ... see it we ... => ... see we ... 17:58:58
@_slack_uw-dirac_UCYHESQE8:matrix.orgSteven Stetzler
In reply to@umerhasan17:matrix.org
Steven Stetzler: I've been looking through spark configurations but can't really find any mention of appending headers. I found a link where this was implemented in Java, but I'm not too sure how to implement the same for pyspark https://spinozakotlin.github.io/tutorials/cors. One way I thought we could bypass this is try to make the Jupyter server pretend to be a client so it can access like any other client. The other way is installing a chrome extension.
thanks for looking into this, and thanks for the link. I think that that might refer to a different Spark project, one for building web applications (http://sparkjava.com/). What would making the Jupyter server pretend to be a client look like?
19:16:17
28 Mar 2020
@suyog_garg:matrix.orgsuyog_garg joined the room.17:44:18
@suyog_garg:matrix.orgsuyog_garg Hey bsipocz_matrix , I am highly interested in working the project: Null geodesics for Schwarzschild and Kerr Geometries. 
Can anyone inform how the mentors can be contacted?
17:49:58
@abhijeetmanhas:matrix.orgabhijeetmanhas
In reply to@suyog_garg:matrix.org
Hey bsipocz_matrix , I am highly interested in working the project: Null geodesics for Schwarzschild and Kerr Geometries. 
Can anyone inform how the mentors can be contacted?
Hey suyog_garg you can join #einsteinpy:openastronomy.org . You will find project mentors there.
17:58:22
29 Mar 2020
@hari_8:matrix.orghari_8 joined the room.07:25:18
@suyog_garg:matrix.orgsuyog_garg set a profile picture.08:14:16
@suyog_garg:matrix.orgsuyog_garg changed their profile picture.08:14:40
@umerhasan17:matrix.orgumerhasan17 Steven Stetzler: something similar to this https://medium.com/netscape/hacking-it-out-when-cors-wont-let-you-be-great-35f6206cc646. There is a need for a proxy which can also be locally as far as I can tell. 10:34:41
@shreyash.kawalkar:matrix.orgshreyash.kawalkar Hello Steven Stetzler , I have mailed you a drafted proposal on your official email ID few days back. I would like to get some feedbacks on it and comply the same as per your valuable feedback. 13:31:42
@shreyash.kawalkar:matrix.orgshreyash.kawalkar My mail id: shreyashk1997@gmail.com13:35:02
@shreyash.kawalkar:matrix.orgshreyash.kawalkarHello guys, regarding the rendition of external websites on jupyterlab extensions, I do agree with you all. In my opinion it would be optimal to develop a server extension to the same, preferably with python requests handlers and proxy-forward the requested website by web scraping the URLs and content embedded into them. Moreover, this would help us to facilitate additional functionalities to the end-user in future. It wouldn’t even further hamper with security issues. 13:49:11
@techguybiswa:matrix.orgtechguybiswa
In reply to @shreyash.kawalkar:matrix.org
Hello guys, regarding the rendition of external websites on jupyterlab extensions, I do agree with you all. In my opinion it would be optimal to develop a server extension to the same, preferably with python requests handlers and proxy-forward the requested website by web scraping the URLs and content embedded into them. Moreover, this would help us to facilitate additional functionalities to the end-user in future. It wouldn’t even further hamper with security issues.
Yeah web scraping the URL can be a way to fetch all the necessary details without dealing with any CORS or any iframe issues.
Agree on that part.
17:57:30
@techguybiswa:matrix.orgtechguybiswa And yes, Steven Stetzler I have also sent you my updated draft proposal on your mail id. 17:58:11
@bsipocz:matrix.orgbsipocz_matrix@room - Please remember, the gsoc application deadline is 1.5days away. Don't forget to upload the applications to the gsoc portal!23:21:29
7 Apr 2020
@suyash_salampuria:matrix.orgsuyash_salampuria set a profile picture.16:49:28
5 May 2020
@BobaMa:matrix.org@BobaMa:matrix.org left the room.21:47:23
22 May 2020
@cadair:openastronomy.orgAstroCadair removed their display name AstroCadair.14:21:04
@cadair:openastronomy.orgAstroCadair set their display name to AstroCadair.14:21:45
7 Jul 2020
@tegan349:matrix.org@tegan349:matrix.org joined the room.17:41:44
8 Jul 2020
@tegan349:matrix.org@tegan349:matrix.org left the room.00:55:22
3 Aug 2020
@wannabe_something:matrix.org@wannabe_something:matrix.org left the room.11:13:46

There are no newer messages yet.


Back to Room List