Sender | Message | Time |
---|---|---|
7 Dec 2022 | ||
David Sutherland | Will add the above to the issue | 08:26:36 |
David Matthews | I'd have thought the platform configuration is sufficient but maybe I'm getting confused as to how we see this method being used. Perhaps one to debate further at the next VC? | 13:42:49 |
oliver sanders | Yep, the comms method is only for jobs ATM, however, I think there may be legit use cases for allowing it to be configurable e.g. if the required ports are not open between the client machine and the Scheduler hosts (in which case SSH+TCP would make sense). I think this was just an oversight :( Should be simple to resolve though, just need to load the global config in the client factory function thinngy that decides which client we get. I've put up an issue for this: https://github.com/cylc/cylc-flow/issues/5235#issuecomment-1340604947 | 17:45:02 |
David Sutherland | Definitely a use case if http/hub-proxy has more reach than the tcp local network .. you can just copy the api info, then run commands remotely | 19:41:03 |
David Sutherland | this will allow for websockets, next, so we can have graphql subs on the command line (while I work on sch subs) | 20:06:14 |
David Sutherland | I know the justification of CLI http, but I'm not sure there's any justification for job communications over HTTP (even though it can easily be done).. do I or don't I add an option to platforms:
| 22:09:12 |
David Sutherland | because if they can ssh jobs to remote platforms, won't they ssh back to invoke the job messaging if needed? | 22:10:20 |
David Sutherland | or is it one way? and if so, is there ever the case tcp comms are blocked from the remote but http open I vaguely remember in our NZ gathering, someone talking about needed HTTP CLI access on a remote machine | 22:12:20 |
David Sutherland | * or is it one way? and if so, is there ever the case tcp comms are blocked from the remote but http open I vaguely remember in our NZ gathering, someone talking about needing HTTP CLI access on a remote machine | 22:12:38 |
David Sutherland | this can go through the hub proxy (BTW) | 22:13:46 |
David Sutherland | * this http can go through the hub proxy (BTW) | 22:14:02 |
David Sutherland | * this http can go through the hub proxy (BTW), If I manage to know what url it's using when writing the api_info.json | 22:14:56 |
Hilary Oliver | If it's easy to support multiple comms methods here, fine. However, at some point we probably have say "this is how Cylc works; if you want to use Cylc make the business case to your HPC admins that they need to open the appropriate comms channels" | 22:15:28 |
David Sutherland | * this http can go through the hub proxy (BTW), If I manage to know what host and port it's using when writing the api_info.json | 22:15:30 |
David Sutherland | Yeah, this is easy to support.. I'm just using UIS existing libs at the moment, and requiring UIS installation | 22:16:45 |
David Sutherland | Actually sorry, just installed a new environment to check, I did install the requests library in the UIS env. But there may/will be other libraries that can make requests and are already included. | 22:45:54 |
8 Dec 2022 | ||
David Matthews | Tim Whitcomb raised the requirement to use https for task comms, see https://cylc.github.io/cylc-admin/feb2020-workshop-notes | 07:37:15 |
16 Dec 2022 | ||
David Sutherland |
How does comms method If I use the same | 05:11:36 |
David Sutherland | *
How does comms method If I use the same | 05:12:29 |
David Sutherland | Also why just
Guess I answered my own question 😅 | 05:49:01 |
David Sutherland | * Also why just
Guess I answered my own question 😅 | 05:53:59 |
David Sutherland | * Also why just
Guess I answered my own question 😅 | 06:29:46 |
oliver sanders | In reply to @dwsutherland:matrix.orgPoll doesn't make sense for localhost job comms either. | 11:10:19 |
oliver sanders | In reply to @dwsutherland:matrix.orgBecause this comms method must be set in the global config on the host it applies to it will always be locahost that we configure this for. | 11:11:56 |
David Sutherland | That was kinda my point.. but I have seen workflows with poll set for all jobs XD | 11:12:12 |
David Sutherland | * That was kinda my point.. but I have seen workflows with poll set for all tasks XD | 11:12:28 |
oliver sanders | By workflows you mean global configurations? | 11:12:37 |
oliver sanders | (we can't set communications method at the workflow level in Cylc 8) | 11:12:49 |
David Sutherland | In reply to @oliver-sanders2:matrix.orgCylc7 | 11:13:05 |
David Sutherland | We still have to make sure things don't break when someone does something weird | 11:13:44 |