!SDKYnTgYyOXNBpJySp:matrix.org

cylc protocols & APIs

21 Members
HTTPS, WebSocket, ZeroMQ; REST, GraphQL1 Servers

Load older messages


SenderMessageTime
16 Dec 2022
@dwsutherland:matrix.orgDavid Sutherlandtechnically you could have jobs on the same host as scheduler being polled .. I don't know why you would11:14:24
@dwsutherland:matrix.orgDavid Sutherland(via the config)11:14:37
@oliver-sanders2:matrix.orgoliver sanders

Note that this configuration (on the scheduler host):

[platforms]
  [[foo]]
    communications method = https

Will cause jobs to use HTTPS comms (because we set the comms method as an environment variable in the job) but it will NOT cause non-job traffic to be routed in the same way. E.G. if you have an interactive session on that job platform your request will default to TCP comms. This is why we need to use the global config on the remote host to configure comms for non-job traffic which is why the platform comes out as localhost.

11:16:59
@oliver-sanders2:matrix.orgoliver sanders

[platform][localhost] is currently used for:

  • Local jobs.
  • Cylc servers (e.g. cylc executable, ssh command).
11:18:18
@oliver-sanders2:matrix.orgoliver sanders *

Bote [platform][localhost] is currently used for:

  • Local jobs.
  • Cylc servers (e.g. cylc executable, ssh command).
11:18:24
@oliver-sanders2:matrix.orgoliver sanders *

Nte [platform][localhost] is currently used for:

  • Local jobs.
  • Cylc servers (e.g. cylc executable, ssh command).
11:18:28
@oliver-sanders2:matrix.orgoliver sanders *

Note [platform][localhost] is currently used for:

  • Local jobs.
  • Cylc servers (e.g. cylc executable, ssh command).
11:18:31
@oliver-sanders2:matrix.orgoliver sanders *

Note [platform][localhost] is currently used for:

  • Local jobs (e.g. submission retry delays).
  • Cylc servers (e.g. cylc executable, ssh command).
11:18:46
@oliver-sanders2:matrix.orgoliver sanders *

Note [platform][localhost] is currently used for:

  • Local jobs (e.g. submission retry delays) for job comms.
  • Cylc servers (e.g. cylc executable, ssh command) for auto-restart, host-selection, etc.
11:19:17
@oliver-sanders2:matrix.orgoliver sanders
In reply to @dwsutherland:matrix.org
We still have to make sure things don't break when someone does something weird
I think we can reasonably refuse to allow poll as a job submission mode on localhost.
11:20:33
@oliver-sanders2:matrix.orgoliver sandersThe TCP ports should always be exposed because you're on the same machine. If you're using containers (on localhost) you can register them as independent platforms as we do in the CI test.11:21:38
@oliver-sanders2:matrix.orgoliver sanders * The TCP ports should always be exposed because you're on the same machine. If you're using containers (on localhost) you can register them as independent platforms as we do in the CI tests.11:21:41
@dwsutherland:matrix.orgDavid Sutherland

That's essentially how I had it, but under [CLI] instead of [platforms][localhost] (as https was also availble for the task platforms also)..

From what I gather, and what you've said, CYLC_TASK_COMMS_METHOD is loaded with value taken from the config local to the scheduler .. and is carried with the remote job, so there'd be no need to figure out the tasks platform/method remotely

Ok, will define comms method under localhost with only zmq and https as options

11:33:27
19 Jan 2023
@dwsutherland:matrix.orgDavid Sutherland

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?

If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking a call to itself in an infinite loop (using global config) 🤦‍♂️

03:22:53
@dwsutherland:matrix.orgDavid Sutherland *

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?

If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking a call to itself in an infinite loop (using global config) 🤦‍♂️ (until request timed out)

03:23:25
@dwsutherland:matrix.orgDavid Sutherland *

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?
https://github.com/cylc/cylc-flow/pull/5267
If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking a call to itself in an infinite loop (using global config) 🤦‍♂️ (until request timed out)

04:13:55
@dwsutherland:matrix.orgDavid Sutherland *

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?
https://github.com/cylc/cylc-flow/pull/5267
If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)
  • get that stop extension working via hub server stop (can be later)

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking a call to itself in an infinite loop (using global config) 🤦‍♂️ (until request timed out)

04:15:33
@dwsutherland:matrix.orgDavid Sutherland *

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?
https://github.com/cylc/cylc-flow/pull/5267
If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)
  • get that stop extension working via hub server stop (can be later)
  • documentation

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking a call to itself in an infinite loop (using global config) 🤦‍♂️ (until request timed out)

04:16:19
@dwsutherland:matrix.orgDavid Sutherland *

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?
https://github.com/cylc/cylc-flow/pull/5267
If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)
  • get that stop extension working via hub server stop (can be later)
  • documentation

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking an API call to itself in an infinite loop (using global config) 🤦‍♂️ (until request timed out)

04:20:11
@dwsutherland:matrix.orgDavid Sutherland *

oliver sanders: Do you want to get this:
https://github.com/oliver-sanders/cylc-flow/pull/new/swarm-https
into master or cli-via-uis branch?
https://github.com/cylc/cylc-flow/pull/5267
If I can get these sort of tests in, I just need the following to finish up:

  • add start-task as an option for play via the uis
  • figure out how to pass the hub proxy URL/name to the UIS on start up (if not already available, haven't found it yet)
  • get that stop extension working via hub server stop (can be later)
  • documentation

I was stuck on cylc-play via the UIS for a bit.. banging my head against a wall, until I realised the UIS was invoking an API call to itself in an infinite loop (when using global config comms method) 🤦‍♂️ (until request timed out)

04:20:42
@oliver-sanders2:matrix.orgoliver sandersIf you can get the swam tests running for HTTPS on the cli-via-uis branch that would subject HTTPS to the same testing as ZMQ and POLL which would be great. Really need to get SSH comms running in the swarm too but that proved a little difficult.10:03:08
17 Mar 2023
@metronnie:matrix.orgRonnie Dutta changed their display name from metronnie to Ronnie Dutta.11:38:16
30 Apr 2023
@imlostlmao:matrix.orgimlostlmao joined the room.07:51:26
14 May 2023
@ralph:fx45.in@ralph:fx45.in joined the room.00:13:24
18 May 2023
@gvlx:matrix.org@gvlx:matrix.org changed their profile picture.16:14:37
20 May 2023
@ralph:fx45.in@ralph:fx45.in left the room.21:19:43
29 Jun 2023
@revilo666:matrix.orgHilary Oliver David Sutherland: any thoughts on this one: https://github.com/cylc/cylc-flow/issues/5609 22:33:09
1 Oct 2023
@tony++:matrix.org@tony++:matrix.org joined the room.20:40:50
2 Oct 2023
@tony++:matrix.org@tony++:matrix.org left the room.19:22:17
26 Mar 2024
@gvlx:matrix.org@gvlx:matrix.org left the room.15:19:30

There are no newer messages yet.


Back to Room ListRoom Version: 1