!jZUPVDWqESwCibUpnD:matrix.org

#webrtc:matrix.org

119 Members
All about using Matrix as a WebRTC signalling layer45 Servers

Load older messages


SenderMessageTime
1 May 2021
@ianprinz:matrix.org@ianprinz:matrix.org left the room.10:41:20
5 May 2021
@hemantkashniyal:matrix.org@hemantkashniyal:matrix.org joined the room.03:47:44
@hemantkashniyal:matrix.org@hemantkashniyal:matrix.org left the room.03:48:08
8 May 2021
@m3r0v1ng10:matrix.org@m3r0v1ng10:matrix.org changed their profile picture.06:08:31
@m3r0v1ng10:matrix.org@m3r0v1ng10:matrix.org changed their display name from M3r0v1ng10 to m3r0v1ng10.06:09:04
@m3r0v1ng10:matrix.org@m3r0v1ng10:matrix.org changed their profile picture.06:13:21
9 May 2021
@m3r0v1ng10:matrix.org@m3r0v1ng10:matrix.org left the room.20:36:51
11 May 2021
@sir_hiss:matrix.orgsir_hiss joined the room.06:04:59
@server_stats:nordgedanken.dev@server_stats:nordgedanken.dev set a profile picture.12:41:28
13 May 2021
@initpwn:matrix.orginitpwn joined the room.20:26:17
14 May 2021
@neilj:matrix.orgneil changed their display name from neil to neil_away.06:37:46
18 May 2021
@neilj:matrix.orgneil changed their display name from neil_away to neil.07:55:56
20 May 2021
@colemickens:matrix.orgcolemickens πŸ³οΈβ€πŸŒˆ changed their display name from colemickens to colemickens πŸ³οΈβ€πŸŒˆ.21:03:51
25 May 2021
@paulinalundin:matrix.orgPaulina changed their display name from Paulina to Paulina [Away].16:19:36
26 May 2021
@TimSmall:matrix.org@TimSmall:matrix.org left the room.19:04:26
29 May 2021
@matthew:matrix.orgMatthew changed their display name from Matthew to Matthew (away).05:13:51
30 May 2021
@waytt:matrix.orgwaytt joined the room.23:17:19
1 Jun 2021
@paulinalundin:matrix.orgPaulina changed their display name from Paulina [Away] to Paulina.07:52:57
2 Jun 2021
@samkuhn:matrix.orgsamkuhn joined the room.11:27:22
5 Jun 2021
@tobiasfella:kde.org@tobiasfella:kde.org left the room.20:07:52
6 Jun 2021
@matthew:matrix.orgMatthew changed their display name from Matthew (away) to Matthew.22:06:54
10 Jun 2021
@lalpi:matrix.org@lalpi:matrix.org joined the room.11:37:26
@lalpi:matrix.org@lalpi:matrix.org left the room.11:38:31
19 Jun 2021
@Thulinma:matrix.orgThulinma (old acc) changed their profile picture.14:18:25
@Thulinma:matrix.orgThulinma (old acc)

Hey all! I posted this a few times over the last few years, but figured I'd try again: I'm the lead dev on a (partially) open source media server project, which supports WebRTC as input and output. I am / we are interested in connecting the media server to Matrix for WebRTC signalling, but my knowledge of Matrix internals is not high enough to know the best way to make such a connection/integration. Is there anyone I could have a chat with to figure out the best way to do this (if at all)? Thanks in advance for anyone that may have the time and/or insight to assist. Feel free to either respond here or PM me.

There are also other types of integration beyond WebRTC that might be useful/worthwhile (e.g. chatroom linking to video - which might be cool as we are the backend for several semi-big streaming services), but this is probably not the right channel to discuss those πŸ˜…. Still, if anyone wants to talk about that, same goes in terms of reaching out to me. (And/or feel free to invite me into a more appropriate channel to discuss further.)

20:38:41
20 Jun 2021
@simon.brandner:envs.netΕ imon Brandner Thulinma: could you perhaps share a bit more info about the project? 06:50:50
@Thulinma:matrix.orgThulinma (old acc)
In reply to @simon.brandner:envs.net
Thulinma: could you perhaps share a bit more info about the project?

Of course. I'm talking about www.mistserver.org . The software specializes in transmuxing and protocol to protocol conversion (e.g. file to stream, stream to file, stream to other-type-of-stream) and mostly read/writes end-consumer formats, such as WebRTC, HLS, DASH, MP4, MKV, RTMP, RTSP, MPEG-TS, MSE, etcetera. In this context, perhaps the most interesting use of the software is that by Picarto.tv, one of the biggest (albeit niche) competitors to Twitch.

Some possible use cases I can think of off the top of my head with Matrix:

  • Ability to open streams (or practically any kind of media data) as a video/audio call.
  • Ability to record a video call and/or forward it to any streaming service.
  • Potentially to act as a simplified video conference bridge (switching the video feed to the feed with the loudest audio stream, while merging all audio streams together, for example - negating the need to transcode anything). This use case would require the most work on our end, though.
  • In general bridging video/audio calls to almost any kind of media available in almost any kind of format, regarding input or output or both.
11:04:18
@dave:matrix.orgDave
In reply to @Thulinma:matrix.org

Hey all! I posted this a few times over the last few years, but figured I'd try again: I'm the lead dev on a (partially) open source media server project, which supports WebRTC as input and output. I am / we are interested in connecting the media server to Matrix for WebRTC signalling, but my knowledge of Matrix internals is not high enough to know the best way to make such a connection/integration. Is there anyone I could have a chat with to figure out the best way to do this (if at all)? Thanks in advance for anyone that may have the time and/or insight to assist. Feel free to either respond here or PM me.

There are also other types of integration beyond WebRTC that might be useful/worthwhile (e.g. chatroom linking to video - which might be cool as we are the backend for several semi-big streaming services), but this is probably not the right channel to discuss those πŸ˜…. Still, if anyone wants to talk about that, same goes in terms of reaching out to me. (And/or feel free to invite me into a more appropriate channel to discuss further.)

it should be fairly straightforward: once you have a matrix client library of some kind, you'll just be exchanging offers and answers containing SDP over matrix messages, just like you'd set up any WebRTC connection
14:12:49
@dave:matrix.orgDavehttps://spec.matrix.org/unstable/client-server-api/#voice-over-ip is the section in the spec for the signalling messages, and https://github.com/matrix-org/matrix-doc/pull/2746/files is the update to voip version 1 which at the moment needs to be read alongside14:14:32
@Thulinma:matrix.orgThulinma (old acc)

Yeah it's not so much the spec itself I wanted guidance on, but more... what kind of integration makes sense from a Matrix point of view?

Should I implement an Application Service, for example? Or would it be better if I had some sort of minimal homeserver inside the streaming server? Does it make more sense for every stream to be a "user" on the network, and open up potentially hundreds of client connections? Ideally I would like to have as little Matrix-specific code in the media server as possible, but I assume there will have to be some to make things work nicely.

While I have been using Matrix on and off over the last ~4 years or so, and am familiar with the basics from a chat perspective, I am not sure I can make the best calls when it comes to what "the community" would like to see from this kind of integration.

My gut tells me an application service would be the best fit, which then creates a namespace for rooms that "are" media streams. Calling such a room should then connect to the stream, while chatting in it could fill stream metadata tracks (think real-time subtitling, for example) or connect to the stream's chat room (which we haven't implemented inside the software at all yet, and I think it would be better to do some kind of Matrix integration rather than reinventing the wheel here).

Does that sound reasonable, or do I have it all wrong?

17:09:48

Show newer messages


Back to Room List