!bQveTkYXFyxLJQwcLG:matrix.org

Malleable Systems Collective

116 Members
https://malleable.systems | Code of conduct: https://malleable.systems/code-of-conduct | Forum: https://forum.malleable.systems | Logs: https://view.matrix.org/room/!bQveTkYXFyxLJQwcLG:matrix.org/29 Servers

Load older messages


SenderMessageTime
21 Mar 2024
@_bifrost_contrapunctus=40jabjab.de:aria-net.orgfugata changed their display name from contrapunctus to contrapunctus_.14:06:51
@_bifrost_contrapunctus=40jabjab.de:aria-net.orgfugata changed their display name from contrapunctus_ to fugata.14:07:02
22 Mar 2024
@indieterminacy:matrix.orgindieterminacy

khinsen: Just reading up on The Open Science Network and I saw that you are involved.
https://openscience.network/

h/t https://wedistribute.org/2024/03/bonfire-open-science/

Looks like a great initiative!

22:32:53
24 Mar 2024
@khinsen:matrix.orgkhinsen
In reply to @indieterminacy:matrix.org

khinsen: Just reading up on The Open Science Network and I saw that you are involved.
https://openscience.network/

h/t https://wedistribute.org/2024/03/bonfire-open-science/

Looks like a great initiative!

For now, I just promised to get involved, once there's a running service. It looks indeed like a promising intitiative!
17:52:50
25 Mar 2024
@_bifrost_wgreenhouse=40hmm.st:aria-net.orgwgreenhouse left the room.03:42:47
@_bifrost_contrapunctus=40jabjab.de:aria-net.orgfugata changed their display name from fugata to contrapunctus.11:56:05
@_bifrost_contrapunctus=40jabjab.de:aria-net.orgfugata changed their display name from contrapunctus to contrapunctus_.11:58:42
@_bifrost_contrapunctus=40jabjab.de:aria-net.orgfugata changed their display name from contrapunctus_ to fugata.11:58:49
@orion_reed:matrix.orgOrion Reed

Spent last night rebuilding my website (orionreed.com) and ended up, mostly successfully, building a PoC DOM -> Canvas translation. If you hit the button(s) at the top right you should see what I mean. I also wrote a little tweet thread that breaks it down a little more (https://twitter.com/OrionReedOne/status/1772271156373905465)

I think there's a lot of "low-hanging fruit" in UX-first interoperability. Where you get the pieces and the materials able to coexist and talk to each other, then you enrich them with more computation. I think canvases as an Information Substrate (in the sense coined by Michel Beaudouin-Lafon) have a pretty unique potential in moving towards a more integrateable HCI.

I don't mean that everything is spatial, or everything is whiteboard-esque, but that the properties they have as a medium for information are actually very well suited for integration of UX in a way that the DOM is not:

  • DOM is problematic to produce concurrently without coordination, leading to almost all production being at the scale of a page/document/website
  • DOM Layout is heavily restricted and not easily composed with independently-authored work
  • DOM has a tiny vocabulary for topological relationships (I mean in the representation, not in JS) such as hierarchy and sibling, where canvases can be much more expressive.

These are half-thoughts, I think there's some cool potential here, just wanted to poke this group and see if any thoughts emerge.

16:06:13
@bkil:matrix.orgbkilAnd what about accessibility?16:09:32
@orion_reed:matrix.orgOrion ReedHard to know what the future there looks like, but while any initial experimentation is almost inevitably going to have a poor accessibility model, I don't think there's anything innate that means this different kind of medium couldn't be (at least) as good as what we have today.16:12:15
@bkil:matrix.orgbkilUp to now, my preconception about canvas was the opposite of accessibility. Is there prior art how to build a whole SPA solely on canvas but still make it as accessible as if you were using DOM?16:29:32
@Ryuno-Ki:matrix.orgRyuno-Ki (André Jaenisch)Smells like a lot of ARIA16:55:34
@Ryuno-Ki:matrix.orgRyuno-Ki (André Jaenisch)I would rather see SVG as an alternative over Canvas16:55:53
@orion_reed:matrix.orgOrion ReedThe challenge with SVG is that it's a standard for drawing, not holding semantic or topological information, so for example a graph is made of actual geometry, not relationships. I did actually reach out to Chris Lilley recently, the inventor of SVG, as I recently roped myself into organising an interoperability working group for canvas systems (canvasprotocol.org)17:03:55
@indieterminacy:matrix.orgindieterminacyIve had an epiphany about representing details of my annotation form, Qiuy, in euclidean forms. Im a little dissapointed not to approached it that way given it having two sets containing 36 types in it.17:06:11
@bkil:matrix.orgbkil I'm still proud of my list-based tree visualization shared in #Web Design / Development - let me share it here as well https://bkil.gitlab.io/static-wonders.css/ux/groups-tags.html 17:09:16
@bkil:matrix.orgbkilWe could easily rotate it 90 degrees even.17:09:41
@orion_reed:matrix.orgOrion Reed
In reply to @bkil:matrix.org
Up to now, my preconception about canvas was the opposite of accessibility. Is there prior art how to build a whole SPA solely on canvas but still make it as accessible as if you were using DOM?

One near-term approach to this would be to try and keep all key information in a DOM which can be readily accessed by existing accessibility tech. Longer term, the challenges are shared with many other domains: How do we do accessibility for graph-shaped information? Or for interactions that are not transactional or command-based? Or where you need to interact with multiple overlapping hierarchies of information (and so on).

Lot's of open questions and it will always be harder to work against ubiquitous web standards/norms/tech because it's had decades to develop things like accessibility.

17:14:22
@bkil:matrix.orgbkilMy first idea would be to allow the visitor to traverse graphs interactively, revealing small neighborhoods at every step (possibly flattened to a 1 or 2-level tree or via some other form of abbreviation)17:16:40
@bkil:matrix.orgbkilAnd possibly provide for filtering operations to reduce the size of the graph.17:17:06
@bkil:matrix.orgbkilWe may be able to come up with better ideas if you shared a more concrete example we could iterate on.17:17:43
@orion_reed:matrix.orgOrion ReedOne thing the canvas-like substrates may have in their favour is that information is less spread out. It's easier to lump semantically-related information into single objects, making their interfaces/boundaries explicit in a way that can be hard to parse out of a DOM. You can still have both, too. For example the way I lumped stuff on my site together meant that the lists stayed as single objects with their own small DOM inside.17:18:07
@orion_reed:matrix.orgOrion ReedYou could also, for example, express relationships over an existing DOM as a way to augment it, not replace it. E.g. creating links between buttons/actions and being able to "wire them up" as a sequence which you can then trigger at once. Or to provide multiple views for an otherwise fixed layout. I think the exciting stuff is mostly complementary to, not competing with the existing architectures of the web.17:24:31
@Ryuno-Ki:matrix.orgRyuno-Ki (André Jaenisch)
In reply to @orion_reed:matrix.org
The challenge with SVG is that it's a standard for drawing, not holding semantic or topological information, so for example a graph is made of actual geometry, not relationships. I did actually reach out to Chris Lilley recently, the inventor of SVG, as I recently roped myself into organising an interoperability working group for canvas systems (canvasprotocol.org)
I hadn't heard that Canvas were a standard for holding semantic or topological information
17:45:27
@orion_reed:matrix.orgOrion Reed

imho the best descriptor of canvases is as information substrates (https://hal.science/hal-01614273/document). They define constraints on the data, context for its interpretation, and a means of presentation and interaction.

Certainly not a standard, as there are many for semantic and topological information. But canvases are in a slightly richer category as a medium which is intractable and visualisable from the outset. The working group I mentioned (with folks like tldraw, stately.ai, sage-3 and others) is hoping to make some headway on open standards/interop for not just presentational details but relational and semantic information too.

18:00:25
26 Mar 2024
@_bifrost_wgreenhouse=40hmm.st:aria-net.orgwgreenhouse joined the room.00:36:06
@_bifrost_wgreenhouse=40hmm.st:aria-net.orgwgreenhouse left the room.16:20:58
@_bifrost_wgreenhouse=40hmm.st:aria-net.orgwgreenhouse joined the room.17:03:50
@_bifrost_wgreenhouse=40hmm.st:aria-net.orgwgreenhouse left the room.19:09:06

Show newer messages


Back to Room ListRoom Version: 5