!KOGBGqVOBKJjKLgFUY:matrix.org

Caster

98 Members
Caster is a collection of tools aimed at enabling programming and accessibility entirely by voice built upon the Dragonfly API.28 Servers

Load older messages


SenderMessageTime
5 Aug 2020
@gitter_tietyt:matrix.orgtieTYT (Gitter) that's interesting. I'm definitely used numb for longer numbers. I guess there's something flaky about it 18:57:56
@gitter_lexiconcode:matrix.orgLexiconCode (Gitter) it seems numb does not want to exceed 4 whole numbers in one utterance. For instance one could say 12345 and it only outputs 1234. 19:16:07
@gitter_lexiconcode:matrix.orgLexiconCode (Gitter) (edited) ... one utterance. For instance one could say `12345` and it only outputs `1234`. => ... one utterance when dictating single digits. For instance one could say `12345` and it only outputs `1234`. 19:16:20
@gitter_lexiconcode:matrix.orgLexiconCode (Gitter) (edited) ... `1234`. => ... `1234`. I won't be able to take a look at this until next Monday as I am actually leaving in a few minutes for Vacation. 19:17:24
@gitter_lexiconcode:matrix.orgLexiconCode (Gitter) (edited) ... for Vacation. => ... for a Vacation. 19:17:32
@gitter_lexiconcode:matrix.orgLexiconCode (Gitter) if I had time to test I would verify any issues with the dragonfly grammar. Also I would and experiment with a caster mapping rule. finally I would verify that the integer range is not being truncated/changed wnKK in the merger process. 19:21:13
6 Aug 2020
@gitter_danesprite:matrix.orgDane Finlay (Gitter) This seems like a bug with ShortIntegerRef and not a Caster issue. I will have a look into it. Hope you have a nice vacation @LexiconCode :-) 07:56:10
@gitter_danesprite:matrix.orgDane Finlay (Gitter) @mrob95 Any idea why this problem with ShortIntegerRef might be happening? 13:38:54
@gitter_mrob95:matrix.orgMike Roberts (Gitter)Will take a look14:09:29
@gitter_mrob95:matrix.orgMike Roberts (Gitter) Looks like the functionality is just not implemented - the original use case was for easily selecting line numbers which would usually be in the <10000 range. We can make it adopt IntegerRef's behaviour in the high numbers? 14:20:27
@gitter_mrob95:matrix.orgMike Roberts (Gitter) (edited) ... selecting line numbers ... => ... selecting line/page numbers ... 14:20:38
7 Aug 2020
@gitter_tietyt:matrix.orgtieTYT (Gitter) would this explain why I can't say numb 005? 03:31:25
@gitter_tietyt:matrix.orgtieTYT (Gitter)it comes out as 003:31:28
8 Aug 2020
@gitter_danesprite:matrix.orgDane Finlay (Gitter)

@mrob95 Thanks. Looks like your solution works nicely :+1:

@tieTYT IntegerRef and ShortInteger aren't written for that. It would be a nice addition. One problem with it is that the end result would still be 5 when the words are parsed to an integer.

05:09:46
@gitter_tietyt:matrix.orgtieTYT (Gitter)well, the reason I would want that feature is so that I could dictate forms that require credit card numbers etc. sometimes those numbers start with multiple zeros. Is it a fair feature request?05:52:18
@gitter_danesprite:matrix.orgDane Finlay (Gitter) Yes, that's fair. There are already Dragonfly element classes for this: Digits and DigitsRef. I don't think they're properly documented at the moment. Try using DigitsRef("d", 1, 12, as_int=False) as an extra. The value you get will be a list of the numbers spoken. 06:20:36
@gitter_danesprite:matrix.orgDane Finlay (Gitter)Might be something to add to Caster.06:21:39
@kamilla:fairydust.spacekamilla joined the room.09:08:12
@gitter_activegamedev:matrix.orgMatt Wilson (Gitter) Is it possible to use other sounds to control commands? Say I wanted to click my tongue to substitute saying "kick" 18:58:33
@gitter_esc123:matrix.orgesc123 (Gitter) @beyondaxis Yes but in a very limited way. I’ll copy and paste something I read from another Caster contributor (fortunately I didn’t record who it was) but im sure they can chime in as well if they see this 19:24:54
@gitter_esc123:matrix.orgesc123 (Gitter)

"Unfortunately accuracy can drop if you try to use too many and some combinations do not work well due to phonetic distinctiveness issues. Furthermore, wannabe sounds might be a better description as:

I have no idea how to get things to work with sounds that can not be mapped to letters( so for instance no pops), if anyone has experimented with that and would like to share that would be very interesting!

interestingly, the dragonflies spec will be recognized both if we make a sound or if we spell it. For example , for fffp you can make a sound like here (or adapt a little bit), but it will also recognize if you say FP ( pronounced the same way you would speak fps)

so this is clearly inferior to what dedicated noise recognition systems can do, but I would say it is good enough to get some basic things done. I have been using these lately for things like going up or down, switching between tabs, triggering vimmium , going back and forth in history when browsing or for switching between commonly used applications and so far so good! on my end with DNS 15 home and FlexyMike DEC, unless overloaded Dragon doesn't usually have much of a problem differentiating for instance between shhp,sssp,fffp,tttp,pppp,xxxp,kkkp or fffp,ffft,fffk,fffx,fffs and so on,so you have quite a few options!"

19:25:26
@gitter_esc123:matrix.orgesc123 (Gitter) (edited) ... as: I have no idea how to get things to work with sounds that can not be mapped to letters( so for instance no pops), if anyone has experimented with that and would like to share that would be very interesting! interestingly, the ... => ... as: I have no idea how to get things to work with sounds that can not be mapped to letters( so for instance no pops), if anyone has experimented with that and would like to share that would be very interesting! interestingly, the ... 19:26:26
@gitter_esc123:matrix.orgesc123 (Gitter)Again this was copied from someone else but can confirm that these noises work as long as 4 letters are used as described19:27:30
@gitter_esc123:matrix.orgesc123 (Gitter) (edited) Again this was copied from someone else but can confirm that these noises work as long as 4 letters are used as described => @beyondaxis Yes but in a very limited way. I’ll copy and paste something I read from another Caster contributor (unfortunately I didn’t record who it was) but im sure they can chime in as well if they see this 19:28:40
@gitter_esc123:matrix.orgesc123 (Gitter) (edited) @beyondaxis Yes but in a very limited way. I’ll copy and paste something I read from another Caster contributor (unfortunately I didn’t record who it was) but im sure they can chime in as well if they see this => "On a random notice, a small update in case anyone is interested in "sounds" with Dragon. after some experimenting, it seems that Dragon can support quiet a few "sounds" without needing to launch accuracy tuning. At the moment I think I have tried around 30 different ones for which we can make dragonfly rules including stuff like shhp,pppf,pppt,tttk,ssss,xxxx. It seems that that the key to get Dragon to recognize those sounds, is to drag the dragonfly specs to them 4 letters or longer. for example, a rule ffp will not work in my end, whereas fffp will! Unfortunately accuracy can drop if you try to use too many and some combinations do not work well due to phonetic distinctiveness issues. Furthermore, wannabe sounds might be a better description as: I have no idea how to get things to work with sounds that can not be mapped to letters( so for instance no pops), if anyone has experimented with that and would like to share that would be very interesting! interestingly, the dragonflies spec will be recognized both if we make a sound or if we spell it. For example , for fffp you can make a sound like here (or adapt a little bit), but it will also recognize if you say FP ( pronounced the same way you would speak fps) so this is clearly inferior to what dedicated noise recognition systems can do, but I would say it is good enough to get some basic things done. I have been using these lately for things like going up or down, switching between tabs, triggering vimmium , going back and forth in history when browsing or for switching between commonly used applications and so far so good! on my end with DNS 15 home and FlexyMike DEC, unless overloaded Dragon doesn't usually have much of a problem differentiating for instance between shhp,sssp,fffp,tttp,pppp,xxxp,kkkp or fffp,ffft,fffk,fffx,fffs and so on,so you have quite a few options!" 19:29:48
@gitter_mpourmpoulis:matrix.orgKitsios Panagiotis (Gitter)

@esc123 thanks for sharing my old post and giving it a try! It is good to know that others reproduce this:)

@beyondaxis While general-purpose noise recognition with arbitrary sounds does not seem possible with DNS, it does end up ,whether intentionally or by accident, supporting a whole bunch of "letters like" sounds such as fffp,shhh,shhp,pppx,pppt, as long as you pay attention to the four letter trick. of course this is kinda limiting( so you cann't do that tongue click) but it is more than good enough to replace a lot of monosyllables but you might be using for various common tasks like page_up/page_down,next/previous tab,triggering vimium and so on. At the moment, I think I am using about a dozen of such sounds and it is making a world of difference for me,I can highly recommend giving it a try.

For those interested,at #825 there is an example noise grammar for Chrome to get you quickly started

21:31:50
9 Aug 2020
@gitter_esc123:matrix.orgesc123 (Gitter) @mpourmpoulis yeah sorry. I copied and pasted it and just forgot where I had read it. I haven't really incorporated any of the sounds into my grammars yet but I will try your chrome script in the next day or two. Using it for Vimmium, page navigation etc. may be a very good use case for this kind of thing. Thanks for sharing it! 07:26:05
@taylorine:utwente.iotaylorine joined the room.09:14:31
@kai:kde.orgkai 09:19:34
10 Aug 2020
@woody:poddery.comwoody joined the room.21:32:16

There are no newer messages yet.


Back to Room List